Embed Size (px)
Citation preview
2
Altmetrics
• “"...is the creation and study of new metrics based on the Social Web for analyzing, and informing scholarship."” Coined by Jason Priem in 2010
• “ the study and use of non-traditional scholarly impact measures that are based on activity in web-based environments.” POLS
2014臺灣學術機構典藏 (TAIR)研討會
3
The thrusts behind altmetrics: evaluation
• Reflect the concern over “journalization of science”– Outputs
• The rise of social media as a place to generate scholarly impacts – Impacts
2014臺灣學術機構典藏 (TAIR)研討會
4
Changing definition of scholarly outputs
• The new NSF policy states: “Acceptable products must be citable and accessible including but not limited to publications, data sets, software, patents, and copyrights. “
• “Altmetrics give a fuller picture of how research products have influenced conversation, thought and behaviour.” Heather Piwowar
2014臺灣學術機構典藏 (TAIR)研討會
5
Alternative research outputs
• Research database• Scientific software• Poster and presentation at conferences, in particular
in the medical sciences • Electronic theses and dissertations • Performances in film, theater, and music • Lectures, online classes and other teaching activities
2014臺灣學術機構典藏 (TAIR)研討會
6
More inclusive evidences of impact
2014臺灣學術機構典藏 (TAIR)研討會
7
Table 1
Descriptive statistics of the metrics and overall scholarly performance variables
Mean SD Median Maximum Minimum # of articles in the press 25.68 71.59 1 426 0
# of non-academic articles 5.75 14.04 2 93 0
# of syllabi citations 56.84 98.17 19 488 0
# of circulation 417.18 741.39 86 3750 0
# of citations in TH&D 740.44 998.86 407 4420 0
# of Th&D supervised 31.56 53.59 13 336 0
Wikipedia presence 1.72 3.59 0 18 0
Webometrics Visibility 13.75 56.49 1 422 0
Webometrics Size 77.05 325.28 4 2356 0
Webometrics Rich Files 30.67 111.68 0 739 0
Webometrics Scholar 1.25 6.21 0 40 0
# of citations in THCI 25.16 70.92 3 497 0
# of citations in ACI 121.88 189.50 61 1093 1
# of citations in Scopus 68.54 138.56 1 714 0
# of citations in WOS 26.16 68.01 2 460 0
# of books authored 8.68 17.82 2 98 0
# of journal articles 70.96 88.76 43 490 5
# of conference articles 46.82 41.37 37 188 0
award received index 5.78 6.08 3 20 0
# of grants received 11.11 7.48 10 30 0
Chen, K. H., Tang, M. C., Wang, C. M., & Hsiang, J. (2014). Exploring alternative metrics of scholarly performance in the social sciences and humanities in Taiwan. Scientometrics, 1-16.
2014臺灣學術機構典藏 (TAIR)研討會
8
Table 2
Correlations among conventional and new output measures
magazine articles
authored
theses and dissertation
advised books authored
journal articles
authored
conference articles
authored
articles in the press .313* (0.059-0.526) .431** (0.197-0.624) .326* (0.038-0.548) .431** (0.161-0.636) .321* (0.043-0.533)
magazine articles authored .392** (0.108-0.611) .421** (0.147-0.652) .639** (0.420-0.791) .299* (0.022-0.532)
theses and dissertation advised .346** (0.098-0.558) .566** (0.345-0.731) .263* (-0.007-0.505)
books authored .565** (0.324-0.765) .664** (0.501-0.773)
journal articles authored .491** (0.258-0.670)
*. Correlation is significant at the 0.05 level (2-tailed). **. Correlation is significant at the 0.01 level (2-tailed).
2014臺灣學術機構典藏 (TAIR)研討會
9
Table 3 Correlations among conventional and new impact metrics
citations in theses and
dissertations wiki presence
citation received in
THCI database
citation received in
ACI database cited in Scopus
cited in Web of
Science
citations received in syllabi .664** (0.481-0.788) .412** (0.178-0.605) .544** (0.352-0.694) .699** (0.533-0.812) .024 (-0.244-0.262) .044 (-0.223-0.299)
citations in theses/dissertation .408** (0.157-0.591) .440** (0.222-0.621) .899** (0.818-0.950) .302* (0.049-0.535) .227 (-0.056-0.473)
wiki presence .469** (0.227-0.658) .414** (0.180-0.592) -.027 (0.227-0.658) -.129 (-0.382-0.145)
citation received in THCI database 1.000 .521** (0.325-0.689) -.114 (-0.374-0.131) -.157 (-0.414-0.093)
citation received in ACI database .255 (-0.023-0.509) .200 (-0.098-0.456)
citations in Scopus .874** (0.775-0.942)
*. Correlation is significant at the 0.05 level (2-tailed). **. Correlation is significant at the 0.01 level (2-tailed).
Table 3 Correlations among conventional and new impact metrics
citations in theses and
dissertations wiki presence
citation received in
THCI database
citation received in
ACI database cited in Scopus
cited in Web of
Science
*. Correlation is significant at the 0.05 level (2-tailed). **. Correlation is significant at the 0.01 level (2-tailed).
2014臺灣學術機構典藏 (TAIR)研討會
10
Table 4
Correlations among the metrics and scholarly performance variables
Awards received index # of grants received
Humanities Social
Sciences Humanities Social Sciences
# of article in the press -.050 .568** -.366 .282
# of non-academic
articles
.796** .419** .819** .304*
# of syllabi citations .630** .506** .877** .210
# of library circulation .840** .560** .823** .164
# of citations in Th&D .778** .722** .681** .524**
# of Th&D supervised .515** .624** .695** .622**
Wikipedia presence -.011 .426** .276 .108
# of citations in THCI .674** .523** .729** .224
# of citations in ACI .688** .692** .759** .484**
# of citations in Scopus .354** .224 .194 .381**
# of citations in WoS .147 .199 -.237 .297
# of books authored .616** .422** .660** .213
# of journal articles .689** .660** .702** .570**
# of conference articles .476** .334* .543** .275
*. Correlation is significant at the 0.05 level (2-tailed).
**. Correlation is significant at the 0.01 level (2-tailed).
2014臺灣學術機構典藏 (TAIR)研討會
11
Table 5 Rotated Component Matrix
Component
1 2 3 4 # of citations in ACI .883 -.107 .220 .166 # of syllabi citations .735 .213 .056 .355 # of citations in TH&D .868 -.112 .207 .114 # of circulation .759 .013 -.099 .390 # of journal articles .822 .041 .262 .280 # of books .685 .307 -.209 .284 # of advisees .550 .073 .488 .225 # of conference articles .702 .094 -.313 -.030 Webometrics_Visibility .113 .852 -.029 .023 Webometrics_Rich Files -.047 .911 .185 -.002 Webometrics_Size -.088 .885 -.004 .088 Webometrics_Scholar .202 .669 -.095 -.132 # of citations in Scopus .063 -.018 .937 -.046 # of citations in WoS .006 .035 .931 .009 Wikipedia_presence .258 -.167 -.096 .795 # of non-academic articles .537 .136 -.023 .545 # of articles in the press .283 .042 .143 .754 Percentage of variance explained 36.690 17.333 13.540 6.172
2014臺灣學術機構典藏 (TAIR)研討會
12
Table 6 Dependent variable: the “awards received” index
Variable entered β Adjusted R2
All cases (N=57)
Domestic scholarly influences .561
.492 Social influences .380
International impact .243
Humanities (N=13)
Domestic scholarly influences .715 .466
Social Sciences (N=44)
Domestic scholarly influences .459
.508 Social influences .423
International impact .323
2014臺灣學術機構典藏 (TAIR)研討會
13
Table 7
Dependent variable: # of grants received
Variable entered β Adjusted R2
All cases (N = 57)
Domestic scholarly influences .494 0.421
International impact .444
Humanities (N = 13)
Domestic scholarly influences .715 0.526
Social Sciences (N = 44)
International impact .467 0.398
Domestic scholarly influences .440
2014臺灣學術機構典藏 (TAIR)研討會
14
– ‘…We rely on filters to make sense of the scholarly literature, but the narrow, traditional filters are being swamped… …the growth of new, online scholarly tools allows us to make new filters: these altmetrics reflect the broad, rapid impact of scholarship in this burgeoning ecosystem. We call for more tools and research based on altmetrics.’• Link
to the altmetrics vs. traditional data for an Ebola article in Nature
The thrusts behind altmetrics: discovery
2014臺灣學術機構典藏 (TAIR)研討會
152014臺灣學術機構典藏 (TAIR)研討會
16
Researchers’ view
2014臺灣學術機構典藏 (TAIR)研討會
17
Current altmetrics efforts
• Altmetric / with Scopus• Plum Analytics /now with EBSCO
– Launched in2011 by former librarians Mike Buschmen and Andrea Michalek
• Impact Story • Reader Meter• ALM
2014臺灣學術機構典藏 (TAIR)研討會
18
Altmetric.com data sources1) Policy documents We track a wide range of public policy documents for mentions, and are adding more every month.
2) Mainstream media You can check out the news sources page on the Altmetric website for the latest list of news sources that we track.3) Social media data• Twitter Facebook (public posts only) Google+ Pinterest Reddit‧ ‧ ‧ ‧• Sina Weibo PubPeer and Publons LinkedIn groups‧ ‧• Blogs (this is a manually curated list - currently this contains over 8,000 blogs)• Sites running Stack Exchange (Q&A) Reviews on F1000 YouTube‧ ‧• ... & many smaller sources
4) Online reference manager and publisher download count data• Mendeley• CiteULike
http://support.altmetric.com/knowledgebase/articles/83335-which-data-sources-does-altmetric-track
19
Altmetric.com• Altmetric example
http://support.altmetric.com/knowledgebase/articles/83337-how-is-the-altmetric-score-calculated-
Source weight
News 8
Blogs 5
Q&A forums 2.5
Twitter 1
Google+ 1
Facebook 0.25
20
Plum analytics • Metrics
– Usage - Downloads, views, book holdings, ILL, document delivery
– Captures - Favorites, bookmarks, saves, readers, groups, watchers
– Mentions - blog posts, news stories, Wikipedia articles, comments, reviews
– Social media - Tweets, +1's, likes, shares, ratings
– Citations - PubMed, Scopus, patents
2014臺灣學術機構典藏 (TAIR)研討會
21
Source: (Lin & Fenner, 2013). 2014臺灣學術機構典藏 (TAIR)研討會
23
Traditional repository metrics
• Download counts• Page views• Google analytics– Geographic access, referral links, search terms
• Some citation metrics
2014臺灣學術機構典藏 (TAIR)研討會
24
Example of using almetrics in IR
2014臺灣學術機構典藏 (TAIR)研討會
An example article from University of Massachusetts Medical School
25
Value of Altmetrics for IRs
• Demonstrate impact of open access, recruit new content
• Showcase social importance of content• Add more context and meaning to download counts• Provide authors with more comprehensive
understanding of their readership and lead to new collaborators
2014臺灣學術機構典藏 (TAIR)研討會
26
Existing barriers
• Limited DOI implementation• Author disambiguation
2014臺灣學術機構典藏 (TAIR)研討會
27
Useful references• Bernal, I. (2013). Open Access and the Changing Landscape of Research Impact Indicators:
New Roles for Repositories. Publications, 1(2), 56-77.• Lin, Jennifer and Martin Fenner (2013). Altmetrics in evolution: defining and redefining the
ontology of article-level metrics. Information Standards Quarterly, Summer, 25(2): 20-26.• Konkiel, S., & Scherer, D. (2013). New opportunities for repositories in the age of
altmetrics. Bulletin of the American Society for Information Science and Technology, 39(4), 22-26.
• Mounce, R. (2013). Open access and altmetrics: Distinct but complementary. Bulletin of the American Society for In formation Science and Technology, 39(4), 14-17.
• Palmer, Lisa A. (2013), "Altmetrics and Institutional Repositories: A Health Sciences Library Experiment". University of Massachusetts Medical School. Library Publications and Presentations. Paper 142. http://escholarship.umassmed.edu/lib_articles/142
• Roemer, R. C., & Borchardt, R. (2013). Institutional Altmetrics and Academic Libraries. Information Standards Quarterly, 25(2), 14.
2014臺灣學術機構典藏 (TAIR)研討會
