Embed Size (px)
Citation preview
ASSESSING THE QUALITY OF OPEN ACCESS JOURNALS审核开放获取期刊的质量
S E M I N A R A T C H I N A O P E N A C C E S S W E E KO C T O B E R 1 9 , 2 0 1 6 , B E I J I N G
T O M @ D O A J . O R GE D I T O R - I N - C H I E F D O A J
You are free to:Copy, share, adapt, or re-mix;
Blog, live-blog, or post video of;
This presentation. Provided that:
You attribute the work to its author and respect the rights and licenses associated with its components.
Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only ccZero.Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at;http://www.thisismyurl.com/free-downloads/15-free-speech-bubble-icons-for-popular-websites
• PROOF? 证据
• MISBELIEFS 误解
• THE REALITY OF OPEN ACCESS 真正的开放获取
Are Open Access Journals of Low Quality? 开放获取期刊的质量差吗？
S U P P O S E• S C O P U S A S M E A S U R E F O R T O L L A C C E S S Q U A L I T Y J O U R N A L S• D O A J A S M E A S U R E F O R O P E N A C C E S S Q U A L I T Y J O U R N A L S
F A C T S• N O T A L L S U B S C R I P T I O N J O U R N A L S A R E I N S C O P U S O N L Y 1 0 - 2 0 , 0 0 0 O F 1 0 0 . 0 0 0• N O T A L L O P E N A C C E S S J O U R N A L S A R E I N D O A J O N L Y 8 - 1 0 , 0 0 0 O F 3 5 , 0 0 0
• C O N C L U S I O N • P E R C E N T A G E Q U A L I T Y J O U R N A L S I S A B O U T T H E S A M E
Open Access versus Toll Access 开放获取 vs. 订购访问
OPEN ACCESS.....• A R T I C L E S R E C E I V E M O R E C I T A T I O N S• R E A C H E S A B I G G E R A U D I E N C E• L E A D S T O B E T T E R E D U C A T I O N• A V O I D S D U P L I C A T E S T U D I E S• A R T I C L E S C A N B E M O R E E A S I L Y C H E C K E D• D A T A L E S S P R O N E T O M A N I P U L A T I O N• I S B E T T E R F O R A D V A N C I N G S C I E N C E• L E A D S T O M O R E I N N O V A T I O N
The Reality of Open Access真正的开放获取
• QUALITY OF PUBLISHING（出版的质量）
• QUALITY OF THE SCIENCE （科学的质量）
Assessing the Quality of a Journal审核期刊的质量
• CRITERIA FOR PUBLISHING• Principles of transparency and Best Practice in Scholarly Publishing• DOAJ criteria for Quality Open Access Publishing
Quality of Publishing（出版的质量）
• D i r e c t o r y o f O p e n A c c e s s J o u r n a l s
• L a u n c h e d i n M a y 2 0 0 3 , L u n d U n i v e r s i t y , S w e d e n – l i s t o f 3 0 0 t i t l e s
• C e n t r a l l y , p u b l i c l y a n d i n t e r n a t i o n a l l y a v a i l a b l e c o m m u n i t y -c u r a t e d l i s t o f h i g h q u a l i t y o p e n a c c e s s j o u r n a l t i t l e s a c r o s s a l l d i s c i p l i n e s
• A i m : t o b e t h e s t a r t i n g p o i n t f o r a l l i n f o r m a t i o n s e a r c h e s f o r q u a l i t y , p e e r - r e v i e w e d o p e n a c c e s s m a t e r i a l
What is the DOAJ?DOAJ是什么？
The Principles （原则）
1. Peer review process 2. Governing Body3. Editorial team/contact 4. Author fees5. Copyright6. Identification of and dealing with allegations of research misconduct7. Ownership and management
8. Website9. Name of journal10. Conflicts of interest11. Access 12. Revenue sources13. Advertising14. Publishing schedule15. Archiving16. Direct marketing
Required information for inclusion in the
DOAJ收录DOAJ所需的信息
*Basic requirement（＊为基本要求）
https://doaj.org/publishers
Journal Web Site (1)* 期刊网站
• Dedicated web site per journal – journal specific web address*
• All journal content centrally available – not spread over various pages
• Do not mimic other journal web sites• Web site clear, concise, easy to navigate, transparent,
up to date and correct content – high ethical and professional standards
• Language & grammar usage correct, spell check
Journal Web Site (2)* 期刊网站
• Visible links to business information• Avoid distracting, offensive, irrelevant, moving, blinking
advertisements• Unique identifier (web address) *:
• Journal level• Article metadata level (also DOI)• Full text article level (pdf, html, xml, epub)
• ISSN (International Standard Serial Number) *• Print ISSN and/or• Online ISSN
Journal Content 期刊内容
• Clear journal structure for easier navigation, indexing, discoverability• Publication date for each article• Publication year per volume/issue• Volumes & issues; 5 articles per year• Start & end page number• Authors, affiliations, countries, ORCIDs• Articles arranged in Table of Contents• Search/Browse option• Links to Current, Archive/Past Issues
Impact Factors 影响因子
• Thomson Reuters IF against ethics and principles of OA
• DOAJ is IF agnostic• Display of IF information on journal web page
discouraged
Ownership & Management 归属权 & 管理
• Journal title unique – not confusing/misleading• Avoid using misleading information• Each journal unique, journal specific policies• All business information about journal available from
central web site for journal* - not generic web site for publisher
Business Information* 商业信息
• About• Aims and Scope• Editorial Board• Instructions for Authors• Quality control system• Open Access system• Plagiarism policy• Licensing terms• Contact info
Editorial Office & Editorial Team 编辑部 & 编辑团队
• Editor*/Editor-in-Chief/Associate Editor/Co-Editor• Full names, Affiliations, Countries, Emails*• Postal address of office• Contact information: email/telephone
Governing Body 主管部门
• Editorial Board*/Editorial Advisory Board• Arts & Humanities allowed editorial review, 2 editors,
no editorial board• Members to be experts in field/journal scope• Full names, Affiliations, Countries, Emails*
Aims & Scope 期刊的内容和范围
Author Fees 作者费用
• Article Processing Charges (APCs)• Article Submission Charges (APCs)• Manuscript Handling Fees• Galley Fees, page charges, colour charges, etc.• Per article (incl. any taxes if applicable) – not per page• Waiver policy• Clearly visible for prospective authors – also if
no charges apply*
Peer Review Process* 同行评议
• Advice on individual manuscripts from reviewers/ experts in the field who are not part of the journal's editorial staff
• Quality control rigorous• Process & policies clearly described on journal's web
site• Editorial/Peer - Blind/Double blind/Open*
Instructions for Authors* 投稿须知
• Detailed style guide• Description of quality control process (review)• Copyright information• Licensing information• Plagiarism policy• Instructions on how to submit an article• Contact email address
Access & Usage 获取 & 使用
• Full text of all content available as Open Access, no delay/embargo*
• How accessible is journal to the rest of the world, harvesters
• Open Access or Subscription Access or Pay per view• Journal specific OA statement/policy*• Differentiate between OA statement – Copyright -
Licensing
Rights 权利
• Recommend: author retains copyright• Recommend: no exclusive publishing rights• Recommend: no transfer of commercial rights
https://doajournals.wordpress.com/2015/06/02/copyright-and-licensing-part-2/
Content Licensing 内容许可
• Clearly described on web site• Licensing terms on all articles, all versions (html, pdf,
xml etc.)• Embedded in article level metadata
https://creativecommons.org/licenses/
1
2
https://creativecommons.org/licenses/
3
4
https://creativecommons.org/licenses/
5
6
Depositing Policy 存储政策
http://www.sherpa.ac.uk/romeo/index.php
Ethics & Malpractice 伦理 & 不端行为
• Indicate steps to identify & prevent papers where research misconduct occurred
• Unethical• Plagiarism (statement & similarity check tool)• Citation manipulation• Data falsification/fabrication
• See COPE Guidelines in dealing with allegations
Conflict of Interest 利益冲突
• Policy on handling potential conflict of interest - editors, authors, reviewers
Financial Sustainability 财务可持续
• Revenue sources (eg author fees, subscriptions, advertising, reprints, institutional support, organizational support)
• Advertising policy, types of ads, decision making on ads, ads linked to content or reader behavior/displayed at random
• Marketing: appropriate, well targeted, unobtrusive
Publishing Schedule 刊发计划
• Clearly indicate periodicity• No interruptions• Annually, bi-annually, monthly, bi-monthly, continuos,
etc.• Number of volumes, issues
Accessibility & Availability 可访问性 & 可用性
Digital Archiving & Preservation 电子存储 &保存
• Electronic backup• Cloud, disk, server, tapes, etc
• Preservation – Keepers’ Registry & PubMed Central• Portico• Open Journal Systems (OJS) – PKP Private LOCKSS network
deposited in CLOCKSS
DOAJ Seal 印章
J O U R N A L L E V E L• P E E R - R E V I E W , E D I T O R I A L B O A R D , P R O O F - R E A D I N G ( D O A J
C R I T E R I A )
• T H O M S O N R E U T E R S - J I F ( T H O M S O N - R E U T E R )
• J O U R N A L C I T A T I O N D I S T R I B U T I O N S R E P L A C I N G T H E J I F ( P U B L I S H E R S )
A R T I C L E L E V E L
• A R T I C L E L E V E L M E T R I C S ( A L T M E T R I C , I M P A C T S T O R Y )
• R E L A T I V E C I T A T I O N I N D I C E S ( I C I T E T O O L )
Assessing Quality of the Science审核科学的质量
oT H E S C I E N T I F I C Q U A L I T Y O F A J O U R N A L C A N N O T B E A S S E S S E D B Y T H E A V E R A G E C I T A T I O N S C O R E S O F A R T I C L E S
oT H E S C I E N T I F I C Q U A L I T Y O F A R T I C L E S C A N N O T B E A S S E S S E D B Y W H E R E T H E Y A R E P U B L I S H E D
oS C I E N T I F I C Q U A L I T Y C A N O N L Y B E A S S E S S E D O N A R T I C L E L E V E L
Assessing Quality of the Science审核科学的质量
H E A D L I N E S I N , S C I E N C E , N A T U R E , T H E S C I E N T I S T , P L O S T H I S Y E A R 2 0 1 6 What is wrong with the JIF?期刊影响因子有错吗？
• W E A K R E L A T I O N W I T H J O U R N A L Q U A L I T Y• N O R E L A T I O N W I T H I N D I V I D U A L A R T I C L E Q U A L I T Y I N A G I V E N J O U R N A L• N O R E L A T I O N W I T H S C I E N T I S T Q U A L I T Y
• I N A P P R O P R I A T E U S E O F J I F F O R A L L T H E A B O V E !
• I N A D D I T I O N T H E J I F I S H I G H L Y B I A S E D T O W A R D S E N G L I S H L A N G U A G E S T M J O U R N A L S
What is wrong with the JIF?期刊影响因子有错吗？
THE JIF I S C A L C U L A T E D I N A P P R O P R I A T E L Y A S T H E A R I T H M E T I C M E A N O F A
H I G H L Y S K E W E D D I S T R I B U T I O N O F C I T A T I O N S
IT CONTAINS NO MEASURE OF THE SPREAD OF THE DISTRIBUTION; IT
OBSCURES THE HIGH DEGREE OF OVERLAP BETWEEN THE CITATION DISTRIBUTIONS
OF MOST JOURNALSIT IS NOT REPRODUCIBLE AND THE DATA
THAT SUPPORT IT ARE NOT PUBLICLY AVAILABLE
What is wrong with the JIF?期刊影响因子有错吗？
Source :doi:http://dx.doi.org/10.1101/062109.
Table 2: Percentage of papers published in 2013-2014 with number of citations
below the value of the 2015 JIF.
Larivière et al. (2016)
highly skewed distribution of citations高度不平衡的文献引用分布
doi: http://dx.doi.org/10.1101/062109
FOR PUBLISHERS:D O N O T U S E I F F O R T H E P R O M O T I O N O F Y O U R
J O U R N A L
FOR AUTHORS:I T I S N O T I M P O R T A N T W H E R E Y O U P U B L I S H B U T
W H A T Y O U P U B L I S H
FOR FUNDERS:D O N O T J U D G E S C I E N T I S T S O N W H E R E T H E Y
P U B L I S H O R H O W M U C H T H E Y P U B L I S H
Too much is wrong with the JIF期刊影响因子有太多的错误
Replacing the Impact Factor取代影响因子
this analysis helps to expose the exaggerated value attributed to the JIF and strengthens the contention that it is an inappropriate indicator for the evaluation of research or researchers," the team concludes in a preprint paper posted to bioRxiv.
doi: http://dx.doi.org/10.1101/062109
ALTMETRICST A K I N G I N T O A C C O U N T C I T A T I O N S , S O C I A L M E D I A ,
C O N V E N T I A L M E D I A ( N E W S P A P E R S , T V , V I D E O )
RELATIVE CITATION SCORESC I T A T I O N I N D I C E S A D J U S T E D F O R S C I E N T I F I C F I E L D
Article Level Impact Assessment基于文献的影响力评估
LEIDEN MANIFESTOdoi:http://dx.doi.org/10.1101/062109
DORAThe San Francisco Declaration on Research Assessmentdoi: 10.1242/dmm.012955
San Francisco Declaration on Research Impact关于科研影响力的旧金山声明
http://www.ascb.org/dora/
Leiden Manifesto for Research Metrics关于科研指标的莱顿宣言
TEN PRINCIPLESAmong which6. Account for variation by field in publication and citation practices8. the journal impact factor is published to three decimal places to avoid ties. it makes no sense to distinguishbetween journals on the basis of very small impact factor differences. Avoid false precision
Relative Citation Ratios相对引用率
https://icite.od.nih.gov/
•
Relative Citation Ratios相对引用率
The must haves! Journals must have: 必须有
• An Open Access statement• Comply with the BOAI definition• A peer-review process, and describe the kind of process• An editor/editorial board with clearly identifiable members• Licensing and copyright information• Aims and scope• Published a least 5 articles per year to qualify (DOAJ criteria)• Impact Factor (any) IRRELEVANT
Quality Open Access Journals高质量的开放获取期刊
Journals are strongly recommended to have• Unrestricted copyright for the author• No exclusive publishing rights• No transfer of commercial rights• Clear licensing conditions• Preferably use of Creative commons licensing• Embedded licensing information with articles• Link to underlying data• No mention of IF, instead use journal citation distribution plots
Quality Open Access Journals高质量的开放获取期刊Recommendations
推荐
Thanks to all the Library Consortia, Universities and Publishers and our
Sponsors for the financial support to DOAJ!感谢我们所有的图书馆联盟，大学，出版商和赞助商对DOAJ
的财政支持！
We have vacancies [email protected]
