ASSESSING THE QUALITY OF OPEN ACCESS JOURNALS 审核开 … · • doaj as measure for open access...

ASSESSING THE QUALITY OF OPEN ACCESS JOURNALS审核开放获取期刊的质量

S E M I N A R A T C H I N A O P E N A C C E S S W E E KO C T O B E R 1 9 , 2 0 1 6 , B E I J I N G

T O M @ D O A J . O R GE D I T O R - I N - C H I E F D O A J

You are free to:Copy, share, adapt, or re-mix;

Blog, live-blog, or post video of;

This presentation. Provided that:

You attribute the work to its author and respect the rights and licenses associated with its components.

Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only ccZero.Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at;http://www.thisismyurl.com/free-downloads/15-free-speech-bubble-icons-for-popular-websites

• PROOF? 证据

• MISBELIEFS 误解

• THE REALITY OF OPEN ACCESS 真正的开放获取

Are Open Access Journals of Low Quality? 开放获取期刊的质量差吗？

S U P P O S E• S C O P U S A S M E A S U R E F O R T O L L A C C E S S Q U A L I T Y J O U R N A L S• D O A J A S M E A S U R E F O R O P E N A C C E S S Q U A L I T Y J O U R N A L S

F A C T S• N O T A L L S U B S C R I P T I O N J O U R N A L S A R E I N S C O P U S O N L Y 1 0 - 2 0 , 0 0 0 O F 1 0 0 . 0 0 0• N O T A L L O P E N A C C E S S J O U R N A L S A R E I N D O A J O N L Y 8 - 1 0 , 0 0 0 O F 3 5 , 0 0 0

• C O N C L U S I O N • P E R C E N T A G E Q U A L I T Y J O U R N A L S I S A B O U T T H E S A M E

Open Access versus Toll Access 开放获取 vs. 订购访问

OPEN ACCESS.....• A R T I C L E S R E C E I V E M O R E C I T A T I O N S• R E A C H E S A B I G G E R A U D I E N C E• L E A D S T O B E T T E R E D U C A T I O N• A V O I D S D U P L I C A T E S T U D I E S• A R T I C L E S C A N B E M O R E E A S I L Y C H E C K E D• D A T A L E S S P R O N E T O M A N I P U L A T I O N• I S B E T T E R F O R A D V A N C I N G S C I E N C E• L E A D S T O M O R E I N N O V A T I O N

The Reality of Open Access真正的开放获取

• QUALITY OF PUBLISHING（出版的质量）

• QUALITY OF THE SCIENCE （科学的质量）

Assessing the Quality of a Journal审核期刊的质量

• CRITERIA FOR PUBLISHING• Principles of transparency and Best Practice in Scholarly Publishing• DOAJ criteria for Quality Open Access Publishing

Quality of Publishing（出版的质量）

• D i r e c t o r y o f O p e n A c c e s s J o u r n a l s

• L a u n c h e d i n M a y 2 0 0 3 , L u n d U n i v e r s i t y , S w e d e n – l i s t o f 3 0 0 t i t l e s

• C e n t r a l l y , p u b l i c l y a n d i n t e r n a t i o n a l l y a v a i l a b l e c o m m u n i t y -c u r a t e d l i s t o f h i g h q u a l i t y o p e n a c c e s s j o u r n a l t i t l e s a c r o s s a l l d i s c i p l i n e s

• A i m : t o b e t h e s t a r t i n g p o i n t f o r a l l i n f o r m a t i o n s e a r c h e s f o r q u a l i t y , p e e r - r e v i e w e d o p e n a c c e s s m a t e r i a l

What is the DOAJ?DOAJ是什么？

The Principles （原则）

1. Peer review process 2. Governing Body3. Editorial team/contact 4. Author fees5. Copyright6. Identification of and dealing with allegations of research misconduct7. Ownership and management

8. Website9. Name of journal10. Conflicts of interest11. Access 12. Revenue sources13. Advertising14. Publishing schedule15. Archiving16. Direct marketing

Required information for inclusion in the

DOAJ收录DOAJ所需的信息

*Basic requirement（＊为基本要求）

https://doaj.org/publishers

Journal Web Site (1)* 期刊网站

• Dedicated web site per journal – journal specific web address*

• All journal content centrally available – not spread over various pages

• Do not mimic other journal web sites• Web site clear, concise, easy to navigate, transparent,

up to date and correct content – high ethical and professional standards

• Language & grammar usage correct, spell check

Journal Web Site (2)* 期刊网站

• Visible links to business information• Avoid distracting, offensive, irrelevant, moving, blinking

advertisements• Unique identifier (web address) *:

• Journal level• Article metadata level (also DOI)• Full text article level (pdf, html, xml, epub)

• ISSN (International Standard Serial Number) *• Print ISSN and/or• Online ISSN

Journal Content 期刊内容

• Clear journal structure for easier navigation, indexing, discoverability• Publication date for each article• Publication year per volume/issue• Volumes & issues; 5 articles per year• Start & end page number• Authors, affiliations, countries, ORCIDs• Articles arranged in Table of Contents• Search/Browse option• Links to Current, Archive/Past Issues

Impact Factors 影响因子

• Thomson Reuters IF against ethics and principles of OA

• DOAJ is IF agnostic• Display of IF information on journal web page

discouraged

Ownership & Management 归属权 & 管理

• Journal title unique – not confusing/misleading• Avoid using misleading information• Each journal unique, journal specific policies• All business information about journal available from

central web site for journal* - not generic web site for publisher

Business Information* 商业信息

• About• Aims and Scope• Editorial Board• Instructions for Authors• Quality control system• Open Access system• Plagiarism policy• Licensing terms• Contact info

Editorial Office & Editorial Team 编辑部 & 编辑团队

• Editor*/Editor-in-Chief/Associate Editor/Co-Editor• Full names, Affiliations, Countries, Emails*• Postal address of office• Contact information: email/telephone

Governing Body 主管部门

• Editorial Board*/Editorial Advisory Board• Arts & Humanities allowed editorial review, 2 editors,

no editorial board• Members to be experts in field/journal scope• Full names, Affiliations, Countries, Emails*

Aims & Scope 期刊的内容和范围

Author Fees 作者费用

• Article Processing Charges (APCs)• Article Submission Charges (APCs)• Manuscript Handling Fees• Galley Fees, page charges, colour charges, etc.• Per article (incl. any taxes if applicable) – not per page• Waiver policy• Clearly visible for prospective authors – also if

no charges apply*

Peer Review Process* 同行评议

• Advice on individual manuscripts from reviewers/ experts in the field who are not part of the journal's editorial staff

• Quality control rigorous• Process & policies clearly described on journal's web

site• Editorial/Peer - Blind/Double blind/Open*

Instructions for Authors* 投稿须知

• Detailed style guide• Description of quality control process (review)• Copyright information• Licensing information• Plagiarism policy• Instructions on how to submit an article• Contact email address

Access & Usage 获取 & 使用

• Full text of all content available as Open Access, no delay/embargo*

• How accessible is journal to the rest of the world, harvesters

• Open Access or Subscription Access or Pay per view• Journal specific OA statement/policy*• Differentiate between OA statement – Copyright -

Licensing

Rights 权利

• Recommend: author retains copyright• Recommend: no exclusive publishing rights• Recommend: no transfer of commercial rights

https://doajournals.wordpress.com/2015/06/02/copyright-and-licensing-part-2/

Content Licensing 内容许可

• Clearly described on web site• Licensing terms on all articles, all versions (html, pdf,

xml etc.)• Embedded in article level metadata

https://creativecommons.org/licenses/

1

2

https://creativecommons.org/licenses/

3

4

https://creativecommons.org/licenses/

5

6

Depositing Policy 存储政策

http://www.sherpa.ac.uk/romeo/index.php

Ethics & Malpractice 伦理 & 不端行为

• Indicate steps to identify & prevent papers where research misconduct occurred

• Unethical• Plagiarism (statement & similarity check tool)• Citation manipulation• Data falsification/fabrication

• See COPE Guidelines in dealing with allegations

Conflict of Interest 利益冲突

• Policy on handling potential conflict of interest - editors, authors, reviewers

Financial Sustainability 财务可持续

• Revenue sources (eg author fees, subscriptions, advertising, reprints, institutional support, organizational support)

• Advertising policy, types of ads, decision making on ads, ads linked to content or reader behavior/displayed at random

• Marketing: appropriate, well targeted, unobtrusive

Publishing Schedule 刊发计划

• Clearly indicate periodicity• No interruptions• Annually, bi-annually, monthly, bi-monthly, continuos,

etc.• Number of volumes, issues

Accessibility & Availability 可访问性 & 可用性

Digital Archiving & Preservation 电子存储 &保存

• Electronic backup• Cloud, disk, server, tapes, etc

• Preservation – Keepers’ Registry & PubMed Central• Portico• Open Journal Systems (OJS) – PKP Private LOCKSS network

deposited in CLOCKSS

DOAJ Seal 印章

J O U R N A L L E V E L• P E E R - R E V I E W , E D I T O R I A L B O A R D , P R O O F - R E A D I N G ( D O A J

C R I T E R I A )

• T H O M S O N R E U T E R S - J I F ( T H O M S O N - R E U T E R )

• J O U R N A L C I T A T I O N D I S T R I B U T I O N S R E P L A C I N G T H E J I F ( P U B L I S H E R S )

A R T I C L E L E V E L

• A R T I C L E L E V E L M E T R I C S ( A L T M E T R I C , I M P A C T S T O R Y )

• R E L A T I V E C I T A T I O N I N D I C E S ( I C I T E T O O L )

Assessing Quality of the Science审核科学的质量

oT H E S C I E N T I F I C Q U A L I T Y O F A J O U R N A L C A N N O T B E A S S E S S E D B Y T H E A V E R A G E C I T A T I O N S C O R E S O F A R T I C L E S

oT H E S C I E N T I F I C Q U A L I T Y O F A R T I C L E S C A N N O T B E A S S E S S E D B Y W H E R E T H E Y A R E P U B L I S H E D

oS C I E N T I F I C Q U A L I T Y C A N O N L Y B E A S S E S S E D O N A R T I C L E L E V E L

Assessing Quality of the Science审核科学的质量

H E A D L I N E S I N , S C I E N C E , N A T U R E , T H E S C I E N T I S T , P L O S T H I S Y E A R 2 0 1 6 What is wrong with the JIF?期刊影响因子有错吗？

• W E A K R E L A T I O N W I T H J O U R N A L Q U A L I T Y• N O R E L A T I O N W I T H I N D I V I D U A L A R T I C L E Q U A L I T Y I N A G I V E N J O U R N A L• N O R E L A T I O N W I T H S C I E N T I S T Q U A L I T Y

• I N A P P R O P R I A T E U S E O F J I F F O R A L L T H E A B O V E !

• I N A D D I T I O N T H E J I F I S H I G H L Y B I A S E D T O W A R D S E N G L I S H L A N G U A G E S T M J O U R N A L S

What is wrong with the JIF?期刊影响因子有错吗？

THE JIF I S C A L C U L A T E D I N A P P R O P R I A T E L Y A S T H E A R I T H M E T I C M E A N O F A

H I G H L Y S K E W E D D I S T R I B U T I O N O F C I T A T I O N S

IT CONTAINS NO MEASURE OF THE SPREAD OF THE DISTRIBUTION; IT

OBSCURES THE HIGH DEGREE OF OVERLAP BETWEEN THE CITATION DISTRIBUTIONS

OF MOST JOURNALSIT IS NOT REPRODUCIBLE AND THE DATA

THAT SUPPORT IT ARE NOT PUBLICLY AVAILABLE

What is wrong with the JIF?期刊影响因子有错吗？

Source :doi:http://dx.doi.org/10.1101/062109.

Table 2: Percentage of papers published in 2013-2014 with number of citations

below the value of the 2015 JIF.

Larivière et al. (2016)

highly skewed distribution of citations高度不平衡的文献引用分布

doi: http://dx.doi.org/10.1101/062109

FOR PUBLISHERS:D O N O T U S E I F F O R T H E P R O M O T I O N O F Y O U R

J O U R N A L

FOR AUTHORS:I T I S N O T I M P O R T A N T W H E R E Y O U P U B L I S H B U T

W H A T Y O U P U B L I S H

FOR FUNDERS:D O N O T J U D G E S C I E N T I S T S O N W H E R E T H E Y

P U B L I S H O R H O W M U C H T H E Y P U B L I S H

Too much is wrong with the JIF期刊影响因子有太多的错误

Replacing the Impact Factor取代影响因子

this analysis helps to expose the exaggerated value attributed to the JIF and strengthens the contention that it is an inappropriate indicator for the evaluation of research or researchers," the team concludes in a preprint paper posted to bioRxiv.

doi: http://dx.doi.org/10.1101/062109

ALTMETRICST A K I N G I N T O A C C O U N T C I T A T I O N S , S O C I A L M E D I A ,

C O N V E N T I A L M E D I A ( N E W S P A P E R S , T V , V I D E O )

RELATIVE CITATION SCORESC I T A T I O N I N D I C E S A D J U S T E D F O R S C I E N T I F I C F I E L D

Article Level Impact Assessment基于文献的影响力评估

LEIDEN MANIFESTOdoi:http://dx.doi.org/10.1101/062109

DORAThe San Francisco Declaration on Research Assessmentdoi: 10.1242/dmm.012955

San Francisco Declaration on Research Impact关于科研影响力的旧金山声明

http://www.ascb.org/dora/

Leiden Manifesto for Research Metrics关于科研指标的莱顿宣言

TEN PRINCIPLESAmong which6. Account for variation by field in publication and citation practices8. the journal impact factor is published to three decimal places to avoid ties. it makes no sense to distinguishbetween journals on the basis of very small impact factor differences. Avoid false precision

Relative Citation Ratios相对引用率

https://icite.od.nih.gov/

•

Relative Citation Ratios相对引用率

The must haves! Journals must have: 必须有

• An Open Access statement• Comply with the BOAI definition• A peer-review process, and describe the kind of process• An editor/editorial board with clearly identifiable members• Licensing and copyright information• Aims and scope• Published a least 5 articles per year to qualify (DOAJ criteria)• Impact Factor (any) IRRELEVANT

Quality Open Access Journals高质量的开放获取期刊

Journals are strongly recommended to have• Unrestricted copyright for the author• No exclusive publishing rights• No transfer of commercial rights• Clear licensing conditions• Preferably use of Creative commons licensing• Embedded licensing information with articles• Link to underlying data• No mention of IF, instead use journal citation distribution plots

Quality Open Access Journals高质量的开放获取期刊Recommendations

推荐

Thank you for your attention!谢谢你们的关注！

tom@doaj.org

lars

lars@doaj.org

Thanks to all the Library Consortia, Universities and Publishers and our

Sponsors for the financial support to DOAJ!感谢我们所有的图书馆联盟，大学，出版商和赞助商对DOAJ

的财政支持！

We have vacancies here!tom@doaj.org