30
Responsible Authorship and Peer Review James R. Wilson North Carolina State University www.ise.ncsu.edu/jwilson September 29, 2009 Partially supported by NSF under grant number SES-9818359.

September 29, 2009

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Res

pons

ible

Aut

hors

hip

and

Peer

Rev

iew

Jam

esR.W

ilson

Nor

thCar

olin

aSt

ate

Uni

vers

ity

www.

ise.

ncsu

.edu

/jwi

lson

Sept

embe

r29

,20

09

∗ Par

tial

lysu

ppor

ted

byN

SFun

der

gran

tnu

mbe

rSE

S-98

1835

9.

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

Fr

om A

mer

ican

Sci

enti

st, S

epte

mbe

r–O

ctob

er 2

004.

2

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

OV

ERV

IEW

I.IN

TRO

DU

CT

ION

II.PRIN

CIP

LES

OF

RES

PO

NSI

BLE

AU

TH

ORSH

IP

A.

Prin

cipl

esof

Aut

hors

hip

B.

Prin

cipl

esof

Prim

ary

Aut

hors

hip

C.

Writ

ing

the

Pap

er

III.

RO

LEO

FT

HE

PEER

REV

IEW

SYST

EM

IV.

PRO

BLE

MS

WIT

HT

HE

PEE

RREV

IEW

SYST

EM

A.

Non

perfor

man

ceof

Editor

san

dRev

iewer

s

B.

Con

flict

sof

Inte

rest

ofRev

iewer

s

C.

Supp

ress

ion

ofIn

nova

tion

D.

Pub

licat

ion

Bia

s

3

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

V.

GU

IDEL

INES

FOR

PEE

RREV

IEW

A.

Arc

hiva

lJou

rnal

Art

icle

s

B.

Gra

ntPro

posa

ls

VI.

CA

RRO

TS

AN

DST

ICK

SIN

TH

EPEE

RREV

IEW

SYST

EM

4

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

I.IN

TRO

DU

CT

ION

Ifyo

u’re

doin

gan

expe

rimen

t,yo

ush

ould

repo

rtev

eryt

hing

that

you

thin

km

ight

mak

eit

inva

lid—

not

only

wha

tyo

uth

ink

isrig

htab

out

it:

othe

rca

uses

that

coul

dpo

ssib

lyex

plai

nyo

urre

sults;

and

thin

gsyo

uth

ough

tof

that

you’

veel

imin

ated

byso

me

othe

rex

perim

ent,

and

how

they

wor

ked—

tom

ake

sure

the

othe

rfe

llow

can

tell

they

have

been

elim

inat

ed.

...

Insu

mm

ary,

the

idea

isto

try

togi

veal

lof

the

info

rmat

ion

tohe

lpot

hers

toju

dge

the

valu

eof

your

cont

ribut

ion;

not

just

the

info

rmat

ion

that

lead

sto

judg

men

tin

one

part

icul

ardi

rect

ion

oran

othe

r.

—Ric

hard

P.Fe

ynm

an,“S

urel

yYo

u’re

Joki

ng,M

r.Fe

ynm

an!”

(198

5)

5

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

The

Uni

vers

ityof

Uta

h’s

hand

ling

ofco

ldfu

sion

isa

strik

ing

illus

trat

ion

ofw

hat

happ

ens

whe

nsc

ient

ists

circ

umve

ntth

eno

rmal

peer

-rev

iew

proc

ess

...

and

whe

nun

iver

sity

adm

inistr

ator

slo

bby

for

larg

efe

dera

lfun

dsbe

fore

the

scie

nce

isco

nfirm

ed.

...

Itha

sta

ken

upwar

dsof

som

efif

tyto

one

hund

red

mill

ion

dolla

rsof

rese

arch

tim

ean

dre

sour

ces

tosh

owth

atth

ere

isno

conv

inci

ngev

iden

cefo

rro

om-t

empe

ratu

refu

sion

.M

uch

ofth

iseff

ort

wou

ldno

tha

vebe

enne

cess

ary

had

norm

alsc

ient

ific

proc

edur

esbe

enfo

llowed

.

—Jo

hnR.H

uize

nga,

Col

dFu

sion

:T

heSc

ient

ific

Fias

coof

the

Cen

tury

(199

3)

6

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

II.PRIN

CIP

LES

OF

RESPO

NSIB

LEAU

TH

ORSH

IP

A.

Prin

cipl

esof

Aut

hors

hip

An

auth

orsh

ould

have

mad

esu

bsta

ntia

lcon

trib

utio

nsto

allth

efo

llow

ing

(Int

erna

tion

alCom

mitte

eof

Med

ical

Jour

nalE

dito

rs19

97,20

01):

•co

ncep

tion

and

design

ofth

epr

ojec

t,or

anal

ysis

and

inte

rpre

tation

ofda

ta;

•w

ritin

gth

ear

ticl

eor

revi

sing

itcr

itic

ally

for

inte

llect

ualc

onte

nt;an

d

•fin

alap

prov

alof

the

vers

ion

tobe

publ

ishe

d.

The

follo

win

gar

eno

tsu

ffici

ent

toju

stify

auth

orsh

ip:

•pa

rtic

ipat

ing

sole

lyin

acqu

isitio

nof

fund

ing;

•pa

rtic

ipat

ing

sole

lyin

colle

ctio

nof

data

;or

•su

perv

isin

gth

eov

eral

lact

ivitie

sof

the

rese

arch

grou

p.

7

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

Bey

ond

thes

em

inim

alre

quire

men

ts,H

ouck

and

Tha

cker

(199

0)el

abor

ate

the

follo

win

gpr

inci

ples

ofau

thor

ship

:

•co

ntrib

utio

nof

orig

inal

idea

s;

•de

sign

and

writ

ing

ofan

appr

oved

prot

ocol

;

•re

spon

sibi

lity

for

acqu

isitio

nof

data

;

•re

spon

sibi

lity

for

and

lead

ersh

ipin

the

perfor

man

ceof

the

stud

y;

•an

alys

isan

dcr

itic

alin

terp

reta

tion

ofda

ta—

incl

udin

gre

view

and

eval

uation

ofpr

evio

usst

udie

s;

•dr

afting

,re

vising

,an

dre

view

ing

the

man

uscr

ipt;

•re

spon

sibi

lity

for

the

final

man

uscr

ipt;

or

•w

illin

gnes

san

dab

ility

tode

fend

the

publ

icat

ion.

Aut

hors

hip

shou

ldbe

join

tly

agre

edby

allc

olla

bora

tors

asso

onas

the

grou

pha

sde

cide

don

the

assign

men

tof

resp

onsibi

litie

san

dwor

kloa

dfo

ral

lmem

bers

ofth

egr

oup.

8

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

For

the

late

stin

form

atio

non

auth

orsh

ipan

dpe

erre

view

from

the

Inte

rnat

iona

lCom

mitte

eof

Med

ical

Jour

nalE

dito

rs,vi

sit

www.icmje.org.

For

the

late

stin

form

atio

non

auth

orsh

ipan

dpe

erre

view

from

the

Cou

ncil

ofSc

ienc

eEd

itor

s(f

orm

erly

the

Cou

ncil

ofB

iolo

gyEd

itor

s),vi

sit

www.councilscienceeditors.org.

9

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

B.

Prin

cipl

esof

Prim

ary

Aut

hors

hip

Hou

ckan

dT

hack

er(1

990)

disc

uss

the

follo

win

gpo

ssib

lecr

iter

iafo

rpr

imar

yau

thor

ship

:

•O

rigin

ality

ofco

ntrib

utio

n—an

orig

inal

theo

retica

lor

met

hodo

logi

cal

cont

ribut

ion

that

was

critic

alto

the

pape

r;

•M

ajor

inte

llect

uali

nput

—id

eas

onst

udy

design

and

mod

ifica

tion

s,ob

tain

ing

and

usin

gex

perim

enta

lsub

ject

sor

mat

eria

l,co

nduc

ting

the

stud

y,so

lvin

gm

easu

rem

ent

prob

lem

s,an

alyz

ing

and

inte

rpre

ting

data

,an

dpr

epar

ing

repo

rts;

•M

ajor

feat

ure

ofth

em

anus

crip

t—ce

ntra

lthe

me

orco

ncep

t;or

•G

reat

est

over

allc

ontr

ibut

ion—

tota

leffo

rt,su

cces

sful

proj

ect

coor

dina

tion

,in

telle

ctua

llea

ders

hip,

and

data

anal

ysis

and

inte

rpre

tation

.

Prim

ary

auth

orsh

ipsh

ould

not

beba

sed

sole

lyon

adm

inistr

ativ

epo

sition

orte

chni

cale

xper

tise

.

10

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

C.

Writ

ing

the

Pap

er

•T

hepr

imar

yau

thor

coor

dina

tes

the

cont

ribut

ions

ofal

lcoa

utho

rs,w

hoar

ere

spon

sibl

efo

rbo

thth

est

yle

and

cont

ent

ofth

eir

resp

ective

sect

ions

ofth

epa

per.

•K

eep

inm

ind

the

chec

klist

ofke

yqu

estion

sto

bean

swer

edin

are

fere

e’s

repo

rtas

give

non

slid

es22

–25

belo

w.

•A

void

sele

ctiv

eun

derr

epor

ting

ofre

sults

that

are

“disap

poin

ting

”or

“uni

nter

esting

”—th

atis,re

sults

for

whi

chno

sign

ifica

nteff

ects

coul

dbe

dete

cted

.

11

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

•A

void

over

selli

ngre

sear

chre

sults.

Som

epe

ople

thin

kth

atpu

blic

izin

gth

elim

itat

ions

ofth

ewor

km

aybe

left

toriv

alre

sear

cher

sw

hoha

veco

mpe

ting

tech

niqu

esto

prom

ote.

InA

dvic

eto

aYo

ung

Scie

ntist,

Med

awar

(197

9)m

ade

the

follo

win

gst

atem

ent.

Ica

nnot

give

any

scie

ntist

ofan

yag

ebe

tter

advi

ceth

anth

is:

the

inte

nsity

ofth

eco

nvic

tion

that

ahy

poth

esis

istr

ueha

sno

bear

ing

onw

heth

erit

istr

ueor

not.

The

impo

rtan

ceof

the

stre

ngth

ofou

rco

nvic

tion

ison

lyto

prov

ide

apr

opor

tion

atel

yst

rong

ince

ntiv

eto

find

out

ifth

ehy

poth

esis

will

stan

dup

tocr

itic

alev

alua

tion

.

(The

emph

asis

inth

equ

oted

stat

emen

tis

Med

awar

’s.)

12

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

III.

RO

LEO

FT

HE

PEER

REV

IEW

SY

ST

EM

•T

hem

ain

purp

ose

ofth

epe

erre

view

syst

emis

tose

rve

the

com

mun

ityof

rese

arch

ers—

and

ultim

atel

yto

bene

fitso

ciet

y—by

prov

idin

gex

pert

advi

ceto –

editor

sof

arch

ival

jour

nals

who

mus

tm

ake

deci

sion

son

acce

ptan

ce,

reje

ctio

n,or

revi

sion

ofpa

pers

subm

itte

dto

thei

rjo

urna

ls;an

d

–pr

ogra

mm

anag

ers

offu

ndin

gag

enci

esw

hom

ust

mak

efu

ndin

gde

cision

son

the

rese

arch

prop

osal

ssu

bmitte

dto

thei

rpr

ogra

ms.

•T

hepe

erre

view

syst

empe

rfor

ms

anes

sent

ialq

ualit

y-co

ntro

lfun

ctio

nin

mai

ntai

ning

the

self-

corr

ecting

char

acte

rof

the

rese

arch

ente

rpris

e.

13

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

•A

noth

erm

ajor

func

tion

isim

prov

emen

tof

the

man

uscr

ipt

with

resp

ect

to–

read

abili

ty,

–co

mpl

eten

ess,

–co

ncisen

ess,

and

–rig

or.

•“P

eer

revi

ew”

byso

ftwar

eus

ers

and

deve

lope

rsis

clai

med

tobe

the

prin

cipa

ladv

anta

geof

open

softwar

est

anda

rds;

see

Eric

Ray

mon

d’s

sem

inal

essa

y“T

heCat

hedr

alan

dth

eB

azaa

r,”

whi

chis

avai

labl

ein

the

onlin

ejo

urna

lFirs

tM

onda

y, firstmonday.org

;

see

Vol

ume

3,N

umbe

r3

(Mar

ch19

98).

14

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

IV.PRO

BLE

MS

WIT

HT

HE

PEER

REV

IEW

SY

ST

EM

A.

Non

perfor

man

ceof

Editor

san

dRev

iewer

s

•T

hem

ain

prob

lem

with

the

peer

revi

ewsy

stem

for

arch

ival

jour

nal

articl

esis

sim

ple

dere

liction

ofdu

ty—

–by

editor

sw

hore

fuse

tota

kere

spon

sibi

lity

for

“har

d”ed

itor

ial

deci

sion

s,pr

efer

ring

toop

erat

eby

maj

ority

vote

ofth

ere

fere

es;a

nd

–by

refe

rees

who

cann

otbe

both

ered

tore

adan

dev

alua

teca

refu

llyth

ewor

kof

othe

rre

sear

cher

s,le

avin

ged

itor

sas

refe

rees

ofla

stre

sort

.

•N

onpe

rfor

man

ceof

editor

san

dre

fere

esha

sre

ache

dep

idem

icpr

opor

tion

sin

som

ebr

anch

esof

scie

nce

and

engi

neer

ing.

15

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

•N

otor

ious

initia

lpap

eron

cold

fusion

byFl

eisc

hman

nan

dPon

s(1

989a

)was

–pu

blishe

din

Jour

nalo

fEl

ectr

oana

lytica

lChe

mistr

yin

four

wee

ks,an

d

–so

onfo

llowed

bylo

nglis

tof

erra

ta(F

leisch

man

nan

dPon

s19

89b)

.

16

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

B.

Con

flict

sof

Inte

rest

ofRev

iewer

s

•Ref

eree

sm

aybe

tem

pted

toen

gage

inth

efo

llow

ing

type

sof

misco

nduc

t:

–m

isap

prop

riation

ofid

eas—

that

is,st

ealin

gid

eas

from

the

pape

rsan

dgr

ant

prop

osal

sth

ata

refe

ree

isas

ked

toev

alua

te;an

d

–m

isap

prop

riation

ofpr

iorit

y—th

atis,de

layi

ngor

obst

ruct

ing

the

publ

icat

ion

orfu

ndin

gof

are

fere

e’s

rival

sso

that

the

refe

ree

can

beth

efir

stto

publ

ish

are

sult

orto

rece

ive

fund

ing

forwor

kin

apa

rtic

ular

area

.

•If

the

solu

tion

toth

ere

fere

e’s

own

rese

arch

prob

lem

isfo

und

ina

pape

ror

gran

tpr

opos

alse

ntto

the

refe

ree

for

confi

dent

ialr

evie

w,th

enpe

rmission

tous

eth

ose

idea

sm

ust

beso

ught

from

the

auth

oran

dac

know

ledg

edin

pape

rsex

ploi

ting

thos

eid

eas.

17

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

C.

Supp

ress

ion

ofIn

nova

tion

•Se

eM

cCut

chen

(199

7)an

dH

orro

bin

(199

1)fo

rex

ampl

esof

grou

ndbr

eaki

ngid

eas

that

wer

ere

ject

edfo

rpu

blic

atio

nor

not

fund

edbe

caus

eof

the

inhe

rent

cons

erva

tism

ofre

view

ers.

•Ya

low

(198

2)su

mm

ariz

edth

egi

stof

the

prob

lem

:

The

rear

em

any

prob

lem

sw

ith

the

peer

revi

ewsy

stem

.Per

haps

the

mos

tsign

ifica

ntis

that

the

trul

yim

agin

ativ

ear

eno

tbe

ing

judg

edby

thei

rpe

ers.

The

yha

veno

ne! 18

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

D.

Pub

licat

ion

Bia

s

•In

educ

atio

n,m

edic

ine,

and

psyc

holo

gy,th

ere

iscl

ear

evid

ence

ofpu

blic

atio

nbi

asre

flect

ing

the

dire

ctio

nan

dst

reng

thof

stud

yre

sults

(Dic

kers

in19

91).

•O

ther

caus

esof

bias

inre

fere

es’re

port

sin

clud

e:je

alou

sy;re

veng

e;an

dpr

ejud

ice

agai

nst

cert

ain

topi

cs,in

divi

dual

s,or

inst

itut

ions

(McC

utch

en19

97).

19

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

V.G

UID

ELI

NES

FOR

PEER

REV

IEW

A.

Arc

hiva

lJou

rnal

Art

icle

s

•T

wo

mai

nre

ason

sfo

rbr

eakd

owns

inre

fere

eing

are

–m

isco

ncep

tion

sby

refe

rees

abou

tth

ejo

bth

eyar

esu

ppos

edto

do;

and

–m

ispe

rcep

tion

sby

refe

rees

abou

tth

ein

cent

ives

(res

pect

ivel

y,co

nseq

uenc

es)

fordo

ing

ago

od(r

espe

ctiv

ely,

bad)

job

ofre

fere

eing

.

•Ref

eree

’sm

ain

resp

onsibi

litie

sar

eto

–se

rve

the

editor

asan

“exp

ert

witne

ss,”

and

–an

swer

cert

ain

key

ques

tion

sab

out

the

pape

r.

•M

ost

ofth

ese

ques

tion

sca

nbe

answ

ered

assu

min

gth

epa

per

iser

ror-

free

.

20

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

•G

.H

.H

ardy

said

are

fere

em

ust

answ

erth

ree

ques

tion

sab

out

api

ece

ofre

sear

choff

ered

for

publ

icat

ion:

3.Is

ittr

ue?

2.Is

itne

w?

1.Is

itin

tere

stin

g?

•A

coge

ntex

ampl

eof

such

are

view

Thi

spa

per,

who

sein

tent

isst

ated

inits

title,

give

sw

rong

solu

tion

sto

triv

ialp

robl

ems.

The

basic

erro

r,ho

wev

er,is

not

new

...

—Cliff

ord

Tru

esde

ll,M

athe

mat

ical

Rev

iew

s12

(Jan

uary

1951

):56

1.

21

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

Key

Que

stio

nsto

be

Ans

wer

edin

aRef

eree

’sRep

ort

1.A

reth

epr

oble

ms

disc

usse

din

the

pape

rof

subs

tant

iali

nter

est?

Wou

ldso

lution

sof

thes

epr

oble

ms

mat

eria

llyad

vanc

ekn

owle

dge

ofth

eory

,m

etho

ds,or

appl

icat

ions

?

2.D

oes

the

auth

orei

ther

solv

eth

ese

prob

lem

sor

else

mak

ea

cont

ribut

ion

towar

da

solu

tion

that

impr

oves

subs

tant

ially

upon

prev

ious

wor

k?

3.A

reth

em

etho

dsof

solu

tion

new

?Can

the

prop

osed

solu

tion

met

hods

beus

edto

solv

eot

her

prob

lem

sof

inte

rest

?

22

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

4.D

oes

the

expo

sition

ofth

epa

per

help

tocl

arify

our

unde

rsta

ndin

gof

this

area

ofre

sear

chor

appl

icat

ion?

Doe

sth

epa

per

hold

our

inte

rest

and

mak

eus

wan

tto

give

the

pape

rth

eca

refu

lrea

ding

that

we

give

toim

port

ant

pape

rsin

our

area

ofsp

ecia

lizat

ion?

5.A

reth

eto

pic

and

natu

reof

this

pape

rap

prop

riate

for

this

jour

nal?

Are

the

abst

ract

and

intr

oduc

tion

acce

ssib

leto

age

nera

lrea

der

ofth

isjo

urna

l?Is

the

rest

ofth

epa

per

acce

ssib

leto

are

adily

iden

tifie

dgr

oup

ofre

ader

sof

this

jour

nal?

6.A

reth

ecl

arity

and

read

abili

tyof

the

man

uscr

ipt

acce

ptab

le?

Isth

ew

ritin

ggr

amm

atic

ally

corr

ect?

23

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

7.D

oes

the

man

uscr

ipt

cont

ain

anad

equa

tese

tof

refe

renc

es?

Isad

equa

tecr

edit

give

nto

prio

rwor

kin

the

field

upon

whi

chth

epr

esen

tpa

per

isbu

ilt?

8.Is

the

mat

eria

lapp

ropr

iate

lyor

gani

zed

into

aneff

ective

mix

ofte

xt,

figur

esan

dta

bles

?A

reda

tagi

ven

inta

bles

bett

erpr

esen

ted

infig

ures

orin

the

text

?

9.Is

the

wor

kte

chni

cally

corr

ect?

Are

the

mai

nco

nclu

sion

sju

stifi

edby

the

expe

rimen

tald

ata

and

bylo

gica

llyva

lidar

gum

ents

?A

reth

eth

eore

ms

stat

edan

dpr

oved

corr

ectly

give

nth

eas

sum

ptio

ns?

Inpr

actica

lap

plic

atio

nsof

the

theo

retica

lres

ults

,do

the

auth

ors

chec

kth

eva

lidity

ofth

eun

derly

ing

assu

mpt

ions

?

24

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

10.

Are

ther

ega

psin

the

disc

ussion

ofth

eex

perim

enta

lmet

hods

orre

sults?

Ifth

ere

are

such

gaps

,ca

nth

ecl

osin

gof

thes

ega

psbe

cons

ider

ed(i)

esse

ntia

l,(ii)

desira

ble,

or(iii)

inte

rest

ing?

Are

the

expe

rimen

talm

etho

dsde

scrib

edin

suffi

cien

tde

tail

soth

atot

her

inve

stig

ator

sca

nre

prod

uce

the

expe

rimen

ts?

11.

Hav

eth

eau

thor

sex

plic

itly

addr

esse

dth

elim

itat

ions

ofth

eir

stud

y—th

atis,ha

veth

eyad

here

dto

Feyn

man

’sid

ealo

f“u

tter

hone

sty”

and

“lea

ning

over

back

war

ds”

inre

port

ing

thei

rre

sults?

25

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

•Se

eal

so

–“A

Gui

defo

rN

ewRef

eree

sin

The

oret

ical

Com

pute

rSc

ienc

e”by

Ian

Par

berr

y,w

hich

isav

aila

ble

onlin

evi

a

www.eng.unt.edu/ian/pubs/referee.pdf;

–“R

ules

for

Ref

eree

s”(F

orsc

her,

Scie

nce,

1965

);

–“S

ome

Not

eson

Ref

eree

ing”

(Gle

ser,

The

Am

eric

anSt

atistici

an,

1986

);

–“W

ritin

gan

Effe

ctiv

eM

anus

crip

tRev

iew

”(W

aser

,Pric

e,an

dG

rosb

erg,

Bio

Scie

nce,

1992

);an

d

–Cha

pter

4of

Scie

ntifi

cIn

tegr

ity:

Tex

tan

dCas

esin

Res

pons

ible

Con

duct

ofRes

earc

h(M

acrin

a20

05).

26

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

B.

Gra

ntPro

posa

ls

•To

dese

rve

fund

ing,

apr

opos

alsh

ould

beda

ring,

nove

l,or

inte

rest

ing

(Roz

enwei

g,D

avis,an

dB

row

n,19

88).

•A

positive

revi

ewof

such

apr

opos

alsh

ould

prov

ide

deta

iled

answ

ers

toth

efo

llow

ing

ques

tion

s:

1.W

hyis

the

prop

osed

rese

arch

impo

rtan

t?

2.W

hat

cont

ribut

ion

will

the

prop

osed

rese

arch

mak

e?

3.W

hyar

eth

ein

vest

igat

ors

qual

ified

todo

the

wor

k?

•Rev

iewer

ssh

ould

guar

dag

ains

tth

ete

nden

cyto

give

muc

hm

ore

deta

iled

com

men

tson

the

wea

knes

ses

ofa

prop

osal

than

onits

stre

ngth

s.

27

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

VI.

CA

RRO

TS

AN

DST

ICK

SIN

TH

EPEER

REV

IEW

SY

ST

EM

•Rew

ards

for

good

revi

ewin

g

–Rev

iew

ing

man

uscr

ipts

and

gran

tpr

opos

als

ison

eof

the

mos

tim

port

ant

way

sin

whi

chin

divi

dual

rese

arch

ers

can

cont

ribut

eto

the

deve

lopm

ent

ofth

eir

disc

iplin

e.

–M

cCut

chen

(199

7)ob

serv

edth

atRev

iew

ing

ofjo

urna

lart

icle

san

dgr

ant

appl

icat

ions

give

sre

view

ers

the

inte

llect

ualp

leas

ure

ofin

tera

ctin

gw

ith

auth

ors

and

prop

oser

s,as

wel

las

educ

atio

nth

at,Isu

spec

t,ha

sle

dto

mor

ead

vanc

esth

ange

nera

llyre

aliz

ed.

The

sere

war

dsar

ele

gitim

ate.

28

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

–Si

nce

the

best

refe

rees

gene

rally

rece

ive

the

best

pape

rsan

dpr

opos

als

tore

view

,th

ose

indi

vidu

als

enjo

yth

ebe

nefit

sof

cont

inua

lpro

fess

iona

len

richm

ent

and

rene

wal

.

–H

igh-

visibi

lity

editor

ialp

ositio

nsar

eus

ually

fille

dfrom

the

rank

sof

prom

ptan

din

sigh

tful

revi

ewer

s;an

dm

ost

univ

ersities

and

man

yot

her

rese

arch

orga

niza

tion

sre

gard

appo

intm

ent

tosu

chpo

sition

sas

grou

nds

for

prom

otio

nan

dot

her

form

sof

prof

ession

alad

vanc

emen

t.

29

Res

pons

ible

Aut

hors

hip

and

Pee

rRev

iew

•Con

sequ

ence

sof

Bad

Rev

iew

ing

–B

adre

fere

eing

can

caus

elo

ng-la

stin

gda

mag

eto

anin

divi

dual

’sre

puta

tion

inth

eey

esof

editor

san

dpr

ogra

mm

anag

ers,

who

incr

easing

lym

aint

ain

com

pute

rized

reco

rds

onth

epe

rfor

man

ceof

revi

ewer

s(A

belson

1992

).

–So

me

editor

sm

aint

ain

an“A

”lis

tof

good

refe

rees

and

a“B

”lis

tof

bad

refe

rees

;an

dw

hen

auth

ors

from

eith

erlis

tsu

bmit

apa

per

for

revi

ew,th

eed

itor

sele

cts

refe

rees

for

that

pape

rfrom

the

auth

or’s

list.

30