Embed Size (px)
DESCRIPTION
Citation preview
Overviewofevidence‐baseddecision‐making
GillianPetrokofsky
UniversityofOxford
10/04/2013 UNFFIstanbul,10April,2013 1
EvidenceUseinPolicyMakingNationalgovernmentsUSAObama,B.H.(2009),InauguralAddress,WashingtonDC,20January,availableat:http://www.whitehouse.gov/the‐press‐office/president‐barack‐obamas‐inaugural‐address.CoalitionforEvidence‐BasedPolicyMaking(http://coalition4evidence.org/)AustraliaLeigh,A.(2009),'Whatevidenceshouldsocialpolicymakersuse?',AustralianTreasuryEconomicRoundup,1,pp.27‐43.CanadaTownsend,T.andKunimotoB.(2009),CollaborationandCulture.TheFutureofthePolicyResearchFunctionintheGovernmentofCanada,PolicyResearchInitiative,Ottawa,Canada,March.NewZealandMarsh,D.(2006)Evidence‐basedpolicy:framework,resultsandanalysisfromtheNewZealandbiotechnologysector.Int.J.ofBiotechnology,Vol.8,No.3/4,pp.206‐224SouthAfricaOfficeofthePresidency(2010),GuideToTheOutcomesApproach,Pretoria,OfficeofthePresidencyofSouthAfricaUKCabinetOffice(1999)ModernisingGovernmentWhitePaper,CM4310.London:TSO.
InternationalfocusOECDUNESCOWorldBankDfIDAusAIDCochraneCollaborationCampbellCollaborationCollaborationforEnvironmentalEvidenceEppiCentre
10/04/2013 UNFFIstanbul,10April,2013 2
Evidenceforpolicy“sciencedoesnotperseprovideanswerstopolicyissues,norisittheonlysourceofwhatcountsasauthoritativeevidence”(Sutherlandetal.,2012)
WeacknowledgethatitiscomplexScienceisnottheonlyformofevidence…….however
‘rarelydoesresearchsupplyan“answer”thatpolicyactorsemploytosolveapolicyproblem.Rather,researchprovidesabackgroundofdata,empiricalgeneralisations,andideasthataffectthewaythatpolicymakersthinkaboutaproblem……buttoacknowledgethisisnotthesameassayingthatresearchfindingshavelittleinfluenceonpolicy.’(Weiss,1982)
10/04/2013 UNFFIstanbul,10April,2013 3
‘Evidencebasedforestry’amodel
Bestscience
Society’sneeds&
preferences
Expertopinion
EBF
7/05/2013 Corvallis,Oregon2013 4
Bewareofexperts’bias!
Goodinformationforpolicy
10/04/2013 UNFFIstanbul,10April,2013 5
Aframeworktoreducebias Systematicreview:areviewofaclearlyformulatedquestionthatusessystematicandexplicitmethodstoidentify,selectandcriticallyappraiserelevantresearch,andtocollectandanalysedatafromthestudiesthatareincludedwithinthereview.Statisticalmethods(meta‐analysis)mayormaynotbeusedtoanalyseandsummarisetheresultsoftheincludedstudies.
CollaborationforEnvironmentalEvidence(2013)GuidelinesforSystematicReviewandEvidenceSynthesisinEnvironmentalManagement.
Goodinformationforpolicy
10/04/2013 UNFFIstanbul,10April,2013 6
Aframeworktoreducebias Systematicreview:areviewofaclearlyformulatedquestionthatusessystematicandexplicitmethodstoidentify,selectandcriticallyappraiserelevantresearch,andtocollectandanalysedatafromthestudiesthatareincludedwithinthereview.Statisticalmethods(meta‐analysis)mayormaynotbeusedtoanalyseandsummarisetheresultsoftheincludedstudies.
CollaborationforEnvironmentalEvidence(2013)GuidelinesforSystematicReviewandEvidenceSynthesisinEnvironmentalManagement.
Goodinformationforpolicy
10/04/2013 UNFFIstanbul,10April,2013 7
Systematicreview:areviewofaclearlyformulatedquestionthatusessystematicandexplicitmethodstoidentify,selectandcriticallyappraiserelevantresearch,andtocollectandanalysedatafromthestudiesthatareincludedwithinthereview.Statisticalmethods(meta‐analysis)mayormaynotbeusedtoanalyseandsummarisetheresultsoftheincludedstudies.
CollaborationforEnvironmentalEvidence(2013)GuidelinesforSystematicReviewandEvidenceSynthesisinEnvironmentalManagement.
Aframeworktoreducebias
Whataretheimportantquestions?
• Whodecides?– Howmuchcollaboration?
–Whatmethods?
–Whopays?
– Sowhat?
10/04/2013 UNFFIstanbul,10April,2013 8
CIFOR&Partners’EBFinitiative
• Whodecides?– Partnership– guidedbyaSteeringCommittee
• Whatmethods?– internet‐basedmoderatedapproach– standinginvitationtosuggestquestions– meetingswherekeystakeholdersgather
• Whopays?– initialseed‐funding– donor/national/International/Privatesectorfunding
• Sowhat?– SystematicReviewsofevidencetosupportquestions
10/04/2013 UNFFIstanbul,10April,2013 9
Firsttrancheofpriorityquestions
Topic CIFORleadauthor;keypartners
Impactsofbiofuelcropsonbiodiversity SiniSavilaasko;ETH
Gender,forests&foodsecurity EstherMwangi;SLU
Conceptsofsciencequality&researchevaluation
BrianBelcher;RoyalRoadsUniv
Biodiversitybenefitsof“alternativelivelihood”projects
TerrySunderland;IIED,ZoologicalSocietyofLondon
Propertyrightsandtheenvironment MariaOjanen;UMichigan
10/04/2013 UNFFIstanbul,10April,2013 10
SecondtrancheandbeyondOnlinecollaboration CollaborationatMeetings
UNFF–aninteractivesessiontoscopepolicyquestionsforsystematicreview
10/04/2013 UNFFIstanbul,10April,2013 11
Interactivesessiontoscopepolicyquestions
Aim:Identifykeypolicyquestionsofpolicy‐relevancewhichrequirestrongscienceevidencebase
Whattodo1. reviewflyer&brieflycompletethesecondpageindividually
(5minutes)2. getintosmallgroups&chooseaspokesperson¬e‐taker3. discussyourindividualquestions4. selectonethatyoucanallagreeisahighpriorityandcanbe
addressedpractically5. asagroupcompleteaformforthisquestion6. bepreparedtopresentyourquestionbrieflytoall7. wewillcollectALLindividualandgroupsuggestionspleasetakegoodnotesofyourgroupdiscussions
10/04/2013 UNFFIstanbul,10April,2013 12
References
• Lomas,J.(2000)Connectingresearchandpolicy.Spring.• Seddon,A.etal.(inpress)Lookingforwardthroughthepast.Identificationof
50priorityresearchquestionsinpalaeoecology• Petrokofsky,G.,N.D.Brown,G.E.Hemery,etal.(2010).Aparticipatoryprocess
foridentifyingandprioritizingpolicy‐relevantresearchquestionsinnaturalresourcemanagement:acasestudyfromtheUKforestrysector.Forestry83,357‐367.
• Pretty,J.,etal.(2010)Thetop100questionsofimportancetothefutureofglobalagriculture.InternationalJournalofAgriculturalSustainability,8(4)219‐236
• SutherlandW.J,BellinganL,BellinghamJ.R,BlackstockJ.J,BloomfieldRM,etal.,2012.Acollaboratively‐derivedscience‐policyresearchagenda.PLoSONE7(3):e31824.doi:10.1371/journal.pone.0031824
• Weiss,C.H.(1982)Policyresearchinthecontextofdiffusedecision‐making,in:D.P.B.KALLEN,G.B.KOSSEetal.(1982)SocialScienceResearchandPublicPolicyMaking:areappraisal(Windsor,NFER‐Nelson).
10/04/2013 UNFFIstanbul,10April,2013 13
