8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
1/22
Cliquez pour modifier le style des sous-titres dumasque
Janosz 2010 Janosz 2010
Evaluation of the New Approaches, NewSolutions Intervention Strategy (NANS)
2002-2008
Overview
Preventing Shool Failure in DisadvantagedCommunities
Michel Janosz, Ph.D.
Groupe de recherche sur lesenvironnements / Research Group onSchool Enviornments (GRES)
Universit de Montral
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
2/22
Evaluation Team
Under the leadership of Michel Janosz (UdeM)
Implementation Effects Jean Blanger UQAM Franois Bowen, UdeM
Christian Dagenais UdeM
Gilles Roy, Louis Turcotte ve Paquette, Clia Kremer
Frdric Brire, AlexandreChabot, Didier Dupont, Julie Dutil
Phil Abrami Concordia Sylvie Cartier UdeM
Roch Chouinard UdeM Nadia Desbiens UdeM Jean-Sbastien Fallu UdeM
Christiane Bouthillier Sophie Pascal, Larysa Lysenko Martine Lacroix, Cline Dufresne,
Isabelle Cagiotti, Marcela Quesada Marianne Dub, Annie Chartier
2
co-chercheurs entre 2002-05 Marc-Andr Deniger (2002-2005; UdeM)Richard Bertrand
(2002-2004; U. Laval)
Michel Perron (2002-2004; C. Jonquire)
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
3/22
Janosz 2010 Janosz 2010
33
Plan of presentation
1. What is the New Approaches, New SolutionStrategy?
1. Evaluation questions and methodology
3. A glimpse of results and recommendations
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
4/22
Janosz 2010 Janosz 2010
44
What is the NewApproaches,New Solution Strategy?
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
5/22
Cliquez pour modifier le style des sous-titres dumasque
Janosz 2010 Janosz 2010
General
GoalsTo break the vicious circle of thePoverty-School failure relation.
To improve school success amongstsecondary school students from themost disadvantages communities (200middle and high schools)
Annual funding of 25M$ for 6 years distributedaccording to school size and level of poverty.
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
6/22
Cliquez pour modifier le style des sous-titres dumasque
Janosz 2010 Janosz 2010
Background
Schools as learning communities
Schools decide the interventions they wantto implement locally according to their specificneeds, strength and weaknesses.
Specific interventions are not prescribed,but schools have to follow a structuredcollective problem solving approach in order toselect, implement and evaluate them.
Model of
action
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
7/22
Janosz 2010 Janosz 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
8/22
Cliquez pour modifier le style des sous-titres dumasque
Janosz 2010 Janosz 2010
Implementation national level
EFFECTS
Implementation schoollevel
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
9/22
Janosz 2010 Janosz 2010 99
Evaluation questions and
methodology
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
10/22
Janosz 2010 Janosz 2010
Implementation
Did the Strategy implemented itself asexpected at the Ministry, School board
and school levels?
What explain the gap between what wasplanned and what was realized ?
Annual self-reports questionnaires andface-to-face interviews (180 principals,2 000 teachers)
Questions andmethod
1010
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
11/22
Janosz 2010 Janosz 2010
School-level outcomes Did NANS have positive effects on the
educational potentialof schools withregard to school climate, school violence,
educational practices, school-community andschool-family collaboration?
Student-level outcomes Did NANS have positive effects on the
success of students with regard to learningand motivation, social relationships withpeers and teachers, psychosocial well-beingand life-styles, school perseverance? 1111 Janosz, 2010
Questions andmethod
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
12/22
Janosz 2010 Janosz 2010
Longitudinal quasi-experimental designwith non equivalent group
Annual multiple surveys of 30 000students, 4 000 school personnel in 81schools (70 NANS sampled school, 11comparison schools)
Breakdown of the effects according tothe quality of implementation (alongitudinal index)
1212
Janosz, 2010
Questions andmethod
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
13/22
Janosz 2010 Janosz 2010 1313
A glimpse of results and
recommendations
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
14/22
Janosz 2010 Janosz 2010 1414
The Strategy seemed to be effective atimproving the educationalenvironment but only in the peripheralaspects of the classroom (schoolclimate, violence, school-familycollaboration).
Consequently, it was no surprise thatimprovement at the student level wereconfined to the sphere of socialization
(misbehavior, drug use) and not in
Results
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
15/22
Janosz 2010 Janosz 2010 1515
When positive changes we observed,they were almost always stronger inschools that appeared to have better
implemented the NANS model.
Results
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
16/22
Janosz 2010 Janosz 2010 1616
Nevertheless, most schools hadsignificant difficulties at engagingsuccessfully into the NANS structured
process and many school boards failedat supporting their schools to do so.
The most significant changes inschools practices appeared wheresupport and guidance were provided inquantity and quality.
Results
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
17/22
Janosz 2010 Janosz 2010
The evaluation of implementation revealed aseries of conditions (barriers, facilitators)explaining why, at the end, schools tendedto do more of the same instead of doing
things differently.
Not having taken the time to reflect on ones
practice and perceptions andunderstandings of what it meant to teach todisadvantaged students was one of themultiple barrier highlighted.
1717
Janosz, 2010
Implications
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
18/22
Janosz 2010 Janosz 2010
Interpretation of the results helped us tomake 13 recommendations to the Ministry,according to
1. What components of the Strategy tomaintain
1. What components to revisesignificantly
1. What new conditions to gather and1818 Janosz, 2010
Implications
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
19/22
Janosz 2010 Janosz 2010
e
1919
MERCI BEAUCOUP
DE VOTRE ATTENTION
Reports can bedownloaded at
WWW.GRES-UMONTREAL.CA
Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
20/22
Janosz 2010 Janosz 2010 Janosz, 2010
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
21/22
Janosz 2010 Janosz 2010
Table 2. Distribution of sampled NANS schools and comparison schools based on size andsociogeographic location
Location School size NANS schoolsSampled NANS
schoolsComparison
schools(n=197) (n=66) (n=11)
n(%) n (%) n (%)
Rural Small school 19 (9,64) 9 (13,64) - -
Medium school 12 (6,09) 4 (6,06) - -
Large school 3 (1,52) 1 (1,52) - -Total 34 (17,26) 14 (21,21) - -
Urban Small school 18 (9,14) 2 (3,03) - -
Medium school 31 (15,74) 11 (16,67) 1 (9,09)
Large school 58 (29,44) 24 (36,36) 9 (81,82)
Total 107 (54,31) 37 (56,06) 10 (90,91)Major City Small school 11 (5,58) - - - -
Medium school 11 (5,58) 1 (1,52) - -
Large school 34 (17,26) 14 (21,21) 1 (9,09)
Total 56 (28,43) 15 (22,73) 1 (9,09)
All locations Small school 48 (24,37) 11 (16,67) - -
Medium school 54 (27,41) 16 (24,24) 1 (9,09)
Large school 95 (48,22) 39 (59,09) 10 (90,91)
8/4/2019 Support schools serving disadvantaged communities - NANS Project-Quebec M Janosz Sep 15-11
22/22
Janosz 2010 Janosz 2010