Monitoring & Evaluation Plan

For

The Education Improvement Project-Additional Fund

(TEIP-AF)

Prepared By : M&E team, AED

17/10/2016

العاليوزارة التربية والتعليم دائرة القياس و التقويم

Because:

Quality of education can’t exceed quality of teachers…

2

Content

Introduction

M&E Activities for Component I

M&E Activities for Component II

What have been Achieved

The way forward

Main Challenges/Obstacles

3

Introduction

• AED conducted M&E study for TEIP (Phase I ) in

collaboration with related MOEH departments, Related

Universities, and the M&E national experts…

• The purpose of that study was to provide qualitative

and quantitative indicators about the quality of:

Project Process.

Project Impact study.

4

Products of that study

• M&E reports,,,

• Final impact study report…

5

Lesson Learned from the 1st Phase

• To start data collection at the beginning of the project.

• To finalize the M&E plan at the beginning of the project with the help of other stakeholders.

• To restructure the M&E tools based on the new (modifications of the project).

6

M&E planfor

COMPONENT I (pre-serviced teacher training)

7

Process M&E Activities

1. Implementing satisfaction survey addressing issues related to practicums based on RTTI (Updated).

2. Conducting structured focus groups with : school principals.

mentors.

academic supervisors.

district supervisors.

future teachers .

Classroom students .

Management team .

3. Collecting future teachers related materials to be analyzed and evaluated

Portfolio

Teacher-made test

Lesson plans

8

Methodology (1):

Kirkpatrick model will be adopted for this study benefiting from the process evaluation data sets .

9

Kirkpatrick Evaluation ModelThe model adopted 4 levels :

10

(Reaction)

(Learning)

(Behavior)

(Results)

Trainee response and satisfaction with the training

Standard of the trainees included in

the project & evaluation of the skills acquired by

the trainee.

Changes observed in the trainee’s

performance when applying the new

skill.

The extent to which the beneficiaries had gained

from training through changes observed in their performance

,degree of mastry of acquired skills.

Methodology (cont.):

Sample design :• Satisfaction survey: census .• Focus groups: purposeful sample but faire

representative.• Observing change in pedagogy of future teachers

(conducting classroom observations using stratified random sample ).

• Measuring for 4th graders for the observed teachers.

Study design: • A pre-post design with time series measure on “level

based” .

11

To achieve the evaluation model

(level 3 &4)

12

M&E planfor

COMPONENT II ( In-service teacher training )

13

Process M&E Activities

1. Implementing satisfaction survey addressing issues related to the training packages based on PPTDI (the Updated one).

2. Conducting structured focus groups with : school principals.

academic supervisors.

district supervisors.

Trained teachers .

Classroom students .

Management team .

3. Collecting headmasters and supervisors’ evaluation forms for targeted teachers (cohorts 1 and 2).

4. Collecting related materials to be analyzed and evaluated:

Portfolio .

Teacher-made test

Lesson plans

14

Methodology

Kirkpatrick model will be adopted for this study benefiting from the process evaluation data sets.

15

Methodology (cont.):

Sample design :• Satisfaction survey : census .• Focus groups : purposeful sample “but faire representative”.• Headmaster & supervisor’ Evaluation forms : census

• Observing change in pedagogy of trained teachers .(stratified random sample).

• Measuring achievement for sample of 4th graders for the observed teachers.

Study design : • A Quasi -experimental pre-post design with time series measure

on cohort based .(experiment group will be sampled from cohort1,and the control will be sampled from cohort2)

16

What have been Achieved:

Developing the “M&E framework for TEIP- AF, and discussing this document with all stakeholders…

Modifying the Satisfaction Survey Modifying FG protocols Developing and Piloting the classroom observation tool

“component II”. Developing the classroom observation tool “component I”. Developing a “user guide” for the observation tools. Drawing classroom observation samples “still not

approved”. Preparing timetable of M&E visits “sill changeable one”.

17

The way foreword:

• Arranging field visits to collect the needed data sets

• Contracting part timers for data entry and data processing

• Developing “rubrics” to evaluate: portfolios, tests, And lesson plans.

• Formulating research teams for the aforementioned task.

18

Challenges:

• Readiness of trainees lists for all cohorts (Comp.II).

• Readiness of future teachers lists from all universities (Comp.I).

• Arrangements and Contact with Gaza.

• Conduct activities in Jerusalem.

• Transportations and logistics.

19

كم نشكر لكم حسن استماعكم ونتمنى ل

يوما سعيًدا

Thanks

20