Project Summary
The Just Right Start project aims to prepare Syrian children and disadvantaged host community boys and girls aged between 4-6 years old to be enrolled and retained at formal schools. Many outputs are set to reach this main goal. The project aims to:
Parents of out of school Syrian and host community girls and boys a program that enables safe and learning environment at home. This program is designed to first, raise the awareness of parents through parents’ meetings conducted by the center coordinators; and second, to enable parents with younger children (younger sibling of the enrolled child)
The evaluation is carried out at this point in time to assess and present results (output, outcome), conclusions, lessons learnt and recommendations for a possible future programmatic directions that focus more on changing the mindset towards responsibility for learning results and on ways to scale up Ana Aqra ECE program and influence relevant (formal) education systems.
In August 2020, the project will be completing, 8 of the 6 expected ECE cycles and 6 of the 4 expected Homework support cycles (2 cycles were added during the no cost extension period). A cycle is defined to be the period of 77 teaching days. Each year is composed of 2 cycles and a summer program. Children who reach the age of formal compulsory education are referred to enroll in the formal school.
Evaluation questions
More specifically, it is expected that the evaluator answers the following evaluative questions:
What is the level of implementation of all activities so far? (number of activities implemented vs. how many are supposed to be completed by the end of the project)
Output Indicators
(To be retrieved from Available Progress reports/logframe during the desk review)
- What impact has AA education program had on access and retention of Syrian children in formal education since the beginning of the program?
- How did the ECE and Homework support program contribute to retention of children in formal education and to enhancing their promotion rates?
- What impact has AA Education program had on community participation and refugee engagement of both parents? How has it improved their lives?
-Which intended and unintended negative and positive effects can be possibly attributed to the project/program?
-What role is technology playing to support the education for Syrian children. Is it appropriate and relevant and which areas should be scaled up or adapted in the future?
-How many girls, boys and parents in total have already benefited from the project/program (immediate impact)?
-How can the impact of the Just Right Start project be maximized?
- Are there any other important aspects regarding impact?
Has the partnership with the Private Philanthropic Organization brought any positive or negative impact on the program?
-How relevant and appropriate is the current program design and implementation to the educational, life skills and social needs of Syrian refugee and host community children?
-To what extent has AA adapted to changes in the operating context since 2016?
- What should be done to improve the relevance and appropriateness of the program?
-What programmatic areas should be scaled up or adapted in future?
- To what degree is the project designed and implemented based on the opinions and the priorities of Syrian refugee children and parents? Is it perceived as relevant by them? If so, how?
- To what extent are the different needs of the various sub-groups (children with PSS needs, children with disabilities, children with special education needs) taken into account? How can the program better target sub-groups to become more inclusive?
-Does the curricula and pedagogy meet the needs of the students? How can they be made more appropriate?
- Does the education program meet the INEE minimum standards for education in emergency?
-Are the expected results/outputs of the Just Right Start Project consistent with the outcome, immediate impact and overall goal/impact?
Learning and Sustainability
- What are the suggestions for more effective programming to meet the overarching objective of access and retention in quality formal education? (structurally, work modality and staffing)? Identify current gaps and suggest good practices for future responses and organizational learning.
- What, if any, are the scale up options for the education program in both formal and non-formal education?
- How can AA contribute to a sustainable educational strategy in the host communities? What are the major factors influencing the achievement or non-achievement of sustainability of the Just Right Start Project?
- What steps need to be put in place to ensure the ECE centers and homework support program can continue to provide quality education for the Syrian Refugee and Host community?
- What could be strengthened to achieve greater impact in areas identified as important by children and their parents?
-To what degree have AAA established or improved mechanisms, structures and platforms for generating and reflecting on evidence on the impacts of interventions? What has impeded or supported such efforts?
-To what Degree the evidence generated contributed to influencing AAA internal programming/ national and other NGO ECE platforms/ stakeholders/ and MEHE in Lebanon?
-How well is the AA program internally coordinated? And how can it be improved?
-What is the potential for synergies with other relevant education providers (formal and non-formal)?
-What has been the role of AA in the advocacy and coordination of quality certified education for refugee children within relevant MEHE working groups and sector relevant coordination meetings? How can this be improved?
-How well does the education program coordinate with Formal schools?
-What systems have been established to ensure efficient referrals between formal schools and AA ECE centers? How can these be improved?
The evaluation consists of several phases:
Phase 1: Preparatory stage
Desk Review: A desk review of relevant project documents or sources would be conducted. Key documents to review include: project proposal, project logical framework, the mid-term evaluation report, the monitoring reports (baseline report and second intake report, assessment tools, children’s development and academic progress, relevant minutes from the relevant education working group or task force meetings)
Evaluation matrix and tools development: A detailed evaluation matrix will be produced by the evaluator; which will inform the design of the various evaluation tools that will reflect mixed method. The evaluation matrix and tools (Survey questionnaire and forms) will be part of the inception report that the evaluator will submit to Ana Aqra for approval prior to moving forward in the evaluation process.
Phase 2: Data collection
It is expected that the evaluator sets up a strong data quality insurance process to avoid errors during data collection or data entry both quantitative and qualitative. All 3 centers will be equally included in the data collection plan, and will cover all aspects to inform the analysis.
The evaluator is responsible of collecting, recoding and compiling data.
Phase 3: Data Analysis
The quantitative and qualitative data collected will be analyzed and used in order to present charts, correlations and to write the report of the end-term evaluation study. Ana Aqra Association expects the evaluator to ensure that the evaluation reports meet the objectives as stated in those TOR, that all indicators data be presented and that clear answers to the evaluation questions appears in the report.
Phase 4: Presentation:
Presentation of key quantitative and qualitative findings (feedback workshop) at the end of the conducted evaluation
For the different phases it is expected that data and information will be obtained through different methods such as: data from AA system, review and analysis of documents, structured interviews, semi-structured interviews face-to face or by phone, group discussions, others.
Application Process and Requirements
AAA will be the main focal point for the assignment and direction of the evaluation and will receive directly the evaluation report.
AAA will guide and facilitate the evaluator work in Lebanon by:
AAA will:
The evaluator will:
During the preparation phase, the evaluator will submit a work plan that should clarify the focus of the end-term review and the TOR, highlighting any reservations regarding the feasibility. The report should not exceed 1 page and should include as a minimum:
The evaluator will develop the final methodology for the evaluation that will be discussed and approved by AAA and the donor.
During the preparation phase, the evaluator will submit a work plan that should clarify the focus of the end-term review and the TOR, highlighting any reservations regarding the feasibility. The report should not exceed 1 page and should include as a minimum:
The evaluator will develop the final methodology for the evaluation that will be discussed and approved by AAA and the donor.
The work might be concluded in a period of 31 days and shall include the tasks below:
- Preparation (preparation methodology, work plan, inception report) -
- Field work/data gathering &analysis
- Report writing & presentation
The start of the evaluation is March 2nd, 2020.
Key Qualifications in the team should be:
Reports
The consultants will submit the following reports:
All reports need to be written in English.
The executive summary should summarize key findings and recommendations (three to five pages) and needs to be submitted as part of the final draft report.
The findings and recommendations of the draft final report and final report have to be structured according to the evaluation questions. An outline of the report’s structure needs to be agreed upon during the inception phase.
The quality of the reports will be judged according to the following criteria:
روابط
[1] https://daleel-madani.org/ar/intervention-sectors/ltlym
[2] mailto:[email protected]
[3] http://maps.google.com?q=Beirut%2C+Beirut%2C+Beirut%2C+%2C+Lebanon
[4] https://daleel-madani.org/ar/project-status/startedongoing