Syllabus


Course Objectives:

  • Define and distinguish between monitoring and evaluation.
  • Develop a program logic model to communicate an evidence-based program theory.
  • Develop an M&E plan to track progress of program activities toward objectives and assess program effectiveness.   
  • Develop quantitative and qualitative indicators and targets for an M&E plan.
  • Use relevant qualitative and quantitative data collection and analysis methods to track and evaluate program progress.
  • Identify the qualities of effective qualitative and quantitative data collection tools.
  • Describe how program data can be used for decision-making.
  • Apply ethical guidelines for data collection and reporting.

Topics


Module 1: An introduction to monitoring and evaluating in global health

  • Define monitoring and evaluation.
  • Distinguish between monitoring and evaluation.
  • Explain why M&E is important.
  • Identify monitoring best practices.
  • Explain how key M&E activities fit into a typical program cycle.
  • Describe strategies to address common concerns about program evaluation.

Module 2: Program theory and frameworks

  • Define what a program theory is.
  • Identify three program frameworks.
  • List the five main components of a logic model.
  • Develop evidence-based program outcomes that align with program impact.
  • Develop program outputs that align with program activities and outcomes.

Module 3: M&E plans

  • Describe what an M&E plan is and why it is an important aspect of program success
  • Explain the relationship between logic models and M&E plans
  • Define the key components of an M&E plan
  • Write SMART objectives
  • Name and explain the qualities of effective program indicators
  • Develop indicators and targets for an M&E plan according to specified criteria
  • Describe the 6 steps involved in developing and implementing an M&E plan

Module 4: Monitoring

  • Describe the basic steps to conducting effective program monitoring.
  • List three potential data sources for program monitoring.
  • Conduct descriptive analysis to summarize data for program monitoring.
  • Describe three data visualization methods to visualize data for action.

Module 5: Evaluation

  • Describe the main steps to conducting a program evaluation;
  • Explain when the five types of program evaluations are used;
  • Develop relevant program evaluation questions;
  • Describe three program evaluation methodologies;
  • Describe two quantitative designs commonly used in program evaluation;
  • Name one key element to successful dissemination of evaluation findings.

Module 6: Quantitative data collection methods

  • Explain quantitative sampling approaches, including what information is needed to calculate sample size.
  • Explain three principles of data collection.
  • Describe three data collection methods for program evaluation.

Module 7: Quantitative data analysis

  • List the five main measures of data quality.
  • Explain the importance of processing data for data analysis.
  • Distinguish between descriptive and inferential analysis.

Module 8: Qualitative data collection methods

  • Explain what qualitative data are and how they differ from quantitative data
  • List the advantages and disadvantages of using qualitative data in program M& E
  • Name and describe the steps involved in conducting a qualitative evaluation
  • Describe strategies for planning qualitative evaluations
  • Describe 7 commonly used qualitative sampling methods
  • Explain the criteria used to inform sample size for qualitative data collection

Module 9: Qualitative data analysis

  • Formulate effective open-ended questions to collect qualitative data
  • Explain the overall structure of interview and focus group discussion guides
  • Describe qualitative data collection methods (interviews, focus groups, and observations), when they are used, and their strengths and limitations
  • Distinguish between subjective and objective qualitative observation data
  • Define the 6 basic steps involved in thematic analysis
  • Describe elements to include in a codebook and why codebooks are important
  • Identify guidelines for writing up qualitative findings

Module 10:  Ethics

  • Explain what human subjects protections are and why they are important 
  • Name and define the three fundamental principles of ethics 
  • Explain what informed consent means and describe the key elements of a consent form
  • Distinguish between anonymity, confidentiality, and privacy and describe methods to protect each  
  • Describe procedures that evaluators can adopt to minimize participant vulnerability 
  • Identify the four categories of safeguards for ethical data management and give examples of each 
  • Describe key recommendations to promote ethical reporting, dissemination, and use of findings

Course Activities:


During the course, participants will be expected to:

  • Analyze problem statements and develop outcomes
  • Work with logic models
  • Write SMART objectives and indicators
  • Complete activities around data analysis and visualization (in Microsoft Excel)
  • Assess evaluation questions
  • Analyze qualitative methods
  • Choose sampling methods
  • Create open ended questions
  • Work on an M&E plan