C.1 Example of a typical SDI education survey instrument

TABLE C.1 Example of a typical SDI education survey instrument

Visit and instrument model Module title First visit Module 1 School information

Modules 2A and 2B Teacher roster

Data collector Interviewee Description

Enumerator 1 Principal or head teacher

Enumerator 1 2A: Head teacher 2B: Selected teachers Administered to the head of the school to collect information about the type of school, school facilities, school governance, number of students, and school hours

2A: Administered to head teacher to obtain a list of all school teachers 2B: Administered to selected teachers to collect information about teacher characteristics

Module 3 School finances Enumerator 1 Principal or head teacher Administered to the head of the school to collect information about school finances

Module 4 Classroom observation Enumerators 1 and 2 Observation (teachers and pupils)

Module 5 Pupil test Enumerator 2 Pupils An observation module to assess teaching activities and classroom conditions

A test of students to have a measure of student learning outcomes in mathematics and language in fourth grade

Module 6 Teacher assessment Enumerator 2 Teachers A test of teachers covering mathematics and English subject knowledge and teaching skills

Second visit Module 2B Teacher roster Enumerators 1 and 2 2B: Selected teachers Administered to selected teachers to measure absence rates and count number of unstaffed classrooms

Source: Service Delivery Indicators (SDI) education survey for Kenya (2012).

activities. Once at health facilities, each enumerator is assigned a specific role to perform during the simulation activity. One enumerator, the “patient enumerator,” acts as the patient (or the caregiver of the patient) and presents the symptoms of each of the clinical simulation cases to the health worker. A second enumerator, the “observer enumerator,” instructs the health worker to manage the clinical simulation case as he or she would a real patient, assuming that the health facility is fully functional and equipped, staffed, and stocked with all medications and supplies as per national guidelines. The observer enumerator silently notes the clinical questions and procedures provided by the health worker during the simulation exercise, while the patient enumerator provides the associated standardized response for each of the health worker’s clinical questions and procedures.

Distinct task assignments are also distributed to enumerators during SDI school visits. For instance, during the first, announced visit, one enumerator

could interview the principal or head teacher to complete the school information module (module 1), collect the list of all teachers (module 2A), and complete the school finances module (module 3); another enumerator could observe class lessons (module 4) and administer tests to pupils and teachers (modules 5 and 6, respectively).

Before leaving the facility, the field team supervisor reviews each completed interview and observation module to check for completeness and consistency. If the instruments are incomplete, the enumerator is sent back to collect the missing data from the respondent. Special efforts are made to avoid high rates of nonresponse. If the respondent refuses to be interviewed, a reasonable and polite effort is made to elicit consent from the respondent to participate in the study. Because refusals may stem from misconceptions about the survey or other prejudices, enumerators are carefully trained and encouraged to consider the respondent’s point of view, adapt to it, and reassure him or her.

The field coordinator then implements a second level of quality control, often using spot-check and back-check techniques to ensure the quality and legitimacy of data collected by survey teams. During these fieldwork checks, the field coordinator accompanies a survey team and provides feedback and recommendations to enumerators to improve the delivery of the instrument. Finally, task teams and local technical teams provide the final stage of quality control through periodic review of preliminary data, conducting high-frequency analysis to ensure smooth conduct of survey activities and recommend timely rectifications, if needed.

During the third stage, analysis and capacity building, two-week workshops are conducted to build the technical working group’s capacity for analyzing and interpreting data and undertaking preliminary analyses of core indicators. Tables of key results and slides of summary results are drafted for preliminary review by the task team and government authorities, and a draft report is written.

Finally, during the dissemination and mobilization stage of the SDI project, data and findings are made broadly available to inform the development of policies and design of interventions to improve health and education outcomes in the client country and around the globe. High public awareness of SDI results mobilizes policy makers and citizens as well as donors and other stakeholders into action. SDI projects use a multitude of dissemination materials targeting a variety of consumers of information, including a standardized SDI report, slide decks with key results, and an SDI results brief.

To date, more than 3,200 schools, 34,000 teachers, 7,500 health facilities, and 66,000 health workers have been surveyed in 24 SDI surveys completed across Africa. Now the SDI initiative is expanding globally, and, through fiscal 2021/22, SDI survey work will advance in several countries in Africa and other regions. Participating countries are at different stages of the SDI process, ranging from procurement to data collection and analysis.

Notes

1 | SDI facility surveys are increasingly coupled with household surveys to provide a complete perspective on the quality of basic health and primary school services.

2 | Technical adaptations of the instruments are carried out—for instance, aligning the list of essential medicines and medical equipment to the national guidelines.

3 | In countries where more than one language is spoken, local translators are hired to accompany survey teams.

4 | For the second visit, which is expected to be a surprise visit, the letter should not specify when the visit will occur.

5 | Often, enumerators take advantage of this second visit to complete any information missing from the first visit.