A health systems strengthening intervention to improve quality of care for sick and small newborn infants: results from an evaluation in district hospitals in KwaZulu-Natal, South Africa

Many newborn infants die from preventable causes in South Africa, often these deaths occur in district hospitals. A multipronged intervention aiming to improve quality of newborn care in district hospitals was implemented comprising training in clinical care for sick and small newborns, skills development for health managers, on-site mentoring, and hospital accreditation. We present the results of the project evaluation. We conducted three sequential cross-sectional surveys in 39 participating district hospitals at baseline, midpoint and endpoint of the three-year intervention period. Data were collected by a trained midwife using a series of checklists including: availability of trained staff, drugs and equipment; newborn care practices; perinatal mortality audits; neonatal unit staff skills; quality of record keeping. A scoring system was developed for three domains: resources; care practices; resuscitation equipment, and a composite score that included all variables measured. Health worker (HW) knowledge was assessed at midpoint and endpoint. The average score for resources increased from 13.5 at baseline to 22.6 at endpoint (maximum score 34), for care practices from 17.7 to 22.6 (maximum score 29), and for resuscitation equipment from 10.8 to 16.1 (maximum 25). Average composite score improved significantly from 42.0 at baseline to 55.7 at midpoint to 60.7 at endpoint (maximum score 88) (p = 0.0012). Among 39 participating hospitals, 38 achieved higher scores at endpoint compared to baseline. Knowledge was higher among HWs trained during the project at midpoint and endpoint. Gaps that remained included poor infrastructure, lack of resuscitation equipment in some areas, poor postnatal care and lack of a dedicated doctor. This intervention achieved measurable improvements in many important elements contributing to newborn care. A scoring system was used to track progress, compare facilities' performance, and identify areas for improvement. Various methods were used to generate the quality of care score, including skills assessment and record reviews. However, measuring quality of clinical care and outcomes was challenging, and we were unable to determine whether the intervention improved clinical care and lead directly to improved outcomes for babies. In developing a future score for quality of care, a stronger focus should be placed on assessing clinical care and outcomes.