Tools -> Policy makers ->SUPPORT Summaries -> Methods

How SUPPORT Summaries are prepared

SUPPORT aims to summarise the best and most relevant evidence from reviews of interventions to improve maternal and child health in low and middle-income countries (LMIC) and of health systems interventions relevant to LMIC.  These summaries extract the most relevant information from systematic reviews, evaluate the information and present it in a user-friendly manner so that decision-makers can quickly review the evidence and decide whether a particular innovation is likely to be effective in their own context. 

Information presented in our summaries is based on systematic reviews because they have several advantages: they reduce the risk of bias in selecting and interpreting the results of studies; they reduce the risk of being misled by the play of chance in identifying studies for inclusion, or the risk of focusing on a limited subset of relevant evidence; they provide a critical appraisal of the available research and place individual studies or subgroups of studies in the context of all of the relevant evidence; finally, they allow others to appraise critically the judgements made in selecting studies and the collection, analysis and interpretation of the results.
We have screened thousands of references to identify relevant systematic reviews. In order to be selected for a SUPPORT Summary a review must

• be relevant to achieving maternal and child health goals in LMIC
• examine the effects of interventions, services or programmes; or examine the effects of delivery, financial or governance arrangements, or implementation strategies
• have a methods section with explicit selection criteria

For maternal health we have initially restricted ourselves to reviews that look at serious maternal mortality and morbidity and for child health we are concentrating on neonatal health.

For maternal health and child health we searched MEDLINE, the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effectiveness  (DARE).  For health systems we have searched the Cochrane Effective Practice and Organisation of Care Group’s database of systematic reviews, which contains reviews from the Cochrane Database of Systematic Reviews, DARE, MEDLINE and Embase. 

After a review has been identified, two or more reviewers independently assess its relevance based on the abstracts and – when potentially relevant – based on the full text. Reviews that only include studies from high-income countries are included if the interventions examined and the results are considered relevant to LMIC. Next we assess the quality of all included reviews using a checklist and extract data about the focus and main results. The quality of evidence for the main comparisons in each review is graded using the GRADE system. Finally, we consider the applicability of the results to LMIC, impacts on equity, economic considerations, and the need for monitoring and evaluation.  Completed summaries are peer-reviewed by policymakers and researchers in LMIC, other people with relevant expertise and authors of the reviews being summarised.

Judgements about the relevance of a review for low and middle-income countries
Decisions about how to apply the results of systematic reviews are always located in specific contexts. As such they need to take into account local conditions, needs, values, costs and the local availability of resources. We include a summary of key considerations about the relevance of each review for LMIC. This includes judgements about possible differences between where the research was done and of its application in LMIC. For health systems interventions this includes considerations of differences in:

• structural elements of health systems (such that an intervention could not work in the same way)
• on-the-ground realities and constraints (that might substantially alter the potential benefits of the intervention)
• baseline conditions (different absolute effects, even if the relative effectiveness was the same)
• perspectives and influences of health system stakeholders (such that the intervention may not be accepted or taken up in the same way)

We address potential impacts on equity by examining the findings of the review and considering possible differential effects of the interventions for disadvantaged populations. The potential for impacts on equity is considered in relationship to socioeconomic status, place of residence, race, occupation, gender, religion, education, and social network and capital. This includes consideration of the following questions:

• Are there plausible reasons for anticipating differences in the relative effectiveness of the intervention in disadvantaged settings within the country?
• Are there likely to be different baseline conditions within the country, so that the problem would be more or less important in disadvantaged settings within the country?
• Are there likely to be different baseline conditions in disadvantaged settings within the country, so that the absolute effectiveness would be different?
• Are there important considerations that should be given to implementing the intervention to ensure that inequities are not increased and that they are reduced

In settings with limited resources, policymakers are deeply concerned about the economic consequences of an intervention. The costs and cost-effectiveness of an intervention need to be assessed in a specific setting in order to take account of differences in patterns of resource use and prices. To help decision-makers to make these assessments, we consider what the most important economic consequences are that need to be considered prior to rolling out or scaling up an intervention or policy. This includes consideration of:

• What are the most important economic consequences?
• What information is there about the total resource implications of expanding coverage and sustaining an intervention?
• Is there important uncertainty about medium to long-term economic consequences?
• Is there important uncertainty about the applicability of any reported economic consequences?

Finally, because there is often uncertainty about the effects and cost-effectiveness of interventions, we address the need for monitoring and evaluation, including consideration of:

• Is monitoring necessary?
• If monitoring is necessary, what should be measured?
• Is an impact evaluation necessary?
• If an impact evaluation is necessary, what should be evaluated and how?

For each SUPPORT Summary we consult policymakers, managers and representatives from civil society organisations in Africa, South America and Asia regarding these judgements about the relevance of the review for LMIC.