the usaid jalin project monitoring, evaluation, …

USAID JALIN MERLA PLAN, JUNE 4, 2018

1

THE USAID JALIN PROJECT MONITORING, EVALUATION, RESEARCH, LEARNING, AND ADAPTATION PLAN

June 4, 2018


1

This document is made possible by the support of the American people through the United States Agency for International Development (USAID). The contents of this document are the sole responsibility of DAI and do not necessarily reflect the views of USAID or the United States Government.


ii

TABLE OF CONTENTS

Acronyms ............................................................................................................................................... iii

Executive Summary ............................................................................................................................ 1

Context ................................................................................................................................................. 1

MERLA Approach and Project-Level Results ........................................................................ 1

Introduction ............................................................................................................................................ 3

Jalin Theory of Change and Results Framework ...................................................................... 3

Theory of Change ............................................................................................................................. 3

Results Framework .......................................................................................................................... 4

MERLA Approach ................................................................................................................................. 6

Methods for Understanding the Effectiveness of Project Management ..................... 6

Evaluating Plausible MNH Impact of Local Solutions ........................................................ 7

Approach to Assessing Systemic Change ............................................................................... 8

MERLA Implementation .................................................................................................................... 9

Planning, Managing, and Documenting How Performance Data is Collected and Used in Ongoing Activity Management ................................................................................... 9

Monitoring ....................................................................................................................................................... 9

Evaluation ....................................................................................................................................................... 10

Research ......................................................................................................................................................... 10

Learning and Adapting ............................................................................................................................... 11

Complexity-Aware Monitoring ............................................................................................................... 13

The Developmental Evaluation ............................................................................................................... 15

Intentional contemplation ......................................................................................................................... 15

Tracking Inputs and Outputs of Activities and Achievement of Outcomes over the Life of the Contract .............................................................................................................. 15

Facilitating the Flow of Information Within Jalin ............................................................. 15

Communicating learning ............................................................................................................ 16

Data Quality .................................................................................................................................... 16

Reporting .......................................................................................................................................... 18

MERLA Activities Planned for Year 1 ................................................................................... 19

Indicators and Targets..................................................................................................................... 19

Limitations of Data ....................................................................................................................... 19

Appendices ........................................................................................................................................... 20

Appendix 1. Jalin Indicator Performance Tracking Table ................................................. 21

Appendix 2: Performance Indicator Reference Sheets (PIRS) ........................................ 28

AppendIx 3. Prof Ackmal Taher’s presentation .................................................................... 63

iii USAID JALIN MERLA PLAN, JUNE 4, 2018

ACRONYMS

AIPI Akademi Ilmu Pengetahuan Indonesia (Indonesian Academy of Sciences) EMNC Every Mother and Newborn Counts GOI Government of Indonesia IPTT Indicator Performance Tracking Table KM Knowledge Management MAB Multistakeholder Advisory Body MMR Maternal Mortality Ratio M&E Monitoring and Evaluation MERLA Monitoring, Evaluation, Research, Learning, and Adaptation MNH Maternal and Newborn Health NMR Newborn Mortality Ratio PIRS Performance Indicator Reference Sheet SDG Sustainable Development Goals TAMIS Technical and Administrative Management Information System TOC Theory of Change UHC Universal Health Coverage USAID United States Agency for International Development

1 USAID JALIN MERLA PLAN, JUNE 4, 2018

EXECUTIVE SUMMARY

CONTEXT

Indonesia has enjoyed significant development and economic growth over the past 20 years. However, maternal mortality ratios remain higher in Indonesia than in most other countries in the region, and newborn mortality is unusually high for a middle-income country. New approaches are required to support Indonesia meet its health sector development goals. The stage for these new approaches has been set with strong political commitment from the Government of Indonesia (GOI) as stated in the recently issued Presidential Decree on the implementation of Sustainable Development Goals1 (SDGs) from 2017 and on the Minimum Standard of Services2 (Standar Pelayanan Minimal 2018). Recently, many policies have also been launched to realize health sector development including the Implementation of Universal Health Coverage (Jaminan Kesehatan Nasional 2014), the Healthy Indonesia Program (Program Indonesia Sehat 20153) with its three pillars and its household-approach (Program Indonesia Sehat-Pendekatan Keluarga 2016); the universal delivery care4 (Jampersal 2011) and its updated scheme since 2015; and the minimal service standard for health5 (Standar Pelayanan Minimal Bidang Kesehatan 2016).

Furthermore, economic growth in Indonesia is creating opportunities to leverage resources and technical assistance from the private sector and engage multistakeholder actors – the GOI, the private sector, and civil society – to join and strengthen the maternal and newborn health (MNH) Movement to reduce mortality and achieve national MNH SDGs.

The United States Agency for International Development (USAID) Jalin Project (hereafter referred to as “Jalin” or “the Project”) will support the MNH Movement by working with multistakeholder actors to advocate for a culture of evidence-based approaches and provide tailored technical assistance to strengthen partnerships that co-invest in sustainable and scalable MNH solutions.

MERLA APPROACH AND PROJECT-LEVEL RESULTS

Jalin’s approach to Monitoring, Evaluation, Research, Learning, and Adaptation (MERLA) is comprised of four core operating modalities:

Continued learning and adaptation informed by evidence. Evidence Utilization. Proving concepts. Leveraging impact for scale.

1 Peraturan Presiden Republik Indonesia no. 59 tahun 2017: Pelaksanaan Pencapaian Tujuan Pembangunan Berkelanjutan. 2 Peraturan Pemerintah Republik Indonesia no. 2 tahun 2018: Standar Pelayanan Minimal. 3 Keputusan Menteri Kesehatan Republik Indonesia No. HK.02.02/MENKES/52/2015: Rencana Strategis Kementerian Kesehatan Tahun 2015-2019. 4 Peraturan Menteri Kesehatan Republik Indonesia no. 61 tahun 2017: Petunjuk Teknis Penggunaan Dana Alokasi Khusus Non Fisik Bidang Kesehatan Tahun

Anggaran 2018. 5 Peraturan Menteri Kesehatan Republik Indonesia no. 43 tahun 2016: Standar Pelayanan Minimal Bidang Kesehatan.

USAID JALIN MERLA PLAN, JUNE 4, 2018 2

These four operating modalities link together to address the following medium-term (three- to five-year) outcomes:

MNH evidence disseminated through appropriate knowledge management (KM) channels; Partnerships implementing solutions or advocacy; Multistakeholder actors engaged through the partnership process; Timely, quality, need-driven technical assistance provided; and Total value of catalytic funds provided (to support the incubation and implementation of

local solutions) disaggregated by source.

Achievement of these five outcomes will result in:

Multistakeholder actors demanding and utilizing MNH evidence; Multistakeholder actors actively co-investing to improve MNH outcomes; GOI integrating MNH evidence into programming that targets the poorest and most

vulnerable; GOI and private sector providers delivering quality MNH evidence-informed programming

that reaches the poorest and most vulnerable; Communication channels using MNH evidence and priorities to increase public awareness; Multistakeholder actors adopting and influencing evidence-based system changes; and More Indonesians utilizing MNH evidence-informed clinical and non-clinical services.

Successful achievement of these outcomes will strengthen the MNH Movement in Indonesia and therefore contribute to national goals to reduce maternal and newborn mortality and catalyze investment to improve essential maternal and newborn services for the poorest and most vulnerable.

While this MERLA Plan includes approaches and metrics to measure the above objectives and goals, Jalin understands that the specific causal relationships between objectives will not always be predictable. Consequently, Jalin will use the most appropriate tools to assess and communicate progress.


INTRODUCTION

The Jalin MERLA Plan describes approaches and activities for monitoring progress against targets and using research and learning to inform adaptive management to ensure those targets are met. It serves as a management tool that:

Provides a framework for the MERLA system that will enable the systematic collection, aggregation, analysis, and process for interpretation of data that support evidence- and performance-informed decision-making;

Identifies the core indicators to be used to assess the fixed components of Jalin progress towards achieving planned results and impacts;

Describes the main data tools, sources, and methods used to collect data; Describes roles and responsibilities associated with M&E; Defines data quality assurance measures and data management procedures to provide

transparency and ensure data quality; Aligns with USAID’s strategies and processes; and Facilitates consultation and discussion with USAID, key stakeholders, and consortia

partners.

The Plan includes four major sections:

A description of the Jalin MERLA approach which describes the practices and processes that Jalin will design and implement to measure progress;

Details of how Jalin will collect, store, monitor, analyze and learn from data; The Jalin Theory of Change (TOC) and Results Framework which present expected life-of-

Project outcomes to be captured through MERLA activities; and Indicators and quarterly, annual, and life-of-Project targets organized by component and

presented in an Indicator Performance Tracking Table (IPTT) and detailed in Performance Indicator Reference Sheets (PIRS).

JALIN THEORY OF CHANGE AND RESULTS FRAMEWORK

THEORY OF CHANGE

If MNH evidence is available and compellingly communicated, and if influential multistakeholder actors are engaged and properly incentivized across the health system using market forces, then constructive and inclusive partnerships, solutions, and advocacy can flourish…and these efforts can spur an MNH Movement that contributes to reducing maternal and newborn mortality in Indonesia, specifically for the poorest and most vulnerable.

To help pave the way for those partnerships, solutions, and advocacy to thrive in a way that changes current behaviors in a sustainable way, Jalin will support: 1) institutions instrumental in generating evidence to shape policy decisions, and 2) local actors to identify ways that they can collectively improve MNH outcomes by co-investing in local solutions (inclusive of the private sector, this will mean identifying opportunities where there are MNH outcomes as well as market incentives).

To ensure systems changes are sustained Jalin will: 1) facilitate and provide technical assistance to partners and counterparts as they co-create, co-invest, and co-own local solutions during and beyond the life of the Project, 2) engage the “whole of market” have a more complete view of


MNH challenges and possible solutions that can be supported by domestic resource mobilization, and 3) adopt a collaborative approach to problem definition informed by evidence.

Jalin’s TOC is premised on several key assumptions:

There is a need and a market for robust and compelling evidence that informs decision making and galvanizes interest in and a sense of urgency around MNH;

The whole of market has an interest in and a collective willingness to support MNH solutions;

The diversity of actors, perspectives, and interests represented by the whole of market will leverage resources, ideas, networks, and partnerships that will break through barriers to progress and incentivize action beyond what USAID alone can support; and

Increased attention to MNH by existing and new actors will draw more attention to important issues, shift public perception of the severity of the crisis, and therefore change policy and behavior.

To help catalyze the MNH Movement, Jalin will:

Foster a culture of learning and adaptation; Advocate for a whole of market approach through co-creation, technical assistance, and

catalytic financing; Support local institutions to collect, analyze, use, and disseminate evidence to inform

programming, policy making, and advocacy; and Strengthen national and subnational partnerships to identify, design, invest in, implement,

and scale local MNH solutions.

RESULTS FRAMEWORK

Together with USAID, Jalin developed a Results Framework (Figure 1) that guides programming to address MNH challenges and serves as a tool to monitor, measure, and report on Project-supported achievements. Jalin will regularly assess the relevance of the Framework and revise it, as appropriate, in collaboration with USAID, Indonesian counterparts, and Social Impact (Jalin’s Developmental Evaluation partner).


Figure 1: Jalin Results Framework

Reduce Maternal and Newborn Mortality (5-10 years)

MNH Movement Takes Hold (5-10 years)

Behaviors and Processes Evolve Across Health Systems (3-5 years)

Component 1: Partnership process managed to generate, implement, evaluate, and scale successful local solutions and utilize critical evidence to result in sustainable MNH impact

Component 1.1: MNH Evidence Available and Compellingly Communicated

3-5 year metrics:

• Increased capacity of AIPI to conduct MNH knowledge management• MNH evidence disseminated (Op Eds, peer-review articles submitted for publication, policy briefs

published, evidence dissemination events held)Process Steps:• Conduct EMNC activity across selected districts

• Mobilize MNH KM Strategy with appropriate local partners• Synthesize MNH evidence from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions,

GOI, etc.)

Component 1.2: Constructive and inclusive partnerships, solutions, and advocacy developed

3-5 year metrics:

• Partnerships implementing solutions or advocacy• Multi-stakeholder actors engaged through the partnerships processProcess Steps:

• Engage influential multi-stakeholder actors• Define problem statements for co-creation efforts

• Deploy co-creation approaches to develop evidence-driven solutions and advocacy• Prioritize partnerships, solutions, advocacy for impact• Build local capacity to use a facilitative/co-creation approach

• Monitor and learn from local partnerships, solutions, and advocacy

Component 2: TA deployed effectively to support impact at scale 3-5 year metrics: • Timely, quality, need-driven TA provided

Process Steps:• Provision of specialized TA for local solutions • Provision of responsive TA to the GOI

• Monitor TA with feedback survey

Component 3: Catalytic financing efficiently disbursed to support the incubation and implementation of local solutions

3-5 year metrics:• Total value of funds provided disaggregated by source

Process Steps:• Finance local solutions

• Jalin provides financing in a timely manner

JALIN GOAL:Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to

improve essential maternal and newborn services reaching the poorest and most vulnerable

USAID Jalin Results Framework

• Multi-stakeholder actors demand and utilize MNH evidence;• Multi-stakeholder actors actively co-invest to improve MNH outcomes• GOI integrates MNH evidence into programming that targets the poorest and

most vulnerable; • GOI and private sector providers deliver quality MNH evidence-informed

programming that reaches the poorest and most vulnerable;

• Communication channels use MNH evidence and priorities to increase public awareness;

• Multi-stakeholder actors adopt and influence evidence-based system changes; • More Indonesians utilize MNH evidence-informed clinical and non-clinical

services


MERLA APPROACH

Jalin’s MERLA approach is comprised of four core operating modalities.

1) Doing MNH differently. Whole of market approach characterized by co-creation that supports co-design of and co-investment in local solutions, and co-learning that informs adaptive programming to maximize impact and potential for scale.

2) Evidence Utilization. Link co-created solutions to evidence-based TOCs that are reviewed and revised by key national and subnational stakeholders that are informed by implementation, monitoring, and learning activities, and adapted as necessary.

3) Proving concepts. Local solutions that demonstrate a plausible causal relationship to the reduction in maternal mortality ratio (MMR) and newborn mortality rates (NMR).

4) Scale for impact. Proven concepts that have potential for scale and are be attractive to investors to ensure sustainable.

Figure 2: Jalin MERLA in Action

Jalin will use evidence to facilitate co-creation and partner engagement activities to define and update MNH priorities, design and implement locally-relevant solutions, and collect and analyze learning that contributes to a foundation of knowledge for ongoing innovative programming. Jalin will manage and share knowledge with partners as they implement catalytic solutions. Through this process, Jalin will achieve its Expected Results: 1) manage partnerships which generate, implement, evaluate, and scale successful local solutions and utilize critical evidence to result in sustainable MNH impact, which has two sub-components; 2) deploy effective technical assistance to support impact at scale, and 3) to disburse catalytic financing efficiently.

In alignment with the USAID/Indonesia Country Development Cooperation Strategy 2014–2019, the MERLA Plan integrates collaborating, learning, and adapting mechanisms and an innovative co-creation methodology to monitor and evaluate Jalin’s progress and performance, align evidence generation with intentional learning, and scale promising local solutions. The Plan serves as a KM framework for the utilization of evidence collected from Project activities – such as the Evidence Summit, Every Mother and Newborn Counts (EMNC) survey, co-creation activities, implementation of local solutions – to re-evaluate and refine whole of market approaches to reduce maternal and newborn mortality in Indonesia.

METHODS FOR UNDERSTANDING THE EFFECTIVENESS OF PROJECT MANAGEMENT

USAID’s commitment to a co-creative whole of market approach requires that Jalin adopt a “fixed” and “variable” management structure to accommodate what the Project can reasonably control as fixed activities – collecting and synthesizing evidence to support co-creation of local solutions, for

Doing MNH Differently

Evidence Utilization

Defining Critical

Pathways

Proving Concepts

Demonstrating impacts on

maternal and newborn mortality

Scale for Impact

Leverage and replicate success.


example – yet remain ready to respond to opportunities that emerge through co-creation activities or targeted partnerships.

Jalin will conduct activities to address the seven outcomes listed under the heading in the Results Framework titled ‘Behaviors and Processes to Evolve Across 3-5 years’ and the metrics and processes listed in the components. Jalin will describe progress towards these outcomes in routine reporting which addresses the effectiveness of Jalin’s implementation and management. Note that Year 1 MERLA Plan indicator targets are exclusively focused on “fixed,” or known activities.

EVALUATING PLAUSIBLE MNH IMPACT OF LOCAL SOLUTIONS

The “variable” approach refers to managing, measuring, and communicating activities associated with the whole of market and targeted partnerships that implement MNH solutions and conduct advocacy campaigns. At this time, the partners, objectives, and metrics of these activities are unknown and will be elucidated later in Year 1 (described in further detail below within our approaches to addressing systemic change) and included, as appropriate, in the Year 2 MERLA Plan. Indicators associated with these “variable” activities will be designed to evaluate if solutions are leading to the achievement of results in the six Technical Focus Areas and the abovementioned four core operating modalities.

Jalin will engage key stakeholders to assess the assumptions of proposed local MNH interventions that may vary from province to province and between urban and rural areas, thus allowing for areas of inquiry through research and adaptation through implementation. The development of solution-specific TOC may include discussions with beneficiaries and key stakeholders, and reviews of research evidence supporting the TOC.1

Jalin will ensure that solution-specific TOCs clearly to improved MNH. Solution-specific assumptions must inform TOCs that reflect what is locally feasible given a range of externalities including existing human resources, infrastructure (health and otherwise), and other barriers and facilitating factors that may contribute to success. While the solution-specific TOCs outlined below describe a number of components, USAID Jalin will not require the multistakeholder partners to develop all components of the solution-specific TOCs in advance of implementation.

Jalin will use the following checklist to assess their plausible causal pathways to scale and sustainability:2

1) Is the TOC approach defined? a) Is a definition of TOC given by the authors? b) Do the authors explain their reasons for using this approach?

2) Is the TOC development process described? 3) Are the methods used to develop the solution-specific TOC, such as stakeholder meetings

and interviews, document reviews, program observation, existing conceptual frameworks or published research, described?

4) Where stakeholders are involved, is it clear how many stakeholders participated, what their role is in relation to the intervention, how they were consulted (e.g. number of interviews, focus groups, TOC workshops) and the extent to which the consultations were participatory?

5) Is the method used to compile the data into a TOC described? (including how disagreements between stakeholders were resolved)


6) Is the extent to which stakeholders were able to validate the resultant solution-specific TOC and were owners of the final product described?

7) Does the resultant solution-specific TOC (or a summary thereof) include: a) The long-term outcome or impact of the intervention; b) The anticipated short and medium-term outcomes and the process of change; c) The intervention components which happen at different stages of the pathway; d) The context of the intervention; e) Assumptions about how change would occur; and f) Additional TOC elements such as indicators, supporting research evidence,

beneficiaries, actors in the context, sphere of influence, sustainability, and timelines where relevant?

8) Is the process of intervention development from the solution-specific TOC described? a) Are the methods of how interventions were refined from the solution-specific TOC to

something which can be implemented described? (For example, further stakeholder workshops, interviews, systematic literature reviews)

9) Is the way in which the solution-specific TOC was used to develop and implement the evaluation described? a) Are evaluation research questions generated from the solution-specific TOC? b) Is the role of solution-specific TOC in the design, plan or conduct of the evaluation

clear? c) Do the supporting documents describe the extent to which the key elements described

in the solution-specific TOC were measured in the evaluation (i.e. impact, short and medium-term outcomes and the process of change, context, assumptions and the intervention)?

d) Do the supporting document describe whether and how process indicators were used to improve the quality of the intervention?

e) Is the role of the solution-specific TOC in the analysis of the results of the evaluation clear?

f) Is the role of solution-specific TOC in the interpretation of the results of the evaluation described (including the breakdown of the program theory, unanticipated outcomes and the strength and direction of causal relationships)?

APPROACH TO ASSESSING SYSTEMIC CHANGE

The GOI, notably the Ministry of Health and National Development Planning Agency, has included MNH in their five-year development goals reflecting their commitment to the Millennium Development Goals and the SDGs. In 2013, the Akademi Ilmu Pengetahuan Indonesia (Indonesian Academy of Sciences, AIPI) and the United States National Academy of Sciences evaluated the quality and consistency of data in order to inform policy.3 This has since been followed up with the USAID-funded Evidence Summit which identified priorities for maternal and newborn health and research gaps.4 While the evidence base is limited, the priorities, gaps, and recommendations can be linked to the Pathway to Survival conceptual framework.5 USAID Jalin will tie its advocacy of solutions to the public and private sectors to nationally identified and policies and priorities and link the findings from this project to the Pathway to Survival so that it can be linked to systems-level impact. Each activity of USAID Jalin will be assessed through the MERLA processes described in the following sections to determine if it is in line with national objectives and if it is leading or has potential to lead to systems-level impact with additional advocacy. When appropriate, Jalin may assist in the development of return-on-investment analyses that could be used to demonstrate value to private sector providers that may be more responsive to different incentives.


Though not explicitly a year-one MERLA activity, Jalin will review methodologies to assess and integrate the findings from the broad range of solutions expected to be implemented so that they can be categorized and prioritized for their potential impact on maternal and newborn health, if scaled. Jalin will present options for methodologies to USAID during the Project Year 2 period.

MERLA IMPLEMENTATION

PLANNING, MANAGING, AND DOCUMENTING HOW PERFORMANCE DATA IS COLLECTED AND USED IN ONGOING ACTIVITY MANAGEMENT

Led by the MERLA Director, Evidence Utilization Specialist, Knowledge Management Specialist, EMNC Specialist, and Monitoring and Evaluation (M&E) Specialist, Jalin will plan for, monitor, evaluate, research, learn, and adapt according to Project performance, including local solutions, to ensure that evidence is gathered, analyzed, and used to inform strategies, approaches, partnerships, and activities that contribute to plausible pathways to improved MNH, scalability of local solutions and sustainability of program impact.

MONITORING

Monitoring is essential for developing the evidence base for the expansive group of stakeholders that Jalin intends to work with. Using data on planning, design, service delivery, outputs, and, when possible, outcomes, Jalin will synthesize metrics and milestones to understand and report on progress at the national and subnational levels.

The performance indicators (and associated PIRS) presented in Annex I and 2 will be used to assess performance, and will include geospatial data, as appropriate. The M&E Specialist will be responsible for ensuring data is complete, accurate, and relevant, and is collected and stored securely. To do so, s/he will develop standardized data collection tools and detailed guidelines to ensure that all Jalin staff and partners understand and know how to use them. The M&E Specialist will conduct regular field visits and training sessions on a range of data quality assurance approaches and tools including, but not limited to:

In-person, paper-based, and electronic feedback forms (using tools such as SurveyMonkey) to directly engage key informants;

Standardized data collection forms to record observations will be developed and used; Standardized meeting and field-visit report forms will be developed; and

All Project data will be stored in Jalin’s Technical and Administrative Management Information System (TAMIS), a proven cost-effective online management information system that supports real-time collection and analysis of data that informs management decisions, collaboration, planning, reporting and communication. Once data is entered into TAMIS, the system automatically produces standardized summary views helping staff monitor progress. Importantly, TAMIS helps mitigate remote management challenges by allowing users in dispersed geographic locations to share data efficiently and transparently.

MNH is equally affected by the quality of health systems-related clinical care and socio-cultural factors. Economic prosperity, gender roles and women’s empowerment, human rights, and community mobilization are also extremely important causal elements.6 Recognizing this, Jalin will collect data on more distal contributing factors to provide a clearer picture of the MNH context,


writ large, in Indonesia. To do this, Jalin will work closely with USAID and Social Impact to design Complexity-Aware monitoring approaches that will help collect quality contextual data.

EVALUATION

Effective monitoring and analysis will help Jalin evaluate the relevance, effectiveness, efficiency, and sustainability of activities. Below is an illustrative list of evaluation questions that will be informed and updated by consultation with USAID, the GOI, and other partners.

Relevance: To what extent are Jalin’s objectives and methods still appropriate to the improvement of maternal and newborn outcomes?

Effectiveness: What are the major factors that have contributed to or prevented progress to date?

Efficiency: Are project resources being used efficiently or could the same results have been achieved with fewer resources or alternative approaches?

Sustainability: To what extent is the program bringing about sustainable changes? To what extent are the approaches being integrated into GOI systems, and/or have government buy-in to continue their operation beyond the life of the program? What are the key risks longer-term sustainability and what can be done to reduce these risks over the remainder of the program?

RESEARCH

While indicators and milestones will measure progress of activities against intended outputs and outcomes they will not, in the main, be as effective in revealing challenges to improving MNH and therefore in identifying opportunities for local solutions. For the latter, targeted research will be more useful. Indeed, USAID-supported programming that preceded Jalin, has already identified important evidence gaps that will inform Jalin’s research agenda.4 Additionally, needs and priorities will emerge during Jalin implementation that will inform complementary research topics for which the Project will develop and support specific research methodologies.4

Under the leadership of the MERLA Director, Jalin will work with institutes of higher education, research institutes, and experts to design and conduct studies on priority MNH topics. Jalin will also identify and work with a pool of MNH experts from which it can draw from for short-term technical expertise. Jalin’s Evidence Utilization Specialist will be responsible for establishing and keeping the pool of experts interacting creatively to ensure that they benefit from each other, are informed by evidence communicated by Jalin, and contribute, as appropriate, to co-creation activities and local solutions. S/he will also oversee all Jalin-supported research, manage technical assistance for research, as needed, and work closely with the Communication Specialist to disseminate findings to a broad audience, including Jalin staff and partners implementing local solutions. Jalin’s Communication Plan has identified activities and tools to reach its key audience through research findings when appropriate.

Jalin has a contractual obligation to publish six (6) peer-reviewed articles during the life of the Project. It is important to note that Jalin will upload all Project-related documents to the Development Experience Clearinghouse upon USAID written approval It is also important to note that Jalin will follow the highest ethical standards vis-à-vis all data collection, storage, and reporting including, but not limited to, obtaining clearance from U.S.-based and Indonesian ethical review boards, and informed consent from study participants


LEARNING AND ADAPTING

Strategic collaboration, learning, and adaptive management link together all components of Jalin to maximize achievement of expected results.7 Jalin’s learning agenda includes a set of questions consistent with the Project’s Results Framework that address critical knowledge gaps that impede informed management decisions and therefore help to 1) ensure relevance of the Project’s TOC and Results Framework, 2) foster adaptation of activities as evidence emerges, 3) identify and focus on solutions that contribute to short- and long-term priorities.

How can Jalin engage and influence multistakeholder actors to adopt evidence to create MNH change in Indonesia?

How can Jalin better synthesize and share evidence to strengthen the MNH Movement?

Jalin will use co-creation and learning from partnerships, solutions, and advocacy efforts to answer these questions and will work with local stakeholders, specifically KM partners, to package and disseminate findings appropriately to reach target audiences. In other words, Jalin will design learning approaches to ensure that knowledge gained is knowledge used to improve programming continuously, maximize and accelerate uptake, and achieve desired outcomes.

Through frequent consultation with key project partners, Jalin will better understand their evidence needs and points and therefore be able to synthesize and share research, MERLA and other data that is relevant to them. In this way Jalin will make evidence accessible and informative to the whole of market through standard reporting, infographics, slide decks, other project materials, and advocacy campaigns. USAID guidance and best practice recommends the following learning agenda:8,9

1) Set the context by asking stakeholders “how does Jalin fit into the bigger picture?”; 2) Review/clarify the TOC; 3) Develop and prioritize learning questions; 4) Plan for and implement learning activities; 5) Facilitate studies and analyses; and 6) Act on findings and share evidence.

Jalin will use the following methods, as appropriate, to implement the learning agenda and facilitate an environment for adaptive management:10-12

Conduct situational analyses of the national and subnational implementation context; Work with KM partners to conduct internal and partner group discussion sessions

focusing on solutions and lessons learned; Review performance data from local partnerships and solutions and incorporate regular

feedback loops with key stakeholders before, during, and after implementation; Conduct literature reviews relevant to local solutions; Conduct performance and impact evaluations; Share knowledge with national and subnational institutions and experts [e.g. GOI,

Multistakeholder Advisory Body (MAB), KM partners, World Bank, other USAID MNH partners – Maternal and Child Survival Project, Health Finance and Governance project];

Convene regular staff meetings to review activities and identify points of success, failure, barriers, and facilitation; and

Design and implement Complexity-Aware monitoring approaches and tools to better understand causal linkages between inputs and outcomes.


The table below provides an illustrative set of questions associated with specific Jalin activities the answers to which will inform adaptive management.

Table 1: Illustrative Questions for Activities and Learning

Activity Number

Activity Illustrative Learning Questions

NA Cross-cutting and systemic change questions

Are actors within the system changing their mindset about use of evidence? What groups does this occur for? Are actors in the system taking on new roles? If so, how are their roles changing? Why are actors taking up new roles? What can we learn from their motivations? Are there lessons for how we might incentivize or work with others to take on new roles? Are actors within the system leading more effectively on communicating evidence? How is the flow of information changing? How is the communication and/or are interactions of actors changing? Is there a presence of new or unexpected relationships? How are these forming? Are actors in the system adopting, replicating, or taking ownership of co-created solutions? Are actors within the system incorporating co-creation into their own work? What groups does this occur for? Are actors in the system taking on new roles? If so, how are their roles changing? Why are actors taking up new roles? What can we learn from their motivations? Are there lessons for how we might incentivize or work with others to take on new roles? Are actors within the system leading on the implementation of solutions? Is the flow of financial resources changing? How is the flow of information changing? Are actors organizing into new networks or teams? What are these networks and teams doing? Is there a presence of new or unexpected relationships? How are these forming? What strategies are most successful at influencing mindsets about evidence and co-creation? What patterns can be observed across groups? What can we learn about why strategies resonate with some groups but not others? What combination of learning, experiencing, and practicing is most effective? What is strengthening the connections between some actors and not others? Is there a shift in their perceptions, incentives, or something else entirely? How can this observation be used to strengthen other relationships? What aspects of the system enable the diffusion of practices? What aspects of the system impede the diffusion of practices? What is stimulating changes in financial flows? How does this feed into changes in other parts of the system? How can changes in financial flows be further incentivized? Where does the momentum for institutional change come from? Is evidence and learning being shared across the system?

1.1.1 Conduct Every Mother and Newborn Counts Across Select Districts

What is maternal and newborn mortality in select districts? How can mortality be effectively and efficiently measured to generate evidence to guide solutions?

1.1.2 Build knowledge management capacity for MNH with knowledge management partners

How are knowledge management partners engaging with the evidence to share with other stakeholders? How are stakeholders engaging with knowledge management partners to guide evidence generation, packaging, and dissemination? How can Jalin foster KM leadership and capacity of knowledge management partners as part of the MNH Movement?

1.1.3. Synthesize evidence relevant to MNH from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, Indonesian government, etc.) and global sources

How can evidence be efficiently and effectively synthesized? What does the evidence indicate to guide solution development and prioritization? What gaps remain in the evidence? How can Jalin foster addressing evidence gaps? How can evidence be packaged and disseminated to be compelling for stakeholders to understand and take action?

1.2.1. Engage influential multistakeholder actors

Who are influential MNH actors? Are potential influential stakeholders not yet engaged? How can Jalin engage stakeholders? What compels stakeholders to take and sustain MNH actions?

1.2.2. Define problem statements for co-creation efforts

What is the key evidence (see 1.1.3) to guide problem definition? Who should be involved in problem definition? What is the appropriate balance between national and sub-national problem definition? How can Jalin streamline and scale problem definition?

1.2.3. Deploy co-creation approaches to develop evidence-driven solutions and advocacy

What co-creation approaches are most effective to guide evidence-driven solutions and advocacy? What’s the right approach to introduce co-creation? Are there differences in co-creation to foster solutions vs advocacy? (NB informed by 1.2.1 and 1.2.2)

1.2.4 Prioritize partnerships, solutions, advocacy for impact

Are Jalin’s prioritization criteria effective?


Activity Number

Activity Illustrative Learning Questions

1.2.5 Build local capacity to use a facilitative/co-creation approach

How can Jalin increase not only multistakeholder actors involved in, but leading co-creation?

1.2.6 Monitor and learn from local partnerships, solutions, and advocacy

How do mini-MERLAs generate evidence? How can Jalin foster and share evidence across stakeholders, partnerships, and solutions to further the MNH Movement?

2.1 and 2.2

Provision of specialized TA for local solutions; and Provision of responsive TA to the GOI

Is Jalin TA fit to purpose? What types of TA are more effective? What types of TA are in higher demand?

2.3 Monitor TA with feedback survey

Has Jalin TA resulted in changes for partnerships, solutions, and advocacy efforts, how?

3.1 Finance local solutions What types of local solutions garner more investment? Does initial Jalin catalytic investment drive uptake or further investment?

3.2 Jalin provides financing in a timely manner

How can Jalin provide clear guidance to local partners to streamline reporting and accountability? Are there internal processes Jalin can change to facilitate timely payment?

COMPLEXITY-AWARE MONITORING

Jalin will work closely with USAID and Social Impact to develop Complexity-Aware monitoring approaches and tools to measure non-linear, difficult to quantify activity outcomes to inform programming, and better understand systems change.13 Complexity-Aware methodologies are grounded in iterative analysis of multiple qualitative and quantitative data points that help deconstruct causal input-outcome relationships in what USAID calls simple, complicated, chaotic, and complex situations. Jalin will support activities within all four categories and will use Complexity-Aware monitoring tools accordingly, including:13

1) Sentinel Indicators†; 2) Stakeholder Feedback; 3) Process Monitoring of Impacts; 4) Most Significant Change; and 5) Outcome Harvesting.

The table below identifies activities as linked to key results from the Jalin Results Framework where causal linkages are less linear, or a single methodology or measurement is inadequate and therefore requires Complexity-Aware monitoring.

† Sentinel indicators could serve as proxy indicators that communicate the “essence of the process of change affecting a broad area of interest and

which is also easily communicated”. Unfortunately, this indicator does not provide complete information and basing a judgement of progress on a sentinel indicator may lead to inaccurate conclusions.


Table 2: Activities, Results, and Challenges to Linear Causality

Activity Result Challenges to Linear Causality Activity 1.1.2 Build knowledge management capacity for MNH with knowledge management partners

Activity 1.1.3 Synthesize evidence relevant to MNH from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, GOI, etc.) and global sources

Activity 1.2.2 Define problem statements for co-creation efforts

Activity 1.2.3 Deploy co-creation approaches to develop evidence-driven solutions and advocacy

Multistakeholder actors demand and utilize MNH evidence;

Due to the diversity of actors, and to date limited understanding of how evidence is demanded and utilized, Complexity-Aware methodologies are relevant. E.g. how are MOHA authorities at local levels demanding and using evidence; how are traditional providers e.g. IBI (the midwife association) demanding and utilizing evidence, and how is the private sector (EY investments in health for example) demanding and utilizing evidence.

Activity 3.1 Finance local solutions

Multistakeholder actors actively co-invest to improve MNH outcomes

Due to the diversity of the types of partnerships and potential investments (e.g. direct investment from MOHA; access to credit or other financial facility; direct investment by foundations or the private sector in partnership solutions; or changes in BPJS policies increasing resources for services) this outcome is not linear, or easily quantified by a single indicator or measurement methodology.

Evidence generation, synthesis, and use across the activities below.

Activity 1.1.1 Conduct Every Mother and Newborn Counts Across Select Districts

Activity 1.1.2 Build knowledge management capacity for MNH with knowledge management partners

Activity 1.1.3 Synthesize evidence relevant to MNH from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, GOI, etc.) and global sources


Activity 1.2.3 Deploy co-creation approaches to develop evidence-driven solutions and advocacy

Activity 1.2.4 Prioritize partnerships, solutions, advocacy for impact

Indonesia integrates MNH evidence into programming that targets the poorest and most vulnerable. Multistakeholder actors adopt and influence evidence-based system changes. More Indonesians utilize MNH evidence-informed clinical and non-clinical services

Opportunities for integrating MNH evidence are not limited to a single type of actor or solution. Therefore, it is important to capture how MNH evidence is generated and applied from activities like the EMNC as well as other knowledge management and evidence synthesis efforts. This evidence integration could take the form of policy changes, partnership investments, etc.

Jalin will collect and enter into TAMIS all Complexity-Aware data gathered throughout the life of the Project to ensure that it contributes to and complements more traditional M&E analysis presented in Quarterly and Annual Reports, presentations, and other communication outlets.


Jalin understands that new evidence-based knowledge gained from Jalin-supported activities and those of other sources (e.g. The Health Finance and Governance Project, World Bank programming, and GOI datasets) may require revision or adaptation of the Complexity-Aware approach. As noted above, Jain will work with USAID and Social Impact to ensure that regular review and revision of approaches is responsive to new learning.

THE DEVELOPMENTAL EVALUATION

Jalin is committed to working closely with and supporting, to the extent appropriate, Social Impact as it implements the Developmental Evaluation of USAID Jalin Project in Indonesia. While the nuances of this working relationship will be determined in the second quarter of 2018 (and assessed and adapted regularly), Jalin understands that it remains responsible for all MERLA-related activities. Jalin also understands and embraces the opportunity to learn from the Developmental Evaluation as it assesses Jalin’s MERLA approach and activities, identifies opportunities for improvement, and collaborates and learns with Jalin to ensure positive MNH outcomes.

INTENTIONAL CONTEMPLATION

Jalin will schedule routine points for pause and reflection, allowing for the program team to review project goals, reassess challenges facing the project, and barriers and facilitators to change. Using Jalin’s if/then statement from the TOC and the Results Framework as a guide, the Jalin team will document learning to identify potential refinements and adjustments. For changes, the MERLA team will provide memos to the file and to the appropriate unit within Jalin to provide the background for the course correction, the agreed-to action based on evidence, timelines for the changes, and expected results.

Jalin will identify and create opportunities for pause and reflections internally as well as with partners throughout the course of the project. For example, internal after-action reviews related to major events and activities as well as Jalin annual meetings with USAID/Indonesia to pause and reflect, with the intention of course correction if required.

TRACKING INPUTS AND OUTPUTS OF ACTIVITIES AND ACHIEVEMENT OF OUTCOMES OVER THE LIFE OF THE CONTRACT

Jalin MERLA approaches require regular assessment of successes and challenges that reveal relevant and actionable opportunities for improving all aspects of Project management, including support to local solutions. The MERLA Director is responsible for ensuring the quality, utility, documentation, and shared learning of assessments – such as data analysis, document reviews, field visits, and discussions – that may direct Jalin to:16

Focus on opportunities that require smaller investments but may lead to greater impact;

Ensure that Jalin or partner staff are held accountable for action items and activities; End non- or low-performing investments; and

Recognize successes (and failures), effective partnerships, or compelling advocacy.

FACILITATING THE FLOW OF INFORMATION WITHIN JALIN


Through frequent consultation, Jalin will identify areas of particular interest to key project stakeholders to ensure that we synthesize data from M&E and research relevant to them. As Jalin aims to use its knowledge to feed into the Indonesian MNH Movement, the M&E and research data must be accessible and informative to a wide audience, ranging from academics, government staff, the media, and the population at large. To do this there must also be clear communication within the Jalin team as well to be sure all members of staff have access to and understanding of the data in order to use and share it appropriately.

The MERLA Director will have overall responsibility for sharing information on a routine basis both within the Jalin team and to external stakeholders. Following consultation with Jalin senior staff, the MERLA Director will consider the following sharing mechanisms:

Email groups for sharing specific information; Using the Microsoft Teams platform to create discussion groups; Holding routine meetings to share findings and elicit feedback; and Other methods as appropriate.

The Evidence Utilization Specialist and the Knowledge Management Specialist will each have the responsibility to consider the above-mentioned and other tools to share information internal to the project and externally to other partners. In addition, the MERLA team will connect through other technical and administrative teams in Jalin to expand dissemination of information.

COMMUNICATING LEARNING

The communication of learning will be informed by the KM Strategy and Communications Strategy documents that are still in process and being informed by to-be-completed Evidence Summit Assessment and Scoping activity that was conducted in collaboration with USAID/Washington. Jalin will use the KM Strategy and Communication/Dissemination Plan to provide the guidelines for internal and external learning activities.

DATA QUALITY

The MERLA Director will conduct monthly reviews of all M&E data to ensure completeness, accuracy, and relevance to Jalin and local solutions goals and objectives. The Director will also conduct spot-checks remotely via phone or Skype, and in situ during field visits to Jalin Regional Offices, and partner offices and events. For spot-checks, data collected for specific, pre-determined indicators (and the documents supporting the data) will be thoroughly reviewed using tailored assessment tools. Findings from the monthly reviews and spot-checks will be consolidated and reported to ensure it informs management decisions. Note that all salient data quality review results will also be included and regular reporting to USAID, Social Impact, and others, as appropriate.

Jalin will also support an external Data Quality Assessment as directed by USAID. However, it is DAI Global, LLC (DAI) best practice to secure the services of an M&E expert through the Home Office to conduct a comprehensive review of all data management policies, processes, and activities no later than the end of Project Year 2. Jalin therefore plans to and has budgeted for this assistance to take place during the first half of 2019. The process for this DAI-led review is presented below.


Note that data quality procedures and more details on data collection will be included in the Data Management Plan.

Table 3: DQA Processes

DQA Process Steps Actions 1. Prepare the DQA team.

Identify members of Jalin staff that will conduct field-level DQAs; Train staff for collecting data using standard forms;

2. Develop the approach and schedule

Prepare the calendar for DQAs;

The MERLA Director and MERLA Specialist will provide guidance on the objectives and process to those involved in DQAs;

3. Identify the indicators to be included in the review

Conduct DQAs on all core indicators for USAID;

Conduct DQAs on indicators with suspected issues;

Conduct DQAs on indicators for important areas;

4. Categorize indicators

Categorize indicators into outcome and output indicators and develop DQA tools that assess the data collection systems for both;

5. Conduct staff meetings to review DQAs

The MERLA Director and the MERLA Specialist will explain the purpose and process for conducting the DQA, explain the standards for each indicator, and identify issues that require follow-up or special attention;

6. Schedule DQA sessions with implementing partners

Have discussions with local partners on the DQA process and collect information from them on the data and potential issues;

7. Complete the DQA checklist for each indicator

To what extent does the data collected meet the standards of: o Validity o Integrity o Precision o Reliability o Timeliness

Does data collection process align with indicator definition(s)?

Is data appropriately transferred from the field to first level of aggregation, second level and so forth?

Does a random sample of data collected centrally align with that found in the field office?

8. Debrief on main findings to implementing partner office

Clarify any outstanding issues

Provide initial verbal report back on key findings of DQA

9. Write up DQA report, recommendations and action points for improvement

Identify all areas that need attention

Make clear and actionable recommendations

Agree a timeline with implementing partner for implementation of recommendations


REPORTING

However, the two reports below delineate two ways we will regularly consolidate and report on data collected from project activities:

Jalin will report regularly to USAID, the GOI and others, as appropriate to ensure learning associated with progress towards supporting the MNH Movement, national or subnational systems change, new evidence generated and synthesized, effective partnerships, and promising local solutions.

Quarterly Reports document progress against the Work Plan and performance indicators. Staff contributions to Quarterly Reports will be sent to the MERLA Director two weeks after the end of each quarter.

Annual Reports review the Project’s yearly progress and highlight achievements, summarizing the information already captured in Quarterly Reports, including measurement of progress against Work Plan activities and performance indicator targets, as well as lessons learned and best practices identified. Staff contributions to Quarterly Reports will be sent to the MERLA Director two weeks after the end of the Work Plan year.

All Jalin reports submitted to USAID will be in accordance with contract requirements, adhere to Jalin’s Branding Implementation and Marking Plan, and will contain at a minimum:

1) Summary of progress on activities against deliverables and/or completion thereof, (with specific mention of gender-related results, if possible);

2) Performance indicator results; 3) Activity location data (submitted twice annually as part of 2nd Quarterly Progress Report

and the Annual Progress Report); 4) The status of resolving problems described in previous report; 5) New problems encountered since previous report; 6) Any other developments or events which have the potential to significantly affect the

performance or progress toward targets; 7) Proposed solutions to outstanding and new problems; 8) Plans for the next quarter, including international travel plan in accordance with USAID

Acquisition Regulation 752.7032; 9) Success stories to highlight Jalin’s impact; 10) At least 15 high-resolution photos that visually convey the story of the project’s activities

and impact; and 11) A copy of publications and media produced over the quarter including papers, studies,

reports, marketing materials and information products used to showcase the project’s work (fact sheets, videos, info graphics, etc.) and any other note-worthy materials developed with Jalin.


MERLA ACTIVITIES PLANNED FOR YEAR 1

Key cross-cutting MERLA processes for Year 1 will focus on developing data collection, evidence synthesis, KM, and internal and external learning systems. Planned activities fall largely under Component 1.1: MNH Evidence Compellingly Communicated and Component 1.2: Constructive and inclusive partnerships, solutions, and advocacy developed.

INDICATORS AND TARGETS

A detailed description of indicators determined in collaboration with USAID and derived from the Results Framework are listed in Appendix 1. Specific disaggregation (including sex) and baseline estimates (if available), and quarterly, annual, and life-of-Program targets for each indicator are presented in the IPTT. Jalin understands that these targets will very likely change as the Project implements and learns from research and local solutions. Noe that because co-creation processes that will determine details of local solutions have not been conducted to date, associated indicators and targets are not yet included in this Plan. As soon as local solutions have been designed and approved by USAID, Jalin will update the Results Framework and IPTT.

LIMITATIONS OF DATA

This MERLA Plan is intended to ensure that data collected informs the development of national and subnational Jalin-supported activities, notably local solutions. However, indicator data may not fully reflect the diversity of approaches and activities that contribute to improved MNH. While Jalin activities will be designed to support evidence-based design, implementation, and monitoring of local solutions that, if scaled and sustained, may plausibly reduce mortality, Jalin cannot predict which combination of partnerships and activities, whether Jalin-supported or not, will result in positive MNH outcomes. Attribution of impact will be a MERLA and reporting challenge throughout implementation and therefore Jalin will work closely with USAID and Social Impact to design and adapt MERLA approaches and tools to ensure accurate attribution data is collected and informs transparent reporting to all stakeholders.

Table 4: Key MERLA Activities

Activity Output 2018 Timeline Finalize MERLA Plan Final and approved MERLA Plan April Finalize Data Management Plan Final and approved Data Management

Plan April

Develop data collection forms and organization of online and offline databases for MERLA using TAMIS and other tools

Data forms developed; databases developed

January–June

Develop and finalize data quality assessment tools Data quality assessment tools created June Draft a research plan with clearly identified research priorities guided by evidence.

Research plan developed July–September

Develop data-sharing agreement templates for Jalin and local partners to use

Data-sharing template created By end of May

Develop and implement a training program for Jalin staff to understand the overall JALIN MERLA Plan.

Training program developed Completed by mid-June

Develop plan for data sharing across Jalin working areas to facilitate communication and encourage adoption of best practices

Plan developed July–September


APPENDICES


APPENDIX 1. JALIN INDICATOR PERFORMANCE TRACKING TABLE

Jalin # USAID # Indicators Type Data Disaggregated Sources of data (BL; annually)

Baseline Year 1 Year 2 Year 3 Year 4 Year 5

Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn services reaching the poorest and most vulnerable

High Level (HL)-1

Maternal Mortality Ratio

Impact Age National Data Sources

HL-1.1 Maternal Mortality as reported in EMNC Studies

Impact Age and District EMNC Studies

HL- 2 Neonatal Mortality Rate

Impact Sex National Data Sources

HL-2.1 Neonatal Mortality as reported in the EMNC Studies

Impact Sex and District EMNC Studies

MNH Movement Takes Hold

Behaviors and Processes Evolve Across Health Systems

HL-3 STIR-11 Number of innovations supported through USG assistance with demonstrated uptake by the public and/or private sector

Outcome Sector; Technical Focus Area; Province

Program Documents

0 12


Component 1: Partnership process managed to generate, implement, evaluate, and scale successful local solutions and utilize critical evidence to result in sustainable MNH impact

Component 1.1: MNH Evidence Available and Compellingly Communicated

1.1. STIR-12 Number of peer-reviewed scientific publications resulting from USG support to research and implementation programs

Outcome Journal Publication

0 2 2 1

Activity 1.1.1 Conduct EMNC activity across selected districts

1.1.1.a EMNC Activity conducted

Milestone Province, District Program Documents.

0 2.5 5 2

1.1.1.b EMNC results reported and communicated

Milestone Province, District, media type

Program Documents.

0 Yes Yes Yes Yes Yes

Activity 1.1.2 Build Knowledge Management capacity for MNH (knowledge management partners)

1.1.2.a Assessment of AIPI Evidence Summit

Milestone Assessment Report

Yes

1.1.2.b MNH KM Strategy in Place (updated every 24 months)

Milestone KM Strategy Yes

Activity 1.1.3 Synthesize MNH evidence from Indonesia (USAID MNH portfolio, Jalin partnerships & solutions, GOI, etc.)

1.1.3.a MNH evidence disseminated (Op Eds, peer-review articles submitted for publication, policy briefs published, evidence dissemination events held) (Note 1.1 is a subset of 1.1.3.a)

Output Publication or Event Type; Technical Focus Area; Province

Program Documents

0 8 12 12 12 12


1.1.3.b Synthesize latest MNH Evidence from Evidence Summit, GOI evidence, Jalin lessons (see component 1.2); other USAID MNH partners. Goes into annual report and slide deck of Evidence Driven Communications Materials updated semi-annually.

Milestone Technical Focus Areas

Program Document

Yes Yes Yes Yes Yes

1.1.3.c MNH evidence slide deck available (updated semi-annually based on synthesis) for use in co-creation, design, and TA

Milestone Technical Focus Areas

Program Documents

Yes Yes Yes Yes Yes

Component 1.2: Constructive and inclusive partnerships, solutions, and advocacy developed

1.2 Partnerships implementing solutions or advocacy

Output District; Technical Focus Area Solution

Program Documents

0 12


Activity 1.2.1 Engage influential multistakeholder actors for MNH through Partnership (includes MAB, targeted outreach, and identification of provincial participants for co-creation workshops).

1.2.1.a New multistakeholder actors engaged and participating in partnerships process

Output District, Sector represented (e.g. civil society, private or public sector, etc.); Individuals (by sex) vs Organizations/Entities

Program Documents

0 225 150 150 150 150

1.2.1.b Events and targeted outreach held to share evidence (Activity 1.1.3) and engage multistakeholder actors

Output Partnership Engagement Type (e.g. MAB, targeted outreach, provincial outreach), Sector represented (e.g. civil society, private or public sector, etc.), Individuals (by sex) vs Organizations/Entities

10 13 13 13 13


1.2.2.a Problem statements defined

Milestone Province; Technical Focus Area

Program Documents

0 12 12 12 12

Activity 1.2.3 Deploy co-creation approaches to develop evidence-driven solutions and advocacy (inclusive of targeted partnerships as well as workshop model)

1.2.3.a Co-creation events held

Output Province Program Documents

0 8 10 10 10 5

1.2.3.b Co-creation design sessions via targeted partnerships and outreach

Output Technical Focus Area Program Documents

0 5 5 5 5 5

1.2.3.c Solutions or advocacy initiatives identified as a result of co-creation events or targeted outreach

Output Technical Focus Area; Province

Program Documents

0 5 5 5 5 5


Activity 1.2.4 Prioritize partnerships, solutions, advocacy for impact

1.2.4.a STIR-10 (a and b)

Number of innovations (solutions) supported through USG assistance

Output Province; Technical Focus Area(s); New/Ongoing; Type of USG Support

Program Documents

6 12

1.2.4.b Partnerships receiving local funding beyond Jalin

Outcome Province; Technical Focus Area(s); Type of Organization Receiving Support; Type of Organization Providing Support (GOI, private Sector); Proportion of non-Jalin Support

Implementation Plans

12

1.2.4.c DR.4.2-2 Number of civil society organizations (CSOs) receiving USG assistance engaged in advocacy interventions

Output Province; Technical Focus Area(s);

Program Documents

4 6 6 6

Activity 1.2.5 Build local capacity to use a facilitative/co-creation approach

1.2.5.a MAB meetings held quarterly

Milestone Date of Event, Sex of Participants; Sector Represented

MAB Meeting Agenda and Minutes

4 4 4 4 3

Activity 1.2.6 Monitor and learn from local partnerships, solutions, and advocacy

1.2.6.a Partnerships implementing local solutions with Mini-MELAs** and Technical Assistance plans in place.

Output Geographic Zone (e.g. Province or District), and Technical Focus Area(s)

Implementation Plans

6 12 12 12 12

1.2.6.b Number of local solutions/innovations documented with a pathway for scale and sustainability.


Program Documents

0 4 8 12 8


Activity 1.2.7 Package local solutions for adaptation/replication, investment, and scale (won’t start until year 2)

1.2.7.a Number of local solutions/innovations packaged with how-to guides, or mentoring plans to ease adaptation/replication and scale.


Program Documents

3 6 8 6

Component 2: TA deployed effectively to support impact at scale

Activity 2.1 Provision of specialized TA for local solutions; and Activity 2.2 Provision of responsive TA to the GOI

2.1.a; 2.2.a Number of technical assistance requests (from: partnership plans, grants, GOI support requests, etc.) fulfilled by Jalin

Output Geographic Zone (e.g. Province or District), Technical Focus Area; Multistakeholder Type (Private Sector, GOI, CSO, etc.)

Program Documents

8 12 12 12 8

2.1.b; 2.2.b; USAID Health Leadership -1

Number of Universal Health Coverage (UHC) areas supported by USG investment

Output UHC Category (essential health services; quality; financial protection);

Program Documents

3 3 3 3 3

Activity 2.3 Monitor TA with feedback survey

2.3.a

Percentage of TA with positive feedback

Output Geographic Zone (e.g. Province or District), Technical Focus Area; Multi-stakeholder Type (Private Sector, GOI, CSO, etc.)

Feedback Survey

85% 90% 90% 90% 90%


Component 3: Catalytic financing efficiently disbursed to support the incubation and implementation of local solutions

3.1 Total value of USG GUC provided


Grant Agreements and Reports

Discuss with USAID

Activity 3.1 Jalin provides catalytic financing to local solutions in a timely manner

3.1.a Number of grants for catalytic financing provided


Grant Agreements and Reports

Discuss with USAID

Activity 3.2 Jalin funding is provided in a timely manner

3.2.a

Percentage of local solutions requiring GUC funding where funds disbursed in a timely manner


Grant Financial Monitoring

0 100% 100% 100% 100% 100%


APPENDIX 2: PERFORMANCE INDICATOR REFERENCE SHEETS (PIRS)

USAID Performance Indicator Reference Sheet

Number and Name of Indicator: HL-1 Maternal Mortality Ratio

Name of result measured: Jalin Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn health services reaching the poorest and most vulnerable.

Is this a Performance Plan and Report indicator? No

DESCRIPTION

Precise Definition(s): The maternal mortality ratio is the number of maternal deaths per 100,000 live births.

Maternal death is the death of a woman while pregnant or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, from any cause related to or aggravated by the pregnancy or its management but not from accidental or incidental causes.

Live birth refers to the complete expulsion or extraction from its mother of a product of conception, irrespective of the duration of the pregnancy, which, after such separation, breathes or shows any other evidence of life - e.g. beating of the heart, pulsation of the umbilical cord or definite movement of voluntary muscles - whether or not the umbilical cord has been cut or the placenta is attached. Each product of such a birth is considered live born.

Unit of Measure: Number

Disaggregated by: Age and parity, location (urban/rural, major regions/provinces), and socio-economic characteristics (e.g. education level, wealth quintile)

Rationale or Justification for indicator (optional): The goal of Jalin is contribute to national goals of reducing maternal and neonatal mortality in Indonesia. Reducing maternal mortality is also a Sustainable Development goal. This is a context indicator and Jalin will not be able to affect this indicator through implementation. .

PLAN FOR DATA COLLECTION

Data Source: Vital registration, health service records, household surveys, census. The data point will be the Maternal Mortality Ratio agreed to by the Ministry of Health.

Method of data collection and construction: Jalin will use national sources to determine this data.

Reporting Frequency: Annual

Individual(s) responsible at Jalin: Evidence Utilization Specialist

DATA QUALITY ISSUES

Dates of Previous Data Quality Assessments and name of reviewer: N/A

Date of Future Data Quality Assessments (optional): No data quality assessment specifically will be conducted for this indicator although Jalin will identify any data quality issues concerning national maternal mortality figures.

Known Data Limitations: This data is available at the national level and has very large confidence intervals.

TARGETS AND BASELINE

Baseline timeframe (optional):

Rationale for Targets (optional):

CHANGES TO INDICATOR

Changes to indicator: N/A

Other Notes (optional):

THIS SHEET LAST UPDATED ON: 04/27/2018



Name of Indicator: HL-1.1 Maternal Mortality as reported in EMNC Studies



DESCRIPTION

Precise Definition(s): The maternal mortality ratio is the number of maternal deaths per 100,000 live births.

Maternal death is the death of a woman while pregnant or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, from any cause related to or aggravated by the pregnancy or its management but not from accidental or incidental causes.


The EMNC studies will complement national level data by providing evidence to construct causal pathways for maternal and newborn mortality in Indonesia and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale. The EMNC requires methods that provide: (i) the most complete enumeration possible of maternal and neonatal deaths in each study district; (ii) data for determination of the most likely causes of all identified cases of maternal death, and a sample of neonatal deaths, via verbal autopsy; (iii) data for development of causal pathways for maternal and neonatal mortality based on behavioral, social, and health-system factors as collected in a social autopsy.


Disaggregated by: Province (district), age, cause of maternal death

Rationale or Justification for indicator (optional): Maternal mortality remains stubbornly high in Indonesia. This indicator will document causes of maternal death with greater accuracy than other studies, providing a basis for developing effective solutions.


Data Source: EMNC study reports

Method of data collection and construction: The EMNC data will be collected through the verbal and social autopsies conducted in at least one district in each target province.


Individual(s) responsible at Jalin: Every Mother and Newborn Counts Specialist

DATA QUALITY ISSUES


Date of Future Data Quality Assessments (optional): TBD

Known Data Limitations: As the data collected will provide information on relative and not absolute determinants for mortality for one district per province, Jalin will have to ensure that data from the EMNC studies is synthesized appropriately to avoid misinterpretation or over generalization.










Number and Name of Indicator: HL-2 Neonatal Mortality Rate

Name of result measured: Jalin Goal: Contribute to national goals to reduce maternal and newborn mortality and provide catalytic support to improve essential maternal and newborn health services reaching the poorest and most vulnerable


DESCRIPTION

Precise Definition(s): The neonatal mortality rate is the number of deaths during the first 28 completed days of life per 1,000 live births in a given year or period. Neonatal deaths may be subdivided into early neonatal deaths, occurring during the first seven days of life, and late neonatal deaths, occurring after the seventh day but before the 28 completed days of life.



Disaggregated by: Cause of death

Rationale or Justification for indicator (optional): The goal of Jalin is contribute to national goals of reducing maternal and neonatal mortality in Indonesia. Reducing maternal mortality is also a Sustainable Development goal. This is a context indicator.


Data Source: Vital registration, health service records, household surveys, census

Method of data collection and construction: Jalin will use national sources for this data. The data point will be the Neonatal Mortality Rate agreed to by the Ministry of Health.


Individual(s) responsible at Jalin: MERLA Director

DATA QUALITY ISSUES


Date of Future Data Quality Assessments (optional): No data quality assessment specifically will be conducted although Jalin will identify any data quality issues concerning national neonatal mortality figures.

Known Data Limitations: This data is available at the national level and has very large confidence intervals.










Number and Name of Indicator: HL-2.1 Neonatal Mortality as reported in the EMNC Studies



DESCRIPTION

Precise Definition(s): The neonatal mortality rate is the number of deaths during the first 28 completed days of life per 1,000 live births in a given year or period. Neonatal deaths may be subdivided into early neonatal deaths, occurring during the first seven days of life, and late neonatal deaths, occurring after the seventh day but before the 28 completed days of life.


The EMNC studies will complement national level data by providing evidence to construct causal pathways for maternal and newborn mortality in Indonesia and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale. The EMNC requires methods that provide: (i) the most complete enumeration possible of maternal and neonatal deaths in each study district; (ii) data for determination of the most likely causes of all identified cases of maternal death, and a sample of neonatal deaths, via verbal autopsy; (iii) data for development of causal pathways for maternal and neonatal mortality based on behavioral, social, and health-system factors as collected in a social autopsy.


Disaggregated by: Province (district), sex of mother, sex of newborn, cause of death

Rationale or Justification for indicator (optional): Neonatal mortality in Indonesia is unusually high for a middle-income country. This indicator will document causes of newborn death with greater accuracy than other studies, providing a basis for developing effective solutions.


Data Source: EMNC study reports

Method of data collection and construction: The EMNC data will be collected through the verbal and social autopsies conducted in the target provinces.


Individual(s) responsible at Jalin: Every Mother and Newborn Counts Specialist

DATA QUALITY ISSUES



Known Data Limitations: As the data collected will provide information on relative and not absolute determinants for mortality for one district per province, Jalin will have to ensure that data from the EMNC studies is synthesized appropriately to avoid misinterpretation or overgeneralization.









USAID Performance Indicator Reference Sheet Number and Name of indicator: Jalin HL-3; STIR-11 Number of innovations (solutions)supported through USG assistance with demonstrated uptake by the public and/or private sector

Name of result measured: Behaviors and Processes Evolve Across Health Systems


DESCRIPTION

Precise Definition(s): This indicator counts the subset of innovations reported through Jalin 1.2.4.a that have demonstrated uptake at any point during the reporting period (including those whose uptake is ongoing). For the definition of ‘innovations supported through USG assistance’, please see the indicator reference sheet for Jalin 1.2.4.a. By using the results of Jalin HL-3 as the numerator and Jalin 1.2.4.a as the denominator (within but not across reporting periods), Jalin may calculate the percentage of innovations supported that have been adopted by the public and/or private sector.

• ‘Demonstrated uptake’ includes any support for, or adoption by, the public and/or private sectors at any point during the reporting period.

• The public sector includes: Non-Governmental Organizations, Higher Education Institutions, Recipient Country Governments (including any department, office, subdivision, or other entity within the national or sub-national government of the country where the innovation is supported), and other organizations that are part of the public sector but not included in the categories above.

• The private sector includes: Private organizations (including businesses and corporations; business, industry and trade associations; corporate foundations; social enterprises; financial institutions, investors, and impact investors), Private Philanthropy (including private foundations and philanthropists), and other organizations that are part of the private sector but not included in the categories above.

• Blended adoption includes uptake by both the public and private sectors. This could be simultaneous uptake by both, or separate uptake by each, during a reporting period.

• Examples of demonstrated uptake include:

o Procurement or other financial support provided through public, private, or public-private agreements (i.e. non-revenue monies from non-donor sources), including - but not limited to - private investments, grants, loans, funds, or government bonds

o Regulatory approval or incorporation/institutionalization into a host country government’s national or sub-national guidelines, policies, or other legal frameworks (e.g. Essential Medicines List, Patient Safety Framework)

o Market introduction (e.g. a product developed/supported by USAID is offered for sale, and providers trained, through the public or private sectors)

o Distribution or delivery of an innovation or service to an end-user via the public and/or private sectors, such as distribution by community health workers or agricultural extension agents


Disaggregated by: Province, Sector (Public or Private) technical focus area

Rationale or Justification for indicator (optional): This indicator is a proxy for potential sustained demand for the solution beyond Jalin support and indicates potential for impact at scale.


Data Source: Jalin reporting matrix

Method of data collection and construction: Jalin will maintain a list of innovations all throughout the working areas.


Individual(s) responsible at Jalin: Partnerships Director and Regional Teams

DATA QUALITY ISSUES




Known Data Limitations:

Data for this indicator should not be cumulated over multiple years

As the indicator is purposefully defined broadly to ensure that the full range of uptake modalities can be captured, no assumptions should be made regarding comparability of the level or type of uptake across innovations, nor regarding the value or depth of support for, the public and/or private sectors for any innovation.










Number and Name of indicator: Jalin 1.1; STIR 12 Number of peer-reviewed scientific publications resulting from USG support to research and implementation programs

Name of result measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated


DESCRIPTION

Precise Definition(s): This output indicator captures annually the number of scientific publications resulting from USAID support to research and implementation programs. This indicator is NOT cumulative and captures only new publications not reported previously.

‘Peer-reviewed publications’ are defined as and include: scientific studies published in technical journals which conduct technical peer review of the submissions as part of their decision process; technical reports that are subject to external peer-review and then disseminated; and peer-reviewed conference proceedings.


Disaggregated by: N/A

Rationale or Justification for indicator (optional): The evidence made available through Jalin support will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.



Method of data collection and construction: Jalin will collaborate with the knowledge management partners and University of Indonesia to track and confirm all such publications and presentations



DATA QUALITY ISSUES



Known Data Limitations: There is a possibility of duplication, for example publication of the similar data in papers targeting the similar audiences, or in presentations to professional meetings.










Name of Indicator: Jalin 1.1.1.a EMNC Activity conducted



DESCRIPTION

Precise definitions:

The Every Mother and Newborn Counts activity has the potential to generate critical evidence across Jalin’s technical focus areas as well as contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality in Indonesia, and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale. The University of Indonesia will oversee all field level data collection efforts, analysis, and reporting. A detailed design document will be submitted to USAID for approval by the end of April 2018.

The EMNC activity refers to the verbal and social autopsies conducted for maternal and newborn deaths in selected districts. The EMNC activity will be considered to be conducted if the verbal and social autopsy has been completed, the data has been reviewed and cleaned, and the report has been drafted.


Disaggregated by: Province (district)

Rationale or Justification for indicator (optional): Jalin intends to increase quality data and ensure its utilization in programming. The EMNC studies are one set of quality data that can be used.



Method of data collection and construction: Jalin will maintain a master file that covers the EMNC activity that will be updated routinely.


Individual(s) responsible at Jalin: The Every Mother and Newborn Counts Specialist

DATA QUALITY ISSUES



Known Data Limitations: None anticipated.










Number and Name of Indicator: Jalin 1.1.1.b EMNC results reported and communicated



DESCRIPTION

The Every Mother and Newborn Counts activity has the potential to generate critical evidence across Jalin’s technical focus areas as well as contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality in Indonesia, and inform priorities for innovation, policy and program actions to reduce maternal and newborn mortality at scale.

Once the data from the EMNC activity has been completed, Jalin will use the information for project activity purposes.

Reported is defined as the EMNC activity report is shared with either the national Ministry of Health or subnational units, other government bodies, at academic forums, or to other stakeholders.


Disaggregated by: Classification of stakeholder, Province (district), format (report, presentation).

Rationale or Justification for indicator (optional): Jalin intends to increase quality data and ensure its utilization in programming. The EMNC studies are one set of quality data that can be used.



Method of data collection and construction: Jalin will maintain a master file of the dissemination strategy for the EMNC study.



DATA QUALITY ISSUES



Known Data Limitations: There is a possibility of duplication, for example similar reporting and communication activities might be attempted in multiple provinces.










Number and Name of Indicator: Jalin 1.1.2.a Assessment of AIPI Evidence Summit



DESCRIPTION

Jalin will work to strengthen the knowledge management culture and capacity for maternal and newborn health in Indonesia, at the national and sub-national levels, building on the Evidence Summit and other recent activities. Jalin will build on the Evidence Summit and USAID’s investments with AIPI to support and strengthen AIPI as a national MNH knowledge management leader. In April and May, Jalin will conduct an Assessment and Scoping of AIPI. Following the assessment, ‘priority actions’ will be identified that will form the basis for the working relationship between Jalin and AIPI. This activity will be considered complete when the draft ‘priority actions’ are prepared and presented to the AIPI President, the head of the AIPI Medical Commission, or the Secretary General of AIPI.

Unit of Measure: This is a milestone and the Jalin Annual Report and he Assessment Report will form the basis for a “yes” response.

Disaggregated by: Not applicable

Rationale or Justification for indicator (optional): Successful completion of this exercise will feed into the Evidence Driven Slide Deck and strengthen the empirical foundation for partnerships and solutions.



Method of data collection and construction: Jalin will maintain a draft of the ‘priority actions’ and evidence that they have been communicated to the key stakeholders.


Individual(s) responsible at Jalin: Knowledge Management Specialist

DATA QUALITY ISSUES













Name of Indicator: Jalin 1.1.2.b MNH KM strategy in place



DESCRIPTION

In April and May 2018, Jalin will facilitate an Assessment and Scoping of AIPI. At the end of this Assessment and Scoping, ‘priority actions’ will be identified that will serve as the basis for the knowledge management capacity development strategy. A key component of Jalin’s knowledge management strategy at the start of the project is facilitating the sharing of information through knowledge management partners.

The KM strategy will be the combination of the knowledge management partners capacity development strategy and plan and the plan and activities for other knowledge management-related disseminations that Jalin will facilitate. UASID Jalin will update the document every two years.

Unit of Measure: This is a milestone and the Jalin Annual Report and Knowledge Management Strategy will form the basis for a “yes” response.


Rationale or Justification for indicator (optional): The Knowledge Management Strategy is an important tool in support of Jalin’s work to strengthen knowledge management capacity and culture in Indonesia.



Method of data collection and construction: Jalin will maintain a master file of innovations including project plans and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis. The KM plan will be updated every two years,


Individual(s) responsible at Jalin: Knowledge Management Specialist

DATA QUALITY ISSUES



Known Data Limitations: None known at this time







THIS SHEET LAST UPDATED ON: 05/30//2018



Name of Indicator: Jalin 1.1.3.a MNH evidence disseminated



DESCRIPTION

Precise Definition(s): “Evidence” means the available body of facts or information indicating whether a belief or proposition is true or valid. The evidence will be related to MNH but does not have to be generated by Jalin itself.

“Disseminated” means that such information has been shared beyond USAID/Jalin (by Jalin or a Jalin partner at a Jalin-facilitated event) including but not limited to Government of Indonesia officials at all levels, public and private sector health facilities and their staffs, professional and academic institutions, civil society organizations from national to community level, the media, business enterprises, and the general public. Illustrative means of dissemination include peer-reviewed articles submitted for publication, policy briefs, public and private sector events and meetings, press releases, presentations in academic and professional settings, business roundtables, and civil society events.


Disaggregated by: Type of publication or event, technical focus area, province

Rationale or Justification for indicator (optional): The evidence made available through this effort will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.



Method of data collection and construction: Jalin will maintain a master file of all events, presentations and publications including date and time, location, audience, agenda, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.



DATA QUALITY ISSUES



Known Data Limitations: There is a possibility of duplication, for example publication of the same data in papers targeting the same audience, or in presentations to professional meetings.










Name of Indicator: Jalin 1.1.3.b Latest MNH evidence synthesized



DESCRIPTION

Precise Definition(s): “Synthesis” refers to a report of the results of the included studies and should discuss the reasons for differences among studies such as methodological elements.18 Jalin will collect evidence (defined as the available body of facts or information indicating whether a belief or proposition is true or valid) from multiple sources, including: Every Mother and Newborn Counts and other Jalin supported data collection efforts; Government of Indonesia data; academic research; USAID MNH partner reporting; and other development partners. The synthesized evidence will be assessed against its fit to the Pathway to Survival, the Jalin Technical Focus Areas, and organized for the specific audience to whom the synthesized evidence will be shared.5

Unit of Measure: This is a milestone and the Jalin Annual Report and Evidence Driven Slide Deck will form the basis for a “yes” response.




Data Source: Multiple data sources, including newly disseminated information from non-Jalin sources, information from Jalin supported MERLA activities, independent research, GOI data and statistics, and data from development partners.

Method of data collection and construction: Jalin will collaborate with the Indonesian Academy of Sciences and other key evidence partners to conduct the synthesis and develop the body of evidence in the form of an Evidence Driven Slide Deck to be updated twice yearly.



DATA QUALITY ISSUES



Known Data Limitations: The fact that the data have been synthesized is not necessarily an indicator of their quality.










Name of Indicator: Jalin 1.1.3.c MNH evidence slide deck available for use in co-creation, design, and TA



DESCRIPTION

Precise Definition(s): Jalin will collect evidence (defined as the available body of facts or information indicating whether a belief or proposition is true or valid) from multiple sources, including: Every Mother and Newborn Counts and other Jalin supported data collection efforts; Government of Indonesia data; academic research; USAID MNH partner reporting; and other development partners. Jalin will present the evidence in the form of a slide deck. Available means that the slide deck is open source and accessible to multistakeholder actors through meetings, consultations, presentations and electronic dissemination.

Unit of Measure: This is a milestone and well-documented wide distribution of the Evidence Driven Slide Deck will form the basis for a “yes” response.




Data Source: Jalin quarterly and annual reports

Method of data collection and construction: Jalin will collaborate with the Indonesian Academy of Sciences to analyze data from multiple sources and develop the Evidence Driven Slide Deck to be updated twice yearly. Jalin will develop a matrix to catalogue the activities/events undertaken to ensure availability of the data.



DATA QUALITY ISSUES



Known Data Limitations: The indicator speaks to the availability of data/evidence but cannot confirm its utilization.










Number and Name of Indicator: Jalin 1.2 Partnerships implementing solutions or advocacy

Name of Result Measured: Jalin 1.1: MNH Evidence Available and Compellingly Communicated


DESCRIPTION

Precise Definition(s): For Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal—e.g., two actors agreeing to collaborate around a common event—or more formal, with a memorandum of understanding and established governance procedures.

Jalin will only count toward “Jalin Partnership” targets within our MERLA Plan those partnerships with structured initiatives and roles for co-creation, co-investment, implementation, and learning from local solutions.

Specific advocacy initiatives will be identified as partnerships are established. “Solutions” are answers to problems – those interventions that are judged most likely to deliver substantive improvements in maternal and newborn health outcomes in Indonesia. To be counted against this indicator the partnership must have implementation, financial, technical assistance and monitoring, evaluation, learning and adaptation plans in place with plans for sustainability and scale and an indication of how, if scaled, could plausibly improve maternal or newborn health, either on its own or in concert with other interventions.


Disaggregated by: District and technical focus area

Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed.


Data Source: Jalin quarterly and annual reports, memoranda of understanding and other partnership agreement documents

Method of data collection and construction: Partnerships will emerge from co-creation workshops and outreach overseen by Jalin’s Partnerships Director. Jalin will maintain a file of the implementation, financial, TA and MELA plans for each partnership.


Individual(s) responsible at Jalin: Partnerships Director and MERLA Director

DATA QUALITY ISSUES



Known Data Limitations: Simply reporting the number of partnerships does not accommodate an evaluation of their success.










Name of Indicator: Jalin 1.2 Partnerships implementing solutions or advocacy

Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed


DESCRIPTION

Precise Definition(s): Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal, such as two actors agreeing to collaborate around a formal event, or more formal, with a memorandum of understanding and established governance procedures. Specific advocacy initiatives will be identified as partnerships are established. “Solutions” are answers to problems – those interventions that are judged most likely to deliver substantive improvements in maternal and newborn health outcomes in Indonesia. To be counted against this indicator the partnership must have implementation, financial, technical assistance and monitoring, evaluation, learning and adaptation plans in place.


Disaggregated by: District, sector (civil society, public sector, private sector etc.), sex (for individuals)

Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed. New partners will bring new ideas to the table and potentially provide effective solutions.


Data Source: Jalin quarterly and annual reports, partnership agreements

Method of data collection and construction: Jalin will establish and maintain a sortable database of all individuals and organizations that play a role within a structured initiative. Data will be drawn from partnership agreements and implementation plans.


Individual(s) responsible at Jalin: Regional Managers and Partnerships Director

DATA QUALITY ISSUES













Number and Name of Indicator: 1.2.1.a New multistakeholder actors engaged and participating in partnerships process



DESCRIPTION

Precise Definition(s): “Actors” include individuals, organizations and institutions. Actors can be drawn from public and private health sectors, other public-sector entities, enterprises and corporations, civil society individuals and organizations, media, academic institutions, foundations, charitable institutions and others. Jalin will only include structured partnership initiatives with roles for co-creation, co-investments, and learning from local solutions which will define engaged and participating. “New” refers to individuals and organizations not previously engaged in a partnership with Jalin. Any individual or organization may be counted only once for this indicator even if they are involved in multiple partnerships.


Disaggregated by: District, sector (civil society, public sector, private sector etc.), sex (for individuals)

Rationale or Justification for indicator (optional): Partnership and “co-creation” of solutions are at the heart of Jalin and are the means through which preventable causes of neonatal and maternal mortality will be addressed. New partners will bring new ideas to the table and potentially provide effective solutions.


Data Source: Jalin quarterly and annual reports, partnership agreements

Method of data collection and construction: Jalin will establish and maintain a sortable database of all individuals and organizations that play a role within a structured initiative. Data will be drawn from partnership agreements and implementation plans.


Individual(s) responsible at Jalin: Regional Managers and Partnerships Director

DATA QUALITY ISSUES













Name of Indicator: 1.2.1.b Events and targeted outreach held to share evidence and engage multistakeholder actors



DESCRIPTION

Precise Definition(s): “Evidence” means the available body of facts or information indicating whether a belief or proposition is true or valid. Events and targeted outreach may include policy briefs, public and private sector events and meetings, press releases, presentations in academic and professional settings, business roundtables, and civil society events. “Multistakeholder Actors: The term actor includes individuals, organizations, and institutions. To strengthen the MNH Movement with cultural change around the generation and use of evidence to improve MNH outcomes across Indonesia, we need to engage traditional health actors across the health system, as well as nontraditional actors. In the context of Jalin, these could include actors (broadly defined per above) from the public or private health sectors, other public-sector actors, private corporations or other for-profit entities with interests related to healthcare or improved MNH outcomes, civil society, media, academia, and potentially others. The geographic areas of interest among these stakeholders may also be diverse, ranging from national and subnational/provincial to community or household levels. Multistakeholder actors reflect the “whole-of-market” approach that is at the heart of the Jalin Theory of Change.

Engaged means that the actor participates in the process by: providing funding, providing technical input, providing access to facilities or populations, or other factor that could advance the process.

“Targeted outreach” is a directed communication activity towards an actor that can include: event, speech, campaign, document, media-related activity, and other intervention that can fall within communication.


Disaggregated by: Event disaggregated by partnership Engagement Type (e.g. MAB, targeted outreach, provincial outreach), Sector represented (e.g. civil society, private or public sector, etc.),

Rationale or Justification for indicator (optional): The evidence made available through such events will contribute to a more nuanced understanding of causal pathways for maternal and newborn mortality and inform priorities for actions that will contribute to mortality reductions.



Method of data collection and construction: Jalin will maintain a master file of all events, presentations and outreach including date and time, location, audience, agenda, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.


Individual(s) responsible at Jalin: Evidence Utilization Advisor and MERLA Director

DATA QUALITY ISSUES













Name of Indicator: Jalin 1.2.2.a Problem statements defined



DESCRIPTION

Problem statements are the foundation of the co-creation process. A problem statement is a concise description of an issue to be addressed or a condition to be improved. Problems identified will be prioritized according to criteria of plausible improvement to MNH outcomes, opportunity for scale, and potential for co-investment.

Problem statements will be developed based on local evidence through a multi-stage process of consultation, definition, refinement, prioritization and market analysis.


Disaggregated by: Technical focus area, province

Rationale or Justification for indicator (optional): This milestone highlights Jalin’s commitment to partnership, co-creation and local solutions.


Data Source: Compilation of data from stakeholder consultations, targeted meetings at provincial level, and MAB deliberations

Method of data collection and construction: Jalin will maintain a master file of problem statements, updated quarterly to capture changes and prioritization.



DATA QUALITY ISSUES



Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces. If the problem is identified and prioritized in more than one location I would not call it duplication in the same way that reporting the same data to the same audience is.










Name of Indicator: Jalin 1.2.3.a Co-creation events held



DESCRIPTION

Co-Creation: Jalin will adopt an ethos of co-creation. This fundamentally means that we will collaborate with diverse

stakeholders to share design, decision making, investment, and ownership of solutions. Beginning with problem definition informed by evidence and continuing to solution implementation, co-creation cuts across how Jalin operates. Workshops are Jalin facilitated event in which stakeholders come together to work together to develop a solution to improve maternal and newborn health. Targeted outreach refers to a non-workshop setting in which a solution may be discussed between stakeholders.





Data Source: For each event, a standard report will be completed indicating attendance, problem statement, and solution presented.

Method of data collection and construction: Jalin will maintain a master file of events disaggregated by province and type of event, to be updated quarterly.



DATA QUALITY ISSUES



Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces.










Number and Name of Indicator: Jalin 1.2.3.b Co-creation design sessions via targeted partnerships and outreach



DESCRIPTION

Co-Creation: Jalin will adopt an ethos of co-creation. This fundamentally means that we will collaborate with diverse stakeholders to share design, decision making, investment, and ownership of solutions. Beginning with problem definition informed by evidence and continuing to solution implementation, co-creation cuts across how Jalin operates. Co-creation is not limited to a single format of a multistakeholder workshop to generate ideas, but is integral to Jalin’s approach to partnership, technical assistance, and catalytic funding to deliver solutions for sustainable and scalable impact.

Partnerships: For Jalin, partnerships broadly refer to voluntary multistakeholder actor initiatives structured to contribute to reduce maternal and newborn mortality in Indonesia. Partnerships can be informal—e.g., two actors agreeing to collaborate around a common event—or more formal, with a memorandum of understanding and established governance procedures.







Method of data collection and construction: Jalin will maintain a master file of innovations including project plans and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.



DATA QUALITY ISSUES



Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces., but this is not a negative—just a factor to consider during data analysis.










Name of Indicator: Jalin 1.2.3.c Solutions or advocacy initiatives identified as a result of co-creation events or targeted outreach



DESCRIPTION

Definition: A solution is a technical approach that has been co-created by stakeholders in Jalin-supported areas that is proposed to address a maternal or newborn health issue. Advocacy refers to public support for or recommendation of a particular cause or policy related to MNH. The solutions and advocacy initiative counted against this indicator will be generated as a result of Jalin-supported interventions.






Method of data collection and construction: Jalin will maintain a master file of solutions and targeted outreach that will be updated on a monthly basis.



DATA QUALITY ISSUES



Known Data Limitations: There is a possibility of duplication, for example similar innovations might be attempted in multiple provinces.










Number and Name of Indicator: Jalin 1.2.4.a; STIR 10 (a and b): Number of innovations (solutions) supported through USG assistance

Name of result measured: Jalin 1.2: Constructive and Inclusive Partnerships, Solutions and Advocacy Developed Behaviors and Processes Evolve Across Health Systems


DESCRIPTION

Precise Definition(s): ‘Innovations’ are products, processes, tools, approaches, service delivery models, and/or other interventions (broadly defined) that have the potential to achieve significant (not incremental) improvements in development outcomes versus existing alternatives and are intended to improve the lives of ultimate beneficiaries. Here, innovations are defined not by their novelty, but by their potential to achieve significant improvements in development outcomes versus existing alternatives.

• An innovation can be said to have ‘the potential to achieve significant improvements in development outcomes versus existing alternatives’ if a robust TOC linking the innovation to such outcomes can be articulated. The Theory of Change should be supported by evidence of the potential benefits of the innovation versus existing alternatives, and it should be tested and refined throughout the development of the innovation to ultimately substantiate this claim (i.e. rigorously demonstrate the innovation’s potential versus existing alternatives).

• Ultimate beneficiaries are host country individuals, especially the socially and economically disadvantaged, who are beneficiaries of USAID assistance and whose participation is essential to achieving sustainable development results.

• Support through USG assistance includes human, financial, or institutional resources to support, in full or in part, the discovery, research, development, testing, or implementation of innovations.


Data Type: Integer (minimum: 0, maximum: NA)


Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions – solutions – to improve maternal and newborn health that could plausibly reduce mortality if scaled. For Jalin, “solution” and “innovation” are synonymous.



Method of data collection and construction: Jalin will maintain a master file of innovations including project plans and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.



DATA QUALITY ISSUES













Number and Name of Indicator: 1.2.4.b. Partnerships receiving local funding beyond Jalin

Name of result measured: 1.2 Constructive and Inclusive Partnerships, Solutions and Advocacy Developed


DESCRIPTION

Precise Definition(s): This indicator counts the number of partnerships that receive funding from sources other than Jalin. Jalin is not a small grants program and Jalin financial support will be provided as a secondary resource. All sources of co-investment will be rigorously documented.




Disaggregated by: Province, technical focus area, type of recipient organization, type of funding entity, proportion of non-Jalin support

Rationale or Justification for indicator (optional): Key principles of Jalin include co-investment and local ownership. This indicator speaks to those principles.


Data Source: Partnership financial reports and budgets

Method of data collection and construction: Each partnership will have a financial plan documenting the resources required for implementation and the sources of those funds. Partnerships receiving Jalin catalytic funding will submit expenditure reports using templates developed by Jalin. The Partnerships Office will provide oversight.


Individual(s) responsible at Jalin: Regional Managers, Partnerships Team

DATA QUALITY ISSUES



Known Data Limitations: Partners may have an interest in either inflating or concealing the amount of non-Jalin support they receive.










Name of Indicator: Jalin 1.2.4.c Number of civil society organizations (CSOs) receiving USG assistance engaged in advocacy interventions

Name of result measured: Jalin 1.2: Constructive and inclusive partnerships, solutions and advocacy developed


DESCRIPTION

Precise Definition(s): Counts the number of CSOs receiving assistance to initiate or participate in advocacy interventions. Advocacy is a means for individuals, organizations or constituencies to shape public agendas, change public policies, or influence other processes that affect their lives. Advocacy is a series of strategic, interconnected, integrated activities designed to achieve a goal. Advocacy may include lobbying, public interest litigation, letter writing campaigns, information-sharing with target audiences and individuals, and similar activities. For Jalin advocacy will be specifically focused on issues relating to MNH.



Rationale or Justification for indicator (optional): Civil society organization broadly represent the interests of citizens and are key building blocks of Jalin multistakeholder partnerships. Their voices must be heard and recognized in order to shape effective solutions.



Method of data collection and construction: Jalin will maintain a master file of civil society organizations actively engaged in advocacy initiatives and data on these efforts, including project plans and associated documents, data, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.



DATA QUALITY ISSUES



Known Data Limitations: As a simple count of organizations, does not speak to the effectiveness of advocacy conducted.










Number and Name of Indicator: Jalin 1.2.5.a MAB meetings held quarterly



DESCRIPTION

Stakeholder engagement initially focused on engaging the Multistakeholder Advisory Body and is continuing more broadly at the national and sub-national levels. Jalin is continuing to engage with the Chair and Co-Chair to define the scope and clarify the agenda. In addition to the quarterly meetings described in the table below there is ongoing consultation around key priorities (e.g. co-definition, Jalin’s Communications Plan, etc.) via WhatsApp, phone calls, meetings, and other engagement mechanisms. The MAB is a group that has been convened by Jalin.


Disaggregated by: NA

Rationale or Justification for indicator (optional): Jalin’s overarching Theory of Change includes engaging influential multistakeholder actors.



Method of data collection and construction: Jalin will collect MAB meeting agendas, minutes, and other related documents from the MAB meetings. and summarize the data in a matrix to be updated on a quarterly basis.


Individual(s) responsible at Jalin: Partnerships Director

DATA QUALITY ISSUES



Known Data Limitations: None anticipated at this time.


Baseline timeframe (optional): 0








Number and Name of Indicator: Jalin 1.2.6.a Partnerships implementing local solutions with Mini-MERLAs and Technical Assistance plans in place

Name of result measured: Jalin 1. 2: Constructive and inclusive partnerships, solutions and advocacy developed


DESCRIPTION


Jalin will only count toward “Jalin Partnership” targets within our MERLA Plan those partnerships with structured initiatives and roles for co-creation, co-investment, implementation, and learning from local solutions. Specifically, the MAB meets the broader definition of partnership, but would not count towards Jalin Partnership Targets; however, if Jalin were able to establish an initiative with Perhimpunan Rumah Sakit Seluruh Indonesia—the Association of Indonesian Hospitals—around support to scale up utilization of the JKN, this would be an example of a Jalin Partnership for the purpose of targets and monitoring.

A local solution is derived from the co-creation process in which a solution (a technical approach that has been co-created by stakeholders in Jalin-supported areas that is proposed to address a maternal or newborn health issue).

A mini MERLA is a monitoring, evaluation, research, learning, and adaptation plan that is specific to the local solution. Implementing means that the local solution is being conducted.

Inclusive: Inclusive in the context of the Theory of Change reflects Jalin’s overall goal of reaching the poorest and most vulnerable.


Disaggregated by: Technical focus area, province (district).

Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. The intervention must have a plan for metrics and technical support to ensure that it can be assessed and that it is given as much support as possible to ensure success.



Method of data collection and construction: Jalin will maintain a master file of local solutions including project plans, mini-MERLAs and associated documents, date, and/or written materials and summarize the data in a matrix to be updated on a quarterly basis.



DATA QUALITY ISSUES













Number and Name of Indicator: 1.2.6.b Number of local solutions/innovations documented with a pathway for scale and sustainability



DESCRIPTION

Precise Definition(s):

Jalin will use three criteria to prioritize partnerships: potential to improve maternal and neonatal health outcomes; opportunity to scale through expansion or replication; potential for co-investment. Jalin will monitor and learn from local partnerships and solutions through Partnership Officers embedded at the provincial level.

Solution and innovation are used interchangeably and are defined as products, processes, tools, approaches, service delivery models, and/or other interventions (broadly defined) that have the potential to achieve significant (not incremental) improvements in development outcomes versus existing alternatives and are intended to improve the lives of ultimate beneficiaries. • Sustainability may be demonstrated by continuity, institutionalization, and/or financial commitment. Scale refers to expansion or replication of an intervention, institutionalization through systemic change, diversification, or diffusion.

Documented means that the innovation has written information that refers to scale or sustainability along the criteria presented above.


Disaggregated by: Geographic area, technical focus area

Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. The interventions must also have some consideration for scale and sustainability.



Method of data collection and construction: Partnership Officers will work hand in hand with each partnership and document evidence and learning. I am not clear on what criteria will be used to establish that a partnership is on a pathway to scale and sustainability.


Individual(s) responsible at Jalin: Partnership Officers

DATA QUALITY ISSUES



Known Data Limitations: This could be very subjective until the solution has actually proven itself.










Number and Name of Indicator: 1.2.7.a. Number of local solutions/innovations documented with how-to guides or mentoring plans to ease adaptation/replication and scale



DESCRIPTION

Precise Definition(s): This indicator counts the number of partnerships that understand the factors underlying their success and have the capacity to translate this understanding into actions that other partnerships can build on.

Solution and innovation are used interchangeably and are defined as products, processes, tools, approaches, service delivery models, and/or other interventions (broadly defined) that have the potential to achieve significant (not incremental) improvements in development outcomes versus existing alternatives and are intended to improve the lives of ultimate beneficiaries. • Sustainability may be demonstrated by continuity, institutionalization, and/or financial commitment. Scale refers to expansion or replication of an intervention, institutionalization through systemic change, diversification, or diffusion.

In order to be counted against this indicator the partner(s) must develop and present written material in the form of a manual, mentoring plan, PowerPoint presentation or other written/graphic material.


Disaggregated by: Geographic zone, technical focus area

Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. The interventions must also have some consideration for scale and sustainability.



Method of data collection and construction: Partnership Officers will work hand in hand with each partnership to document evidence and learning. Data will be drawn from the manuals, guides and/or PowerPoints that the partners submit.


Individual(s) responsible at Jalin: Partnerships Officers

DATA QUALITY ISSUES













Name of Indicator: .2.1.a; 2.2 a Number of technical assistance requests fulfilled by Jalin

Name of result measured: Jalin 2.l: Provision of specialized TA for local solutions


DESCRIPTION

Precise Definition(s): This indicator is a simple count of the number of TA requests met by Jalin. Each Jalin multistakeholder partnership will develop a technical assistance plan at inception. The TA will be targeted to ensure that successful approaches can be identified, replicated and scaled up. TA will also build on local capacity and be targeted to foster local ownership and co-financing.


Disaggregated by: Province, technical focus area, multistakeholder type

Rationale or Justification for indicator (optional): Jalin is to facilitate improvements in maternal and newborn health the provision of targeted technical assistance could provide that support.



Method of data collection and construction: Multistakeholder TA plans, written and oral reports and briefings from TA providers, Jalin TA monitoring templates


Individual(s) responsible at Jalin: Technical staff and Partnerships Officers

DATA QUALITY ISSUES



Known Data Limitations: As a simple count, does not address the quality of the TA provided.










Number and Name of Indicator: Jalin 2.2a:1.b; 2.2.b.; USAID Health Leadership -1 Number of Universal Health Coverage (UHC) areas supported by USG investment

Name of result measured: Jalin 2: TA Deployed Effectively to Support Impact at Scale


DESCRIPTION

UHC is defined as all people obtain the health services they need – prevention, promotion, treatment, rehabilitation and palliation – without risk of financial ruin or impoverishment, now and in the future. This means that there are five areas of UHC which comprised of: a) essential package of health services based on country health needs; b) assuring quality of health services; c) access to safe, effective, quality, and affordable essential medicines and vaccines; d) instituting financial risk protection interventions; e) tracking health expenditure, especially out of pocket expenditure through national or system of health account (NHA or SHA), which also provide information on financial protection interventions.

To assess whether the country is moving towards UHC, all five areas need to be addressed. Therefore, we want to measure how many areas of the UHC are supported by the USG. Thus, the number range is 0-5, where zero indicating no support and five indicating support to all five areas:

• Technical assistance (TA) provided in strengthening the essential package of health services (0=No, 1=Yes)

• TA provided for improving quality of health services (0=No, 1=Yes)

• TA provided to strengthen pharmaceutical system and making safe, quality and affordable medicines and vaccine available, reducing adverse reactions and antimicrobial resistance (0=No, 1=Yes)

• TA provided in financial risk protection* (0=No, 1=Yes)

• Health accounts data collection in process or completed using SHA 2011 method (0=No, 1=Yes)


Disaggregated by: UHC category

Rationale or Justification for indicator (optional): This indicator provides the foundation for measuring progress on the achievement of Universal Health Coverage, leading to better health outcomes and improved health status.


Data Source: TA reports

Method of data collection and construction: Multistakeholder TA plans, written and oral reports and briefings from TA providers, Jalin TA monitoring templates



DATA QUALITY ISSUES













Number and Name of Indicator: Jalin 2.3.a Percentage of TA with positive feedback

Name of result measured: Jalin 2: TA Deployed Effectively to Support Impact at Scale


DESCRIPTION

Precise Definition(s): This indicator is a proxy for the quality of the technical assistance Jalin provides to the GOI and multistakeholder partnerships. Jalin will develop a survey instrument using a Likert scale to gauge recipients’ satisfaction with the TA provided to them.

Unit of Measure: Percentage

Disaggregated by: Geographic area, technical focus area, multistakeholder type

Rationale or Justification for indicator (optional): Jalin is to facilitate improvements in maternal and newborn health the provision of targeted technical assistance could provide that support.


Data Source: Survey of TA recipients

Method of data collection and construction: Jalin will develop a simple survey tool utilizing a Likert scale and administer it to all recipients of Jalin-funded TA. The numerator will be the results from the respondents that responded, and the denominator will be the number of total respondents.



DATA QUALITY ISSUES












USAID Performance Indicator Reference Sheet:

Name of Indicator: Jalin 3.1 Total value of USG GUC provided

Name of result measured: Jalin 3: Catalytic Financing Disbursed to Support the Incubation and Implementation of Local Solutions


DESCRIPTION

As a last resort, Jalin may provide catalytic financing for local solutions that promise to be transformative in the form of GUCs. Jalin will track and report the total funding provided in USD and IDR.

Unit of Measure: Dollar and rupiah value

Disaggregated by: Technical Focus Area

Rationale or Justification for indicator (optional): Catalytic financing through Jalin for promising solutions has the potential to accelerate uptake and scaling.


Data Source: Jalin financial reports

Method of data collection and construction: Jalin will maintain a database of funding provided and quarterly reconciliation of accounts

Reporting Frequency: Quarterly

Individual(s) responsible at Jalin: Deputy Chief of Party

DATA QUALITY ISSUES













Name of Indicator: Jalin 3.1.a Number of grants for catalytic financing provided

Name of result measured: Jalin 3: Catalytic financing efficiently disbursed to support the incubation and implementation of local solutions


DESCRIPTION

As part of catalytic financing, Jalin will, as a last resort, provide catalytic financing for local solutions. This indicator counts the number of these local solutions that Jalin is funding.



Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. Funding can increase the likelihood of success.



Method of data collection and construction: Jalin will maintain a master file of grants awarded.

Reporting Frequency: Quarterly


DATA QUALITY ISSUES













Number and Name of Indicator: Jalin 3.2.a Percentage of local solutions requiring GUC funding where funds disbursed in a timely manner

Name of result measured: 3: Catalytic financing provided to support the incubation and implementation of local solutions


DESCRIPTION

“Timely” disbursement of GUC funds means that funds are disbursed from Jalin to the solution within three months of the time requested Numerator: Number of local solutions receiving funds within three months of the request for funding. Denominator: Number of solutions receiving catalytic financing from Jalin.

Unit of Measure: Percentage

Disaggregated by: Province; Technical Focus Area

Rationale or Justification for indicator (optional): The core of Jalin is to facilitate the implementation of interventions to improve maternal and newborn health that could plausibly reduce mortality if scaled. Catalytic funding through GUC can increase the likelihood of success.


Data Source: Jalin financial reports

Method of data collection and construction: Jalin will maintain a master file of that includes information on grants disbursed.



DATA QUALITY ISSUES





Baseline timeframe (optional): 0







APPENDIX 3. PROF ACKMAL TAHER’S PRESENTATION

(Attached separately)


References 1. Vogel I. Review of the use of ‘Theory of Change’in international development. UK: Department

for International Development (DFID) 2012. 2. Breuer E, Lee L, De Silva M, Lund C. Using theory of change to design and evaluate public

health interventions: a systematic review. Implementation Science 2015; 11(1): 63. 3. Council NR. Reducing Maternal and Neonatal Mortality in Indonesia: Saving Lives, Saving the

Future: National Academies Press; 2013. 4. Taher AY, Irawan. Evidence-Informed Policy Making on Reducing Maternal and Neonatal

Mortality in Indonesia June 2016 – March 2018. 2018. 5. Kalter HD, Salgado R, Babille M, Koffi AK, Black RE. Social autopsy for maternal and child

deaths: a comprehensive literature review to examine the concept and the development of the method. Population health metrics 2011; 9(1): 45.

6. Filippi V, Ronsmans C, Campbell OM, et al. Maternal health in poor countries: the broader context and a call for action. The Lancet 2006; 368(9546): 1535-41.

7. USAID. USAID Program Cycle Overview. 2012. 8. USAID. Establishing A Learning Agenda. 2017. 9. USAID. Defining a Learning Agenda. 2017. 10. USAID. Activity Monitoring, Evaluation, & Learning Plan Guidance Document. 2017. 11. Garvin DA, Edmondson AC, Gino F. Is yours a learning organization? Harvard business review

2008; 86(3): 109. 12. Ramalingam B. Tools for knowledge and learning: A guide for development and humanitarian

organizations: Overseas Development Institute London; 2006. 13. USAID. Program Cycle Guidance--Discussion Note: Complexity-Aware Monitoring, 2016. 14. Dozois E, Blanchet-Cohen N, Langlois M. DE 201: A practitioner's guide to developmental

evaluation: International Institute for Child Rights and Development, University of Victoria; 2010.

15. Patton MQ. EVALUATION for theWay We Work. 16. Kirschner PA, Hendricks M, Paas F, Wopereis I, Cordewener B. Determinants for Failure and

Success of Innovation Projects: The Road to Sustainable Educational Innovation. Association for Educational Communications and Technology 2004.

17. Westreich D. From exposures to population interventions: pregnancy and response to HIV therapy. American Journal of Epidemiology 2014; 179(7): 797-806.

18. Tricco ACL, E.V.; Straus, S.E Rapid Reviews to Strengthen Health Policy and Systems: A Practical Gudie, World Health Organization, 2017.