Project: 2020 DIAL 1.0 Endline Evaluation

The Digital Impact Alliance (DIAL) was established in 2016 to advance digital inclusion for everyone, everywhere and to overcome the systemic barriers preventing digital solutions from going to scale. Limestone Analytics conducted a comprehensive evaluation to assess the overall impact of DIAL’s first strategy, covering October 2016 through December 2020 and its programs on the digital ecosystem.

The purpose of the evaluation was to understand the impact and effectiveness of DIAL throughout its work for the first several years of implementation. In addition, it provided recommendations for the DIAL’s new Digital Beacons strategy.

The evaluation was based on a wide-ranging document review and the insights of over 70 key informant interviews (KIIs) and focus group participants. The study included both theory-based and performance components, which were implemented using mixed methods, including outcome harvesting, market systems analysis, and value for money analysis.

Limestone used four evaluation questions to design the research framework:

  1. What changes have occurred in the digital ecosystem since October 2016 and since the start of the 2020 COVID-19 pandemic?
  2. Which of these areas is a direct or indirect result of DIAL’s work?
  3. Which of DIAL’s interventions has been most effective in creating these changes?
  4. What can DIAL learn or adopt from these experiences as it moves into a new strategy?

The final evaluation report presented the following recommendations:

  • DIAL to remain sector-neutral but incorporate market perspectives and enhance relationships with organizations extending the basic building blocks of digital inclusion, including digital financial services and digital ID.
  • DIAL to continue to address the challenges in the digital ecosystem that have been exacerbated by the COVID-19 pandemic, including the digital divide and data security and privacy.
  • DIAL to continue to engage donors and offer a platform for greater exchange beyond the Digital Donors Anonymous (DDA).

Clients / Partners

Timeline

Fall

2020

Project Inception and Data Collection
  • Drafted inception report including evaluation matrix, data collection instruments and protocols; Compiled a list of key informants to interview; interviewed over 70 key informants and facilitated two focus group discussions
Winter

2020-2021

Analysis and Reporting
  • Applied mixed methods to analyze the KII and FGD qualitative data along with quantitative budgetar and website analytics data; drafted and delivered the final evaluation report highlighting key findings and recommendations.