{"id":20420,"date":"2018-03-28T14:40:17","date_gmt":"2018-03-28T18:40:17","guid":{"rendered":"http:\/\/www.globalintegrity.org\/?p=20124"},"modified":"2018-12-13T23:00:25","modified_gmt":"2018-12-13T21:00:25","slug":"how-to-make-monitoring-evaluation-and-learning-work-for-complex-change","status":"publish","type":"post","link":"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/","title":{"rendered":"How to make monitoring, evaluation, and learning work for complex change"},"content":{"rendered":"

March 28, 2018<\/p>\n

Michael Moses<\/em>, Director of Learning and Programs<\/p>\n


\n

***This post was originally published by New Philanthropy Capital (NPC)<\/a> on March 26, 2018***<\/em><\/p>\n


\n

To tackle complex, systemic problems you need a plan: enter\u00a0theory of change<\/a>\u00a0(ToC). But like any plan, a theory of change must be reviewed and adapted as new information comes to light, the situation changes or assumptions are questioned.<\/strong><\/p>\n

The challenges that the development sector tries to address are complex and systemic. And governance challenges – like the ones we tackle at\u00a0Global Integrity<\/a>\u00a0\u2013 are particularly confounding.<\/p>\n

The challenges the communities we work with face are unique, so generalised solutions developed outside of those communities, in other contexts,\u00a0will be of limited use<\/a>\u00a0to those trying to solve local problems.<\/p>\n

Instead, solutions that effectively address the issues which local people care about tend to emerge\u00a0over time<\/a>, in particular places and led by\u00a0local stakeholders<\/a>. Success is contingent on these people engaging with, learning about, and shaping the dynamics of the complex, political systems in their specific contexts.<\/p>\n

Developing a\u00a0theory of change<\/a>\u00a0is an essential first step to this. A ToC helps make assumptions explicit, lays out an\u00a0evidence-based hypothesis\u00a0<\/a>about how change is expected to occur, and provides\u00a0a frame<\/a>\u00a0for reflection and course corrections throughout a project or program.<\/p>\n

This latter point is key. As NPC\u2019s recent report on\u00a0systemic use of theories of change<\/a>\u00a0states: \u2018The word \u2018theory\u2019 in its name is no coincidence. Theories are tested and updated as new knowledge emerges<\/p>\n

Effective use of a ToC, requires collecting, and reflecting on, data needed for learning and adaptation.<\/p>\n

The specific design of any approach to monitoring, evaluation and learning (MEL) will vary according to the theory of change it serves, and the context in which it\u2019s used. But three general principles are worth keeping in mind when pursuing change in complex systems.<\/p>\n

    \n
  1. Emphasize (local) action.<\/strong><\/li>\n<\/ol>\n

    Monitoring data\/evidence aims must be useful to local stakeholders. Whether it helps them interrogate their assumptions; track progress; or consider how to adapt in response to emergent information, understanding opportunities for impact is the key. Reporting to donors is a secondary priority.<\/p>\n

    For example, in Global Integrity\u2019s recent\u00a0Learning to Make All Voices Count<\/a>\u00a0project, we worked with civil society organizations in five countries to explore whether progress expected in their theories of was unfolding as expected.<\/p>\n

    When it wasn\u2019t, we helped our partners use evidence to adapt their strategies.<\/p>\n

    In another case, our partners in Tanzania had initially thought that, if they provided community members with information about a national open government policy, citizens would respond by trying to hold local officials to account for honouring those policy commitments.<\/p>\n

    Initial monitoring data, perhaps unsurprisingly, did not bear out this assumption. Instead, local power dynamics – rather than access to information about government policy \u2013 were found to be the issue. So our partners adapted their theory of change, and set to work helping young people and women mobilise into \u201cpeople\u2019s committees\u201d to reshape those dynamics. See this case story<\/a>\u00a0for more.<\/p>\n

      \n
    1. Support\u00a0participation.<\/strong><\/li>\n<\/ol>\n

      A good monitoring, evaluation and learning framework is not developed solely by MEL staff, or by people sitting in offices in places that are geographically or culturally far-away. Rather, they are co-created and used in partnership with local stakeholders and beneficiaries, with their perspectives, priorities, and interests baked into the design and application.<\/p>\n

      For example, our colleagues in the Philippines co-created their MEL framework with regional universities and regional civil society organisations. In doing so, they learned that local partners were most interested in improving their capacity to understand and use district-level budget data. So determining whether and how the project was helping this, became a priority.<\/p>\n

      As a result, our partners to realized that some of the training tools they initially used weren\u2019t having the intended effects. They made course corrections to the assumptions and activities underpinning that aspect of their theory of change. More details are available in\u00a0this case study<\/a>.<\/p>\n

        \n
      1. Embrace\u00a0iteration.<\/strong><\/li>\n<\/ol>\n

        This means that data is gathered regularly, in as close to real-time is as feasible, rather than only at beginning, middle and end of a project. Regular data collection becomes the fuel for regular reflection, and adaptation.<\/p>\n

        In Kenya, our partners recognized that their work in two counties was subject to a number of potential risks, from drought to ethnic conflict. So they made sure to regularly revisit, and analyze, those potential risks. And when conflict did break out, our partners were ready – they quickly identified the danger, and worked with local stakeholders to temporarily replace planned in-person community meetings with virtual discussions over WhatsApp.<\/p>\n

        This key change not only kept project participants safe until the violence died down, but helped keep the project on track amid challenging circumstances. More information is available here.<\/a><\/p>\n

        Ingraining these principles of action, participation, and iteration into your monitoring, evaluation and learning isn\u2019t easy. It requires time, resources, and buy-in – from donors, implementers, and partners.<\/p>\n

        But it can pay off! It helps organisations unlock the usefulness of theories of change and, over time, learn and adapt their way to successfully addressing the complex, systemic challenges that matter to citizens in countries and communities across the world.<\/p>\n","protected":false},"excerpt":{"rendered":"

        March 28, 2018 Michael Moses, Director of Learning and Programs ***This post was originally published by New Philanthropy Capital (NPC) on March 26, 2018*** To tackle complex, systemic problems you need a plan: enter\u00a0theory of change\u00a0(ToC). But like any plan, a theory of change must be reviewed and adapted as new information comes to light, …<\/p>\n","protected":false},"author":1,"featured_media":20622,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[178,190],"tags":[194,304,305,306,307],"table_tags":[],"yoast_head":"How to make monitoring, evaluation, and learning work for complex change - Global Integrity<\/title>\n<meta name=\"robots\" content=\"index, follow\" \/>\n<meta name=\"googlebot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta name=\"bingbot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to make monitoring, evaluation, and learning work for complex change - Global Integrity\" \/>\n<meta property=\"og:description\" content=\"March 28, 2018 Michael Moses, Director of Learning and Programs ***This post was originally published by New Philanthropy Capital (NPC) on March 26, 2018*** To tackle complex, systemic problems you need a plan: enter\u00a0theory of change\u00a0(ToC). But like any plan, a theory of change must be reviewed and adapted as new information comes to light, …\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/\" \/>\n<meta property=\"og:site_name\" content=\"Global Integrity\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/globalintegrity\" \/>\n<meta property=\"article:published_time\" content=\"2018-03-28T18:40:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-12-13T21:00:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.globalintegrity.org\/wp-content\/uploads\/2018\/03\/MEL-for-Complex-Change-7-2-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"560\" \/>\n\t<meta property=\"og:image:height\" content=\"292\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@GlobalIntegrity\" \/>\n<meta name=\"twitter:site\" content=\"@GlobalIntegrity\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.globalintegrity.org\/#organization\",\"name\":\"Global Integrity\",\"url\":\"https:\/\/www.globalintegrity.org\/\",\"sameAs\":[\"https:\/\/facebook.com\/globalintegrity\",\"https:\/\/www.linkedin.com\/company\/global-integrity\",\"https:\/\/twitter.com\/GlobalIntegrity\"],\"logo\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.globalintegrity.org\/#logo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/www.globalintegrity.org\/wp-content\/uploads\/2019\/01\/logo-new.png\",\"width\":365,\"height\":80,\"caption\":\"Global Integrity\"},\"image\":{\"@id\":\"https:\/\/www.globalintegrity.org\/#logo\"}},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.globalintegrity.org\/#website\",\"url\":\"https:\/\/www.globalintegrity.org\/\",\"name\":\"Global Integrity\",\"description\":\"Data, Learning Action for Open Governance\",\"publisher\":{\"@id\":\"https:\/\/www.globalintegrity.org\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/www.globalintegrity.org\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/www.globalintegrity.org\/wp-content\/uploads\/2018\/03\/MEL-for-Complex-Change-7-2-1.png\",\"width\":560,\"height\":292},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#webpage\",\"url\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/\",\"name\":\"How to make monitoring, evaluation, and learning work for complex change - Global Integrity\",\"isPartOf\":{\"@id\":\"https:\/\/www.globalintegrity.org\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#primaryimage\"},\"datePublished\":\"2018-03-28T18:40:17+00:00\",\"dateModified\":\"2018-12-13T21:00:25+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/\"]}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#webpage\"},\"author\":{\"@id\":\"https:\/\/www.globalintegrity.org\/#\/schema\/person\/ab58b880fd3f08399db4ba1c76f0320f\"},\"headline\":\"How to make monitoring, evaluation, and learning work for complex change\",\"datePublished\":\"2018-03-28T18:40:17+00:00\",\"dateModified\":\"2018-12-13T21:00:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#webpage\"},\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.globalintegrity.org\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#primaryimage\"},\"keywords\":\"adaptive learning,MEL,New Philanthropy Capital,NPC,theory of change\",\"articleSection\":\"Adaptive Learning,Open Governance\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.globalintegrity.org\/2018\/03\/28\/how-to-make-monitoring-evaluation-and-learning-work-for-complex-change\/#respond\"]}]},{\"@type\":[\"Person\"],\"@id\":\"https:\/\/www.globalintegrity.org\/#\/schema\/person\/ab58b880fd3f08399db4ba1c76f0320f\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.globalintegrity.org\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/21c32f9176c35e38a90ad767fb7c2c31?s=96&d=mm&r=g\",\"caption\":\"admin\"}}]}<\/script>","_links":{"self":[{"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/posts\/20420"}],"collection":[{"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/comments?post=20420"}],"version-history":[{"count":0,"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/posts\/20420\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/media\/20622"}],"wp:attachment":[{"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/media?parent=20420"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/categories?post=20420"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/tags?post=20420"},{"taxonomy":"table_tags","embeddable":true,"href":"https:\/\/www.globalintegrity.org\/wp-json\/wp\/v2\/table_tags?post=20420"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}