Measuring Impact

Differences Between Monitoring and Evaluation

Introduction

Welcome to this article on monitoring and evaluation, where we explore more about what monitoring and evaluation is. In addition, we will look at how they work together and the key differences between them. This article is written for non Monitoring and Evaluation specialists and as a result will avoid using a lot of technical language. If you would like to refer to technical guides the OECD and World Bank are great places to go for more information. You can also refer to our course catalog where we are always creating and adding new courses.

What is monitoring and evaluation?

Monitoring and Evaluation at its core is all about improving performance.Its done through gathering information, forming judgments about that information and taking action based on the results. 

If we take these three things in turn then what do we mean?

1) Gathering information –  One of the key elements of both monitoring and evaluation is in the collecting of information (or more accurately data). Effective monitoring and evaluation often involves a combination of numerical data e.g. number of attendees at a workshop and non-numerical e.g. written feedback from a focus group to help create a picture of what is happening or happened. 

2) Forming judgments – Data we receive doesn’t mean much on its own. In order to use it to make decisions we need to form judgments around what the values mean. For example, if we know that your staff have spent 30 hours of time and £10,000 on marketing of a new project is that good or bad? That will entirely depend on what resources you have planned to use on the project, the size and scale of the project, how much of the work you have achieved to date and what is left outstanding. It is therefore important to always make an assessment of what the data you collect actually means.

3) Taking action – Using the judgments or assessments you’ve made to make decisions about how to proceed.

How do monitoring and evaluation fit in with the life cycle of your organisation?

In order to understand the difference between monitoring and evaluation, its important to first understand the broader context in which we choose to use them. Most organisations will follow a similar pattern or cycle as follows:

  1. Identify the long term goals or mission of your organisation
  2. Create a strategy or action plan for how you will deliver those long term goals. This is normally through a set of projects each with their own objectives of what it will deliver which will contribute to the overall goal.
  3. Implement the projects
  4. Review and adjust the strategy based on project results.

All of this might be done officially through the use of various frameworks, planning documents and approvals process or it might be unofficial as well. We have put two frameworks below, both of which refer to monitoring and evaluation, to help guide our discussion, but these certainly aren’t the only two options. You might be using a different framework altogether.

Frameworks using monitoring and evaluation

Demonstrates the difference between Monitoring and Evaluation in the ROAMEF Cycle
Figure 1: The ROAMEF Cycle
The ROAMEF Cycle

The ROAMEF Policy cycle is a defined process for policy development. In it you can see that the overall structure of the policy cycle should be to:

  1. Develop a rationale for the intervention,
  2. Decide on your objectives,
  3. Carry out an appraisal or options analysis to decide what is the best course of action to achieve your objectives,
  4. Implement and monitor the project,
  5. Evaluate the project,
  6. Create feedback which will then influence the rationale and so it continues.
Demonstrates the difference in Monitoring and Evaluation in the Results Based Management Framework
Figure 2: Results Based Management Framework
Results Based Management Framework

The Results Based Management Framework uses different language to the ROAMEF cycle but as you can see the pattern is broadly the same:

  1. Set the vision
  2. Define a results map
  3. Plan for monitoring and evaluation
  4. Implement and use monitoring 
  5. Manage and use evaluation 
  6. Use the results of the evaluation to feedback to the vision.

What is the main difference between monitoring and evaluation?

As you can see from both of these frameworks, the primary difference between monitoring and evaluation is where they sit in the life cycle of your organisation and what decisions they will support you in making. For both monitoring and evaluation you will be:

  • Collecting Data
  • Forming Judgments
  • Making Decisions
The decisions you will be making, however, will be different. 
 
Decision making from monitoring data
For monitoring, you will be using the data you gather to help you achieve the objectives of your project. As a result, the types of things you might be asking of your monitoring data are: are we over- or under-spending our resources? Are we reaching the timelines we set for ourselves in our project plan? Are we delivering the finished product or service to the quality we decided on? Since the objectives of your project will be to deliver certain outcomes, monitoring can also include collecting of data around outcomes, with the intention being to improve the project’s operations.
 
Decision making from evaluation data
For evaluation, on the other hand, you will be using the data you gather to help you achieve the objectives of your organisation and help you design a strategy going forward. The types of questions you might be answering for this then are: does this project help us achieve our organisation’s objectives and is it the best approach to take? What lessons did we learn from this project we can apply in the future going forward? Were our assumptions about what activities would deliver certain outcomes correct? If not, what didn’t work? Did we cause any unintended results we didn’t expect? For more information on what areas evaluation covers please refer to the OECD-DAC Evaluation criteria .
As you can see because evaluation is used to feed into thinking around strategy and long term planning, it tends to have a wider scope. Monitoring on the other hand has a narrower focus, concerning itself with what is happening within the project at this moment.
 

Summary of differences between Monitoring and Evaluation

From the general discussion above, you can see that there aren’t hard and fast rules about what monitoring includes and what evaluation includes. There is often a great deal of overlap between the data you collect in monitoring and what you need for evaluation. The distinction becomes about how you use that information and what decisions you make off of the back of it. A table of differences can often be helpful to refer to which we will go through now, however, bear in mind that these aren’t finite rules and you shouldn’t find them restrictive. Each organisation and project is unique and as a result you should develop an approach to monitoring and evaluation which suits you, so please don’t feel restricted by these distinctions. 

Monitoring
  • Normally done by members of the project team as they are implementing the project itself. It might be in the form of project update reports, meetings, quarterly reviews, expenditure reports or time sheets. 
  • Information from monitoring is predominantly for the benefit of the project team to help them implement their plans more effectively.
  •  Is focused on what is happening right now to help take in the moment decisions.
  •  Has a greater focus on inputs, activities and outputs, although can also include elements of measuring outcomes which arise during the time frame of the project. As a result, the data you collect is more likely to be quantitative (numbers based) in nature although may have qualitative elements as well.
  •  Puts a greater emphasis on making sure that things are being delivered on time and to budget, with the main priority being on assessing whether things are being done right.
  •  There will normally be some element of monitoring throughout the life of a project.
 
Evaluation
  • Ideally done by individuals outside of the project term and even external to the organisation to provide independence. This does not have to be the case though and on smaller projects/organisations it can be done by the same people as monitoring. 
  • Information from evaluation is predominantly for the benefit of those stakeholders who are involved in strategic planning for the organisation. They will use the information to guide what programmes or projects are done in the future. 
  • Is focused on future events and long term planning.
  • Has a greater focus on outcomes and impact. As a result, will likely include a carefully balanced combination of quantitative data and qualitative (non-numerical) data.
  •  Works to assess whether your project has been effective, efficient, impactful, sustainable and relevant, with a priority being on understanding whether we are doing the right things.
  •  Evaluations will often be done periodically or at key decision points throughout and after a project, for example, at the end of a pilot phase of after the project has finished. With that being said, evaluation is something you should consider throughout the planning and implementing of your project as well. All too often, if it is left to the end of a project you might find it difficult or impossible to gather the data you need. It is, therefore, important to have a plan for evaluation to work to, even though it might not be something you intend to do on a continuous basis.
 

Conclusion

Monitoring and Evaluation refers to a group of activities and process with the goal of aiming to improve performance. Monitoring is used during the implementation of a project to help steer and guide decisions on how best to achieve the objectives identified for that programme. Evaluation on the other hand is there to support strategic planning. Answering questions such as was our project successful?, did it produce the outcomes and impact we wanted? help guide decision making on what projects to pursue in the future, how is best to achieve the organisation’s objectives and learn lessons to apply to new projects to improve performance overall.  
 
If you aren’t sure on where to start with Monitoring and Evaluation, the best place to begin is with a Theory of Change. A Theory of Change helps you identify what activities and projects you should do in order to create the results you are looking for. It also helps you articulate why you expect the activities you take part in will create the change you want to see in the world. Once you have created a Theory of Change, this should provide a solid foundation for being able to identify what you need to be measuring, what data it is that you need to collect and a strategy for being able to measure your impact effectively.
Ready to create a Theory of Change within your own organisation?

Find out more about our online and blended learning training options below. 

2 thoughts on “Differences Between Monitoring and Evaluation

  1. This is quite interesting,,am going to graduate in certificate of project monitoring and evaluation management.
    Here I saw things I never studied. thank you very much for clarifying the basic concept in monitoring and evaluation.

Leave a Reply

Your email address will not be published. Required fields are marked *