Capacitybuilders has commissioned an evaluation to assess the impact of its investment in third sector capacity building activity across the country.

The evaluation is investigating what has happened to support services during the period 2004-2011 and assessing the effectiveness of ChangeUp, the ten year framework agreed jointly by government and the third sector to build capacity in the third sector. The Changeup vision was launched in 2004 and has been led by Capacitybuilders since 2006.

Through a pioneering research methodology the evaluation is, for the first time, attempting to quantify and track the impact of capacity building activity across England. The evaluation is looking at the outcomes achieved in the first two phases of the Changeup programme up until 2008 and tracking progress over the current three year funding period until 2011 by assessing what has happened to support services and the impact this has had on front line organisations.

The independent evaluation is being undertaken by a partnership comprising of the Third Sector Research Centre, BMG Research, Guidestar Data Services and Sustain Consultancy.

Research Method
The evaluation is using a unique methodology to measure and track growth in the capacity of the third sector and comprises of three main streams.

1) Baseline study
- geographic and thematic analyses a comparison of third sector performance against local economic performance
- the identification of a range of possible indicators and measures of a thriving third sector at a national, regional and local level. For example sustainability, growth, funding, diversity, levels of investment, numbers of partners and outputs.

2) National programme evaluation
- an evaluation of performance, awareness, usage and user satisfaction, revealing evidence of outcomes and impact.
- an extensive programme of engagement with key stakeholders and a detailed study of three National workstreams and two specific national programme activities.

3) In-depth locality case studies
The evaluation includes a number of locality studies that are being undertaken across England to explore local contexts and issues in greater detail. Twelve localities at a lead local authority level have been selected randomly, with each type of lead authority represented (Unitary, County, Metropolitan and London Borough).

These locality studies will be used to:
- see how the range of ChangeUp programmes are having an impact on the ground
- gain an understanding of the functioning and collaborative behaviour of infrastructure organisations and the impact on frontline organisations
- capture relevant learning – both positive and negative
- provide a framework for measuring “distance travelled.

The evaluation team has designed an approach that will use a balance of both qualitative research, such as gathering views from focus groups and interviews, and quantitative research - gathering data from surveys and statistical analysis.

The evaluation is being scrutinised at each stage of the research process by the Evaluation Advisory Panel (EAP). The Panel, which has an independent chair, has been established specifically with a remit of overseeing the evaluation. The Panel’s role is to ensure that the evaluation is independent, robust and has credibility with all stakeholders.

Timetable
The evaluation started in December 2008 and is running until 2011. Reporting for the evaluation will be split into two main components: a summative report looking at the outcomes achieved in the first two phases of ChangeUp (2004-2008), will be published in 2009; and a final report on the framework will be available in April 2011. More information on these reports will be provided in this website.

How will the findings be used?
This is an exciting piece of research for the third sector, and will be important in establishing robust evidence of the benefits gained from investment in sector support services. We will be using the findings from the evaluation to improve the services we deliver and to ensure they are responsive to the needs of the sector. A key element of the evaluation is also the development of a knowledge sharing strategy, which will ensure that all information, knowledge and learning captured and generated is made available to stakeholders and further strengthen Capacitybuilders commitment to being a learning agency.

Further information
For more information on the evaluation, please contact Siân Lewis, Learning and Research Officer, Tel: 0121 237 5126, Email: This e-mail address is being protected from spam bots, you need JavaScript enabled to view it

Article published on the Improving Support website (1 July 2010): Click Here