JISC

The scope of the formative evaluation will cover the continuing evaluation of the two MLE 01/01 projects (SHELL and NIIMLE) as well as the nine new projects starting in Phase Two. This phase of the MLE programme will expand the scope of issues being explored, specifically in the use of the IMS Learner Information Profile (LIP), and include links to organisations external to FE and HE. 

Glenaffric Ltd is an eLearning consultancy specialising in the design, development and evaluation of online learning programmes and systems. Currently we are also undertaking the formative evaluation of the SWaNI programme and overseeing its completion.

Aim

To provide a formative evaluation of the Managed Learning Environments for Lifelong Learning Projects which maximises the synergy between projects and the long term benefits for the JISC community.

Objectives

• To develop an evaluation framework which will encourage synergy/sharing across the projects
• To identify common themes across the projects
• To undertake formative evaluation activities with the projects
• To liaise and meet with the MLE Evaluation Team
• To provide feedback in the form of detailed reports at regular intervals.

Project Methodology

In general, Glenaffric Ltd adopts a qualitative approach to formative evaluation. For the MLE programme this will be an iterative and experiential process for the project teams and other key stakeholders. Through close contact with the appropriate agencies, the evaluation process also promotes understanding and appreciation of the technical issues involved in the development, testing and implementation of project activities. Data collection includes documentary analysis, interviews, meetings and visits, as well as interviews and discussions with the key stakeholders.  

Glenaffric Ltd see the role of the formative evaluator as ‘critical friend’, and as such propose to be in regular contact with project teams. Experience of other programmes confirms that most project teams respond to an evaluation approach based on positive reinforcement and encouragement, with regular feedback and iteration. It also confirms that the evaluation process can add value to project activities and outcomes.

Reporting

Interim evaluation reports were submitted at the end of each programme phase and a final report (available below) on completion of the programme. Glenaffric Ltd have worked proactively with the  programme manager to encourage the early dissemination of findings. Projects received written summary reports following visits.  

Final Report (November 2005)

Formative Evaluation Framework

The framework sets out the methodology and approaches used in the formative evaluation project and is available for download below.