JISC

FREMA: e-learning Framework REference Model for Assessment

The FREMA project is part of JISC’s e-Learning Programme, its goal is to develop a reference model for systems in the Assessment Domain that are built on top of Service-Oriented Architectures, such as Web Services and the Grid, and in particular the JISC e-Learning Framework (ELF).

Aims and Objectives

The aim of the FREMA project is to provide a reference model for the Assessment domain of the ELF. The Assessment domain area reference model involves the specification of services which focus upon the creation, execution and recording of electronic assessments which are accessible across institutions and to the lifelong learner.
The Assessment Reference Model will describe how the assessment area of the e-learning domain maps to the ELF and thus acts as a driver for implementation and evaluation. Once complete, the Assessment Reference Model will ease the development of further services and promote the re-use of existing ones by acting as a focus point for community development of the Service Framework.
The specific objectives are to:

• Define the scope of the Assessment domain terms of existing practice
• Define common Assessment solution patterns in terms of use case studies and scenarios
• Relate them explicitly to the ELF in the form of a service profile and service descriptions
• Provide prototype services that fulfil the profile of the Assessment domain, act as proof of the Assessment Reference Model and allow the reference model to be evaluated

Project Methodology

The objectives are set within a common strategy for the ELF framework:

• The project will take a service-oriented view of the core system modules required to support the assessment domain within e-learning applications
• Each service identified by FREMA will reference an open specification or standard where these are available
• Where possible the project will identify and integrate commercial, home-grown and open source components in the development of prototype assessment services
• FREMA will identify and agree common service definitions, data models and protocols for the Assessment domain within the ELF
• The project will provide and disseminate open-source implementations of the prototype services

The project comprises four work packages (W1-W4) summarised as follows:

• WP1  The project will begin by providing a more detailed and in-depth analysis and specification of the Assessment reference model requirements, and by specifying the standards for the Assessment reference model.
• WP2  The project then develops a first iteration of the design of the reference model and implementation of a prototype.  A particular portion of the Assessment domain area will be addressed (expected to be around half of the domain) and use cases and scenarios will be identified and documented.  The particular portion is expected to be the more straightforward aspects of the Assessment domain area, where relevant Assessment services can be readily identified and related to the reference model
• WP3  The project develops the other portion of the Assessment domain area, expected to be the remaining half of the domain, and use cases and scenarios will be identified and documented.  This particular portion is expected to be the more awkward aspects of the Assessment domain area, which will benefit from the work of WP2
• WP4  Substantial support and dissemination activity runs throughout the project.  Its components include Web site construction and maintenance, developing and running workshops, providing conference posters and presenting conference papers, and authoring and publishing journal articles, providing support for DeL regional pilot projects in the Assessment domain area (the creation and execution of D2), collaboration and coordination with the other e-Learning Framework reference model projects, collaboration and validation activities with CETIS and the CETIS Assessment SIG, and collaboration with other relevant Assessment domain area bodies and authorities (e.g. IMS).

Throughout the project efforts will be made to work with other groups and relate the Reference Model to other bodies of work. 

Implications/ Deliverables/ Stakeholders

The Assessment reference model will include:

1. A domain definition that will describe the scope of the Assessment domain, including evidence that gives an overview of current practises, processes and systems.
2. A set of use cases that describe common solution patterns in the Assessment domain area.
3. Service profile definitions for both existing services and those that need to be developed for the Assessment domain area, their scope, behaviour, and data.
4. Assessment reference model prototype implementations.  

Project Partners

University of Southampton

University of Strathclyde

University of Hull