Anne Pinot de Moira

Head of Assessment Research
Marking of high-stakes examinations in England has traditionally been administered by schools and colleges sending their examination papers directly to examiners. As a consequence, the work of one candidate has, historically, been marked by one examiner, as has work of an entire centre. Previous...
This paper proposes a multilevel model which could be used to compare marking reliability between seed marked items and between seed marked units. It is hoped that the output from the model might promote the sharing of good practice and allow AQA to present a more unified approach to the design of...
Levels-based mark schemes are commonly used in the marking of extended response items but, between specifications, there is little commonality in their design, formulation and application. This study firstly establishes a list of the variable design characteristics between levels-based mark schemes...
The move towards e-marking has meant some large changes to the long established processes and practices for marking national examinations. Each change has been justified with a business plan and, while there are clear benefits to the awarding bodies, the benefits to examiners and candidates have...
Reliability and validity are ever-present themes in the evaluation of assessment. Previous research studies have considered the role of the question paper, the mark scheme and the examiners in providing unbiased estimates of students’ ability. With particular reference to the mark scheme, this...
Effective assessment is often measured in terms of mark re-mark reliability: the extent to which the same mark would be awarded to a candidate by two different examiners or, alternatively, by the same examiner on two different occasions. Reliability, however, can come at the expense of validity:...
Within the new framework set out in the final report of the Working Group on 14–19 Reform (2004), an Extended Project Qualification (EPQ) was proposed in England to foster the development of students' independent study skills. Widespread national provision of a fully accredited EPQ, as a stand-...
The exploitation of innovative technology in the administration of high stakes national qualifications, has provided the opportunity to develop robust quality assurance systems to monitor and improve marking reliability. This paper uses Monte Carlo simulation to explore two simple models of quality...
In summer 2008, the third cohort of students were awarded grades for the pilot Extended Project Qualification (EPQ). At the same time, awards were made to the first, and only, pilot cohort for the Level 1 and 2 Project Qualifications (PQ). As with the EPQ, it is planned that the PQs should be...

Pages