Workshop 2: Applying the CEFR to Rating and Standard Setting: Practical Calibration and Judgement Exercises        

When working with the CEFR, it can be challenging to adapt or work with the descriptors in contexts where human judgement is involved. The core focus of this workshop is on using the CEFR (including the Companion Volume) as a framework for rating productive skills, standard‑setting judgments, and ensuring consistency across raters and tasks.

What knowledge and/or skills will I gain from this workshop?

By the end of this workshop, participants will be able to:

• Understand how CEFR descriptors can guide rating decisions
• Identify key factors for borderline and cut‑score judgements
• Use the CEFR to inform standard‑setting decisions and justify cut scores
• Develop templates for calibration and rating practice for use in their own context

Who is this workshop suitable for?

This is a practical and interactive workshop suitable for CEFR‑literate assessment professionals, who work as raters, train raters, who are involved in standard setting, or would like to learn more about it. No previous standard setting experience is required. Participants are expected to have a working knowledge of the CEFR and to be able to work with CEFR descriptors provided in English and with sample tasks designed for learners of English as a foreign language. Exemplar tasks targeting a range of CEFR levels will be provided.

How is this workshop delivered?

This practical workshop is delivered in person, and will include interactive discussions with the tutor, bite-size introductory input, individual study tasks, and group and pair discussions. A pre-course questionnaire will be used to gauge the level and experience of those attending. Lunch will be provided for participants who join workshop I and workshop II.

Does this require require any specific software?

This course does not require any specific software, but it is a paper-free ‘green’ workshop, and all material will be delivered/shared online. You will need your own laptop.

Who is the tutor?

The course  will be presented by Jane Lloyd (Cambridge University Press and Assessment).  Jane is Senior Research Manager at Cambridge English. Her main responsibilities are leading on standard setting for Cambridge exams, working on large-scale educational reform projects with ministries and NGOs, and working for ALTE. Her work for ALTE is to support other national language test providers. This includes: statistical analysis of items, analysis of rater performance, research into exam and language use at regional and national level, courses and training in assessment, preparation for audits, and training for item writers, test designers and raters. Jane has a degree in Linguistics, a DELTA, an MA in Linguistics and TESOL, and an MA in Language Testing.  She is currently studying for a PhD in Language Testing at CRELLA. 

When is the next course?

The date for the next workshop is 11 November 2026.

How can I register?

Register for the next workshop here.

Expression of Interest

If you would like to express your interest in this course, or any other ALTE course, please click here.

Can several people from the same organisation join this course?

For group bookings, ALTE advises to book a maximum of three places per organisation.

How can I pay?

Full payment is required on registration. We strongly recommend that payment is made online using a Visa, MasterCard or American Express. However, if it is not possible to pay with a credit/debit card when registering, please contact the ALTE Services Unit (servicesunit@alte.org) to request an invoice with bank transfer payment instructions.

Course Terms and Conditions

1. Attendance

• Participants must attend at least 80% of course to receive a Certificate of Completion.
• Attendance will be recorded for each session.
• Those who do not meet the attendance requirement will not be eligible for the certificate.
• Missed sessions may be made up in a later edition of the course, subject to availability and the organiser’s approval.

• Each course registration is valid for one individual participant only.

• Registrations may not be shared, transferred, or used by multiple participants, unless agreed with ALTE.

• Group viewing (for example, several people attending from the same organisation in a meeting room or via a shared connection) is not permitted unless explicitly agreed in writing with ALTE.

2. Recordings and Course Materials

• Recording, copying or sharing any part of the live sessions is not permitted.
• All course materials, including slides, recordings and handouts, are the property of the course organiser and are provided for personal educational use only.
• Materials may not be shared, reproduced or distributed without permission.

3. Technology and Course Changes

• Participants are responsible for ensuring they have a reliable internet connection and appropriate technology to join the sessions.
• The course organiser may make reasonable changes to the schedule, content or tutors if necessary, and will communicate any updates in advance.

4. Agreement

By enrolling on and participating in this course, you confirm that you have read and agree to these Terms and Conditions.