This practical three-day online course provides language testing professionals with hands-on experience in designing high-quality test tasks and items for CEFR-aligned language proficiency assessments. Focusing on commonly assessed proficiency levels and general language testing contexts, participants will explore the principles underlying effective assessment of receptive and productive skills, analyse authentic test materials, and develop their own tasks and items through guided workshops and peer discussion.
The course is planned as follows:
PART One:
Day 1 & Day 2: Item Writing: 13 & 14 October (full days)
Day 3: Artificial Intelligence in language testing: 15 October (full day)
PART Two:
Day 4: Online wrap-us session: 30 October: 2.5 hours
Item Writing for language tests has become one of the fields where generative AI proves to be a very useful companion. This part of the course focuses both on the general characteristics of working with generative LLMs (pros and cons) and a very hands-on practical approach to safeguarding your data and advanced prompting.
For Day 3 of the course, it is important to have access to one the LLMs, preferably in a personal (paid) version (Gemini, ChatGPT, Claude or Copilot). Please ensure you have access to such a model before coming to the course. We will work with it extensively.
Following the live sessions, participants will develop sample materials in their own testing contexts, upload them to a Teams learning platform, where they will receive tutor and peer feedback, refine their work, and then discuss common issues in a follow-up online meeting. The course is suitable for both newer and experienced item writers seeking to strengthen their practical assessment design skills and prepare for emerging AI-assisted approaches to item development.
By the end of Day 1 participants will be able to:
-
Link receptive tasks to CEFR constructs.
-
Identify characteristics of effective reading and listening items.
-
Evaluate item quality against agreed criteria.
-
Produce and review draft receptive-skill items.
By the end of Day 2 participants will be able to:
-
Design productive tasks linked to CEFR outcomes.
-
Create task specifications for speaking and writing.
-
Develop assessment criteria aligned with constructs.
-
Produce draft speaking and writing tasks suitable for later AI-supported development.
By the end of Day 3 participants will be able to:
-
Explain the role of AI in assessment task and item development.
-
Safely protect the shared data in the LLM tools used.
-
Use prompting techniques to generate test tasks and items.
-
Make sure the AI system uses the CEFR framework correctly and properly in link with the generated items.
-
Evaluate AI-generated materials against assessment principles and CEFR requirements.
-
Produce draft assessment materials for subsequent review and refinement.
Course Overview:
The course combines three live online training days with an extended practical task-development project. Participants will draft, review, refine and discuss assessment tasks, receiving both tutor and peer feedback throughout the process.
|
Date
|
Activity
|
Output
|
|
13 October
|
Day 1: Designing Reading and Listening Tasks (Led by Jane Lloyd)
|
Draft receptive-skill items and task specifications
|
|
14 October
|
Day 2: Designing Writing and Speaking Tasks (Led by Jane Lloyd)
|
Draft productive-skill tasks and assessment criteria
|
|
15 October
|
Day 3: AI-Assisted Item Writing and Task Development (Led by Bert Wylin)
|
Participants begin developing a task or item set using AI-supported approaches
|
|
19 October
|
Deadline for Draft 1 upload to Teams
|
Participants upload first draft of task(s) for feedback
|
|
22 October
|
Deadline for peer feedback on Draft 1
|
Participants provide feedback on at least two peers' submissions
|
|
24 October
|
Tutor feedback on Draft 1 completed
|
Participants receive asynchronous tutor feedback
|
|
26 October
|
Deadline for revised Draft 2 upload to Teams
|
Participants upload refined version of task(s)
|
|
28 October
|
Deadline for peer feedback on Draft 2
|
Participants provide further peer feedback on revised submissions
|
|
29 October
|
Tutors review final submissions and prepare wrap-up session
|
Identification of common strengths and areas for development
|
|
30 October
|
Online Wrap-Up Session (half day)
|
Discussion of participant work, common issues and next steps
|
The tutors are: Jane Lloyd and Bert Wylin.
Jane Lloyd is a Senior Research Manager at Cambridge University Press and Assessment. Her main responsibilities are researching integrated learning and assessment practices in the classroom, working on large-scale educational reform projects with ministries and NGOs, and working for ALTE. Her work for ALTE is to support other national language test providers. This includes advising and training in standard setting, statistical analysis of items, analysis of rater performance, delivering pre-conference and online courses and training in assessment, and supporting exam boards with bespoke training and mentoring. She has a degree in Linguistics, a DELTA, MAs in Linguistics and TESOL, and in Language Testing, and is completing her PhD in Language Testing from CRELLA.
Bert Wylin has both an academic and a business profile. He has worked at the KU Leuven since 1993, leading the Education Innovation Centre (integrating EdTech in education). In 2001, he founded a KU Leuven university spin-off, now Televic Education, developing and servicing an e-assessment platform. Bert has delivered various courses for ALTE such as AI in digital language testing and Developing Digital Assessments.
Additional Event Information:
For group bookings, ALTE advises to book a maximum of three places per institution.
Payment is in full when registering. Payment can be made online using Visa, MasterCard or American Express.
If you cannot pay with a credit/debit card please contact the ALTE Services Unit: servicesunit@alte.org. We will then issue an invoice and a bank transfer will be possible.
ALTE offers a 15% discount for ALTE Members and a 10% discount for General public if you book the ALTE Item Writing Basic and AI in Item Writing Part 1 & ALTE Item Writing Advanced and AI in Item Writing Part 2 courses. Please email ALTE Services Unit to secure the discount: servicesunit@alte.org
In case of cancellation up until one month before the start of the event, the full amount will be refunded minus a €50 administration fee. If you have received the course book, you do not need to return this if cancelling. However, in the case of cancellation after this date, no refunds can be made.
Use of Personal Data Disclaimer
I agree that by clicking 'Register', the personal data I include in the registration form may be used and held by ALTE staff only for the purposes related to the organisation of the course.
Spam alert
Please note that ALTE will never ask you to pay via a third-party website.
Please avoid clicking on any links that direct you to a payment website other than WildApricot.