AI Generated Assessment
This project seeks to revolutionise assessment design, moderation, and delivery using artificial intelligence to create high-quality, engaging, and personalised assessments that better meet the diverse needs of learners and industries while maintaining rigorous standards.
The issue
This project aims to address inefficiencies and inadequacies in current Vocational Education and Training (VET) assessment practices.
It seeks to revolutionize assessment design, moderation, and delivery using artificial intelligence to create high-quality, engaging, and personalised assessments that better meet the diverse needs of learners and industries while maintaining rigorous standards.
Intended outcomes
- An AI-generated assessment for Trades Essentials (Micro-credential) that passes moderation standards and meets expert panel requirements.
- Three contextualised versions of the Trades Essentials assessment demonstrating industry context and learner adaptation.
- A comprehensive ethical framework for AI use in assessment, including guidelines for safety, fairness, and transparency.
- A final report detailing the research process, recommendations on AI models and prompt engineering requirements, insights on improving future development, and suggestions for further research.
- Technical documentation of AI models and processes used.
- Recommendations and considerations for ongoing development and research in AI-assisted assessment generation in the VET sector.
The steps
Research and Development Phase
- Data preparation
- Prompt engineering
- Assessment generation
- Expert review and validation (3 rounds)
- Create AI-generated assessment for Trades Essentials
General Personalisation Phase
- Develop three AI-generated assessments for Trades Essentials
- Contextualise assessments based on industry requirements
- Adapt assessments to general learner personalisation
- Expert review and validation (3 rounds)
- Finalise personalised assessments
Final Reporting Phase
- Compile project findings and insights
- Develop recommendations for future development and research
- Prepare comprehensive final report
- Disseminate results to stakeholders and wider VET community
Project expected delivery date: May 2025
Lead organisation: ConCOVE
Collaborators: Epic Learning and George Angus Consulting
At Epic Learning, we know that the best education is engaging, compelling, and enjoyable. We offer a unique, award-winning mix of creativity and expertise to create training and assessments tailored to various needs. Our approach covers everything from strategic planning to the end-user experience, focusing on developing learning solutions that inspire and empower. By blending human insight with innovative techniques, we make sure that learning is not only effective but also resonates with learners, enhancing their skills and knowledge in meaningful ways.
George Angus Consulting is a global education consultancy with a focus on micro and digital credentials, wider vocational education research and qualification and assessment development and design. GAC develops global educational strategies with a view to improving engagement in education and increasing access to education for women, indigenous and disadvantaged people.
Project Status: In Progress
Contract Research Organisation: ConCOVE
Related projects
Degree-level apprenticeship (DLA) comparative pilot
Degree-level apprenticeship pilots
Supporting technical experts to become work-based trainers
Developing and trialing tools and resources that support work-based trainers to improve their practice
Workforce journey indicators data dashboard
A data project to understand how people navigate in and out of the construction workforce
Investigating training advisors in work-based learning in the construction and infrastructure sectors
Analysing systemic forces for workforce development alongside
Offsite manufacturing workforce forecast
Forecasting the size of the offsite manufacturing workforce required across the next 5-10 years
Civil Construction: A requirement for a robust and reliable training pipeline
Providing recommendations to combat the skilled labour shortage
Where is the front door? An investigation into the workforce entry points within the Construction and Infrastructure sector
Mapping the multiple entry points into the construction and infrastructure sectors
Environmental competency training
Ascertaining the specific skills required to meet the government’s environmental goals
Framework for Māori in high-skill roles
Understanding skills shortages experienced by Māori firms to support Māori into high-skill roles
From skilled industry practitioner to Kaiako
Analysing the current kaiako training to identify effective practices in classroom-based tertiary education
Temporary traffic management credentials framework
Informing the development of an improved TTM Credentials Framework
The New Zealand Quarrying Industry’s Possible Futures Toward 2030
Predicting the trends that will impact the quarrying industry to guide quarrying practice
Evaluation of government policy settings for apprentices
Understand the extent to which government apprenticeship policy settings are working
Women’s experiences working in Construction and Infrastructure
Women’s experiences working in Construction and Infrastructure
Skills standards
Good Practice in the Development and Implementation of Skill Standards-Based Qualifications
Neurodiversity
Neurodiversity
The place of micro-credentials in New Zealand
The place of micro-credentials in New Zealand
A Case Study: Cook Brothers Apprentice Academy
A Case Study: Cook Brothers Apprentice Academy
VET in schools: towards a model for Year 12 & 13 in New Zealand schools
VET in schools: towards a model for Year 12 & 13 in New Zealand