What to check in an assessment tool before you buy it

Buying an assessment tool saves weeks of writing, but the purchase is only the start. The tool still has to suit your learners, your delivery mode and the version of the unit you hold on scope. A short, structured look before you pay will tell you how much adapting it will need and whether it suits your needs at all.

Start with the unit on training.gov.au

Open the unit of competency on the national register and keep it beside the tool while you read. Confirm the code and title match the current release. Then work through the unit's own parts: elements and performance criteria, performance evidence, knowledge evidence and assessment conditions. Every part should be covered by at least one task in the tool. If the unit lists foundation skills, look for where those are drawn out as well.

Look for a mapping document

A mapping document shows which task collects evidence for which requirement. Without one, you have to build that cross check yourself. With one, test a few rows at random: pick a performance criterion, find the task the map points to, and read the task to see whether it really asks the learner to show that skill.

Read the instructions as a learner and as an assessor

Learner instructions should say what to do, what to submit, the conditions and any time limits, in plain English pitched at the level of the qualification. Assessor instructions should say how to set up each task, what resources and equipment are needed, and what a satisfactory response looks like. ASQA's Assessment Practice Guide, written against the 2025 Standards for RTOs, says both the assessor and the learner should know what is being assessed, the conditions, how and when assessment will happen, and whether and how AI use is permitted.

Check the mix of methods

A unit with practical skills needs practical tasks, not only written questions. Look for observation checklists, practical demonstrations, projects, case studies or workplace tasks where the unit calls for them. Knowledge questions should test understanding, not just recall of a definition.

Check the benchmarks

Model answers and observation criteria are what make judgements consistent between assessors. Vague criteria such as "performs task correctly" give an assessor little to go on. Look for observable behaviours and decision rules for each task.

Fairness and adjustment

The tool should leave room for reasonable adjustment without lowering the standard, for example allowing an oral response in place of a written one where writing is not the skill being assessed.

Delivery mode and context

A tool written for a classroom may not work for online or workplace delivery, and the reverse. Check that the tasks can actually be done in the setting you use, with the equipment you have.

Review before first use

ASQA's Assessment Practice Guide expects assessment tools to be reviewed before use so they can be conducted in line with the principles of assessment and the rules of evidence. It also lists reliance on purchased tools that have not been contextualised to the student cohort as a known risk. Practical ways to review a tool include asking an industry contact to read it, moderating it with other assessors, and trialling it with a small group similar to your learners. Record what you changed and why.

ASQA's practice guides are written for RTOs that ASQA regulates. RTOs regulated by VRQA in Victoria or TAC in Western Australia should also check their own regulator's requirements.

Questions to ask the seller

  • Which release of the unit was the tool written against?
  • Is a mapping document included?
  • Are assessor guides and model answers included?
  • What file formats are supplied, and can you edit them?
  • How are updates handled when the unit changes?

You can browse assessment kits by unit code and read each product page to see what is supplied before you buy.

Back to blog

Categories

RECENT POSTS