In early childhood education, child safety policy may forbid an external assessor from watching a nappy change. In nursing, patient dignity restricts observation of clinical examinations. In community services, privacy law may bar an assessor from a client interaction. In each case the validity requirement is unchanged: a student cannot be assessed as competent in a skill they have never demonstrated in practice. The environment has changed; the obligation has not. An analysis of the legislatively defensible evidence alternatives available when direct observation is restricted, and the design and documentation conditions each must satisfy. This article is general guidance, and the decisive test in any case is the unit's own assessment conditions, which should be checked directly.
When the Environment Will Not Let You Watch
Three separate questions put to ASQA at a recent sector webinar converged on one assessment design problem, raised in early childhood education but reaching far beyond it: if assessors are not permitted to observe intimate care routines such as nappy changes, how can they validly assess competency? Are doll-based demonstrations sufficient for real-life care scenarios? Can de-identified documentation, reflections or supervisor reports replace direct evidence, and how does an RTO keep such assessment authentic, reliable and industry-aligned? The same problem appears anywhere privacy obligations, child safety requirements, clinical environments or confined workplace access restrict what an assessor can directly see. The validity requirement under Standard 1.4 demands practical application, but the practical environment prohibits direct assessor observation. This article maps the defensible evidence alternatives and the conditions each must meet. It is general guidance, and because the answer in any given case turns on the specific unit, the unit's own assessment conditions are the decisive reference and should be checked directly.
1. The Validity Problem
Standard 1.4(a)(iii) requires that assessment include practical application components enabling the student to demonstrate the relevant skills and knowledge in a practical setting. This is the validity principle applied to practical competency: a student cannot be assessed as competent in a skill they have never demonstrated in a practical context, however well they can describe or theorise about it. For most workplace-delivered qualifications, the standard mechanism is direct observation by the assessor, who watches the performance, evaluates it against the criteria, and makes the individual judgement Standard 1.4(b) requires, with validity satisfied by personal observation.
The design challenge arises when that observation is restricted. Child safety policy may prohibit an external assessor from being present during intimate care; patient dignity and confidentiality may restrict observation of clinical examinations; privacy law may prevent attendance at client interactions; working-with-children requirements may limit who can be present. In each case, the environment has changed, but the validity requirement has not. The RTO's task is to design an assessment system that satisfies the practical application requirement through evidence that is valid, sufficient, authentic and current, even when direct assessor observation is unavailable, and that begins with the pre-use review of the assessment tool under Standard 1.3, which expressly contemplates alternative evidence options for exactly these contexts.
|
The Design Challenge in Plain Terms |
|
Standard 1.4(a)(iii) requires practical demonstration. The environment prohibits direct assessor observation. The solution is not to abandon practical demonstration, nor to quietly lower the bar. It is to design evidence collection that can demonstrate practical competency to the assessor without requiring the assessor to be physically present at the moment of performance. |
2. The Four Tests Any Alternative Must Pass
Standard 1.4(b) requires the assessor to make an individual judgement justified by the four rules of evidence, and any alternative method must satisfy all four. Satisfying three is not enough.
Validity requires that the evidence assures the assessor the student possesses the skills and knowledge in the training product, which for practical competency means the evidence must connect to actual performance, not merely to the student's ability to describe a performance. A written account of how a student would change a nappy does not satisfy validity for a competency that requires them to change one. Sufficiency requires that the quality, quantity and relevance of evidence support an informed judgement, which for practical skills usually means more than a single instance; the design must specify how many instances, across what range, over what timeframe. Authenticity requires assurance that the evidence is the genuine work or performance of this student, which, when evidence comes through intermediaries such as supervisor reports or documentation, demands specific design attention to verify both who performed the task and that the account was not unduly shaped by the person providing it. Currency requires that the evidence reflects present competency: a technique demonstrated competently in week two of a placement but never practised again by week twelve may no longer be current at the time of judgement.
|
All Four, or None |
|
Every alternative evidence method must satisfy validity, sufficiency, authenticity and currency together. Satisfying three of the four is not sufficient, and the most common failure is an alternative that is authentic and current but not valid, because it captures the student describing a task rather than performing it. The design must address all four dimensions at once. |
3. The Evidence Hierarchy
When direct observation is unavailable, the alternatives sit in a hierarchy by how directly they connect to actual performance and how well they meet all four rules. The combination most likely to produce a defensible judgement draws on the stronger types and uses the weaker ones only in support.
|
Rank |
Evidence type |
Rules-of-evidence strengths |
Design conditions required |
|
1 |
Direct observation by a credentialled assessor through a permitted mechanism (an adjacent supervised space, a one-way window, consented CCTV) |
Satisfies all four most directly; authenticity is inherent and currency immediate |
The assessor holds the Credential Policy authorisation; the mechanism is consistent with the centre's privacy and child-safety policies; all parties, including the care recipient, consent |
|
2 |
Structured third-party observation report by a qualified workplace supervisor who witnessed the performance |
Validity if task-specific and criteria-referenced; sufficiency needs multiple instances; authenticity needs verification; currency if dated |
The observer is named with role and qualification; the report is structured against specific criteria, not a character reference; it records date, context, student identifier and specific observations; no conflict of interest |
|
3 |
Simulation in a controlled environment (manikin, doll, role-play with adult volunteers) |
Validity only where the unit's assessment conditions permit simulation and it reproduces real conditions sufficiently; sufficiency needs full coverage; authenticity direct if the assessor is present |
The unit's assessment conditions must allow simulation for the criterion; the conditions must replicate real demands; where supplementary, it must be combined with other evidence |
|
4 |
De-identified workplace documentation produced by the student (care records, incident reports, checklists), countersigned and verified |
Validity limited to the documentation task itself, not the underlying physical performance; sufficiency needs multiple documents; authenticity needs countersignature and verification |
Documents verified as the student's work; supervisor countersignature confirming the context; assessor verification against the student's known work; cannot be the sole evidence for physical-skill competencies |
|
5 |
Student reflective journal or portfolio of the restricted task, with identified context and supervisor confirmation |
Validity limited to knowledge and understanding, not physical performance; contributes to sufficiency in combination |
Specific to identified instances with date, context and supervising practitioner; supervisor confirmation attached; used together with stronger evidence types |
4. Simulation as Evidence: Where It Works and Where It Falls Short
Whether doll-based demonstrations are sufficient for real-life care scenarios is the most contested design question in early childhood education, and the answer depends on the specific competency and what the unit's assessment conditions specify. Standard 1.4(a)(ii) requires assessment to be flexible, appropriate to the context, training product and student, and the assessment conditions in each unit indicate when simulation is appropriate. Where a unit's conditions allow observation in a real or simulated workplace environment, either may be used. Where the conditions require performance with real clients or children in a workplace setting, simulation alone does not satisfy the requirement.
The contrast between two kinds of unit makes the point. For HLTAID009 Provide CPR, the assessment conditions require demonstration of the resuscitation sequence on a manikin, so manikin simulation is not merely acceptable; it is specifically prescribed, and using it satisfies validity. For early childhood units requiring competency in nappy changing, feeding or other intimate care, the assessment conditions typically require performance in a real childcare setting with a real child. That does not require the assessor to be personally present, but it does require the evidence to capture performance in a real childcare context rather than a training-room simulation. A doll-based demonstration in a training room is not performance in a real childcare context, and substituting it does not meet the conditions. So where direct assessor observation is prohibited by child safety policy, the answer is not to substitute doll-based simulation for real performance. It is to capture real performance in the real context through an authenticated third-party observation and reporting system, using simulation for the practice and technique-development phase rather than the summative assessment.
|
Simulation and Real-Context Performance: The Critical Distinction |
|
Simulation is appropriate where the unit's assessment conditions permit it, or for formative practice. It cannot substitute for real-context performance where the conditions require workplace evidence. For care units requiring intimate-care competency, simulation supports skill development, while authenticated third-party observation reports provide the real-context performance evidence that satisfies Standard 1.4(a)(iii). |
5. Third-Party Reports: Designing Them to Satisfy Validity and Sufficiency
Third-party observation reports are the most practically important alternative when an assessor cannot observe a restricted task, and the difference between a valid report and a useless one lies almost entirely in the design of the instrument. A form asking the supervisor to confirm that the student is a good worker with a positive attitude is a character reference; it satisfies none of the four rules for any specific competency. A valid instrument is built around the unit's specific performance criteria, asking the supervisor, for each criterion that can only be evidenced through the restricted task, whether they observed the student perform the specific action, on what date and in what context, whether the performance met the required standard, and what specifically they saw. The observer must be identified with enough specificity, name, role, qualification and relationship to the student, for the assessor to verify their credibility and check for any conflict of interest, such as a family relationship, that would compromise the report.
|
Report element |
Rule of evidence it addresses |
|
Observer identification: name, role, workplace, qualification or experience, contact details |
Authenticity: the assessor can verify a knowledgeable, independent observer completed the report |
|
Date and context of each observed instance |
Currency, and the real-workplace condition: the date establishes present competency, and the context establishes a real setting |
|
Specific performance criteria assessed in the observation |
Validity: the report connects to the specific competency rather than to general impressions |
|
Description of what the observer saw the student do for each criterion |
Validity and sufficiency: the specific description gives the assessor the substantive basis for a judgement |
|
Assessment of whether the performance met the standard, where the observer is qualified to judge |
Validity: a qualified observer's assessment is evidence the assessor evaluates; an unqualified observer's account is description, with the determination remaining the assessor's |
|
Observer declaration of accuracy and independence |
Authenticity: the observer confirms the report is accurate and free of conflict of interest |
|
Number of instances observed |
Sufficiency: the assessor needs to know how many observations support the judgement |
6. Consent-Based Photography: A Policy-First Protocol
A webinar question asked whether de-identified documentation and photography can replace direct evidence, and the answer requires distinguishing de-identification as a privacy protection from de-identification as a way around a no-photography policy. Where a centre or clinical environment prohibits photography of children, clients or patients, that policy applies to assessment photography as to any other, and de-identifying an image after the fact does not make taking it compliant. RTOs must respect centre policies rather than work around them. Where a centre permits photography with the appropriate consents, including from parents or guardians of children, a photograph can provide useful supplementary evidence: it establishes that the performance occurred in a real context, but it does not capture the quality of performance in the detail a trained observer provides, so it is never standalone evidence. A workable protocol includes written confirmation from the centre director that assessment photography is permitted under its policies, written consent from parents or guardians where children are subjects, a de-identification step before images enter the assessment record, secure storage accessible only to the assessor and compliance staff with deletion after the process, and an explicit note that photographs are supplementary, never the primary evidence for any determination.
|
Photography: The Policy-First Rule |
|
Before using photography as assessment evidence anywhere, confirm in writing that the setting permits it. De-identification after the fact does not make non-compliant photography compliant. Where photography is permitted with consent, it provides supplementary evidence that a performance occurred; it cannot substitute for a specific, criteria-referenced third-party observation report. |
7. Building the Evidence Case: Combining the Alternatives
No single alternative, in isolation, is likely to satisfy all four rules for a practical skill requiring physical demonstration in a real context. The design task is to combine types so their collective weight satisfies validity, sufficiency, authenticity and currency at once. A five-component model addresses the common case of a care unit requiring intimate-care competency where direct assessor observation is restricted.
First, simulation for practice and technique development: doll or manikin work during the training phase, directly observed by the trainer for formative feedback, recorded as formative evidence and establishing a performance baseline, not as the summative assessment of real-context criteria. Second, third-party observation reports for real-context performance: a criteria-referenced instrument provided to the workplace supervisor at the start of the placement, completed for a specified minimum number of instances across a specified timeframe to meet sufficiency, and collected at intervals rather than only at the end to maintain currency. Third, student reflective records for knowledge and understanding: a structured entry for each significant care activity recording the date, context, steps followed, challenges and response, outcome, and the supervising practitioner, each confirmed by the supervisor for authenticity. Fourth, supplementary oral questioning: where any knowledge criterion remains insufficiently evidenced, structured oral questioning by the assessor satisfies validity for knowledge and doubles as an authenticity check, since a student who can answer detailed questions about the task they documented is showing the documentation reflects genuine experience. Fifth, portfolio consolidation and assessor review: the assessor evaluates the whole portfolio against every criterion, requests more evidence where any criterion is under-evidenced, and records the evaluation in review notes that form the individual judgement Standard 1.4(b) requires.
|
No Single Source Is Enough |
|
No single alternative satisfies all four rules for a physical-skill competency. The combination must collectively satisfy validity, sufficiency, authenticity and currency, and the assessor's review notes documenting that evaluation, criterion by criterion, are the record of the individual judgement Standard 1.4(b) requires. |
8. Keeping Assessment Authentic, Reliable and Industry-Aligned
The final webinar question asked how to keep alternative-evidence assessment authentic, reliable and industry-aligned, and each quality maps to a specific obligation. Authenticity, under the rules of evidence in Standard 1.4(b), comes from supervisor verification of reflective records, named and contactable observers without conflict of interest, cross-referencing evidence across sources to surface inconsistencies, and oral questioning to confirm genuine understanding; an evidence base that is internally consistent and tied to specific dates and contexts provides a strong foundation. Reliability, the principle in Standard 1.4(a)(iv) that outcomes be comparable irrespective of which assessor judges, comes from standardised third-party instruments completed against the same criteria, assessor moderation comparing how different assessors evaluate equivalent portfolios, and validation of the alternative-evidence system under Standard 1.5, without which the system is untested for reliability. Industry alignment, supported by the industry engagement expected under the training standards in Standard 1.2, comes from designing the evidence system with input from the centre directors and experienced practitioners who will complete the reports, so the instrument captures what competent performance actually looks like and the proficiency the industry expects of graduates.
Conclusion: The Obligation Does Not Move
The temptation, when an environment will not let an assessor watch, is to treat the restriction as a reason to assess something easier: to accept a description instead of a demonstration, a doll instead of a child, a confident manner instead of evidence. The Standards do not allow that, and for good reason, because the competencies most often shielded from observation- intimate care, clinical procedure, work with vulnerable people- are exactly the ones where a wrong competency judgement does the most harm. The validity requirement does not move when the assessor is asked to step out of the room. What moves is the method of gathering evidence, from a single pair of eyes at the moment of performance to a designed system of authenticated third-party observation, student documentation, verification and assessor review that, taken together, lets a trained assessor be genuinely assured the student can do the work. Building that system is more demanding than watching. It is also what the situation requires, and what the people on the receiving end of the graduate's competence are entitled to expect.
|
Summary: Assessing When You Cannot Observe, in Ten Points |
|
1. Standard 1.4(a)(iii) requires practical application evidence; an observation restriction does not remove the obligation, only the default method of meeting it. 2. Every alternative must satisfy all four rules of evidence under Standard 1.4(b): validity, sufficiency, authenticity and currency; three of four is not enough. 3. No single alternative satisfies all four for a physical-skill competency, so evidence types must be combined. 4. The unit's own assessment conditions are the decisive reference for whether simulation or real-context performance is required. 5. Simulation suits formative practice and units that expressly permit it, such as manikin use for HLTAID009 CPR; it cannot replace real-context evidence where the conditions require workplace performance. 6. The strongest alternative to direct observation is a criteria-referenced third-party report by a named, qualified, conflict-free observer, recording specific dated observations. 7. A general character reference satisfies none of the rules of evidence. 8. Photography must comply with the setting's own policy; de-identification after the fact does not cure non-compliant photography, and photographs are supplementary at best. 9. The five-component model, simulation for practice, third-party reports for performance, reflective records for knowledge, oral questioning for verification, and portfolio review, provides a complete approach, with the assessor's review notes forming the individual judgement. 10. Keep the system authentic through verification and cross-referencing, reliable through standardised instruments and Standard 1.5 validation, and industry-aligned through practitioner input under Standard 1.2. Check the current unit assessment conditions in every case. |
References and Further Reading
National Vocational Education and Training Regulator (Outcome Standards for Registered Training Organisations) Instrument 2025, Standard 1.2 (training and industry engagement), Standard 1.3 (pre-use review of assessment tools), Standard 1.4 (the principles of assessment and rules of evidence, including the practical application requirement at 1.4(a)(iii)) and Standard 1.5 (validation). Federal Register of Legislation.
Unit of competency assessment conditions, including HLTAID009 Provide CPR. National Training Register (training.gov.au).
Australian Skills Quality Authority. Practice Guide on assessment, and guidance on conducting valid assessment and on third-party and workplace evidence. https://www.asqa.gov.au/rtos/2025-standards-rtos/practice-guides
Disability Standards for Education 2005 (Cth), reasonable adjustment in assessment. Federal Register of Legislation.
