Why attendance is not evidence
Attendance is the most commonly reported number in education programmes because it is the easiest to collect. It records that a person was present in a room where learning was available. It records nothing about whether any occurred.
The alternative usually proposed is a written test, which for maker learning measures the wrong construct: a learner can describe a soldering technique they cannot perform, and perform one they cannot describe. Assessment in maker settings is nonetheless feasible and well precedented — around three-quarters of surveyed makerspaces assess in some form[21]. The question is what to look at.
Attendance creates an opportunity to learn. Demonstrated, explained work shows what was learned. Only the second belongs on a certificate.
Three sources, each catching something the others miss
The reason for three rather than one is that each fails in a different direction, and the failures do not overlap.
| Source alone | What it can miss |
|---|---|
| The artifact only | A working object built by following instructions, or with substantial help, with nothing understood. |
| The talk-through only | A fluent explanation of something that was never actually made to work. |
| The reflection only | Well-written self-awareness with no demonstrated capability behind it. |
The reflection is the one most often treated as optional, and it is the one with the clearest theoretical warrant: experiential accounts place reflection as the step that converts a specific experience into something usable in the next situation[7]. That transfer is exactly what a certificate is asserting.
The talk-through does most of the work
A short, structured conversation in which the learner explains how and why their work works, and what they would change. Four properties make it the most valuable instrument available to a facilitator.
- It costs only time. No equipment, no marking scheme, no software.
- It is subject-neutral. It works identically for a robot, a song and a painting, which compensates for the fact that digital work is far easier to assess automatically than craft work is.
- It is harder to rehearse than a written answer. Follow-up questions about choices the learner made tend to separate understanding from recalled explanation — not reliably, but far better than a script does.
- It teaches while it assesses. Explaining a build is itself one of the more reliable ways to consolidate it.
This has become more important, not less, as generative tools have become widely available. A polished artefact and a plausible write-up are now within reach of a learner who understands neither. A conversation is not.
Completeness and quality are separate judgements
The six evidence states establish that work is complete: an aim exists, options were considered, the thing was made, it was evaluated, shared and refined. That is a binary, and it is deliberately coarse.
How good the work is, is a different question, and we resist a false precision about it. Two published frameworks shape how level rubrics describe increasing quality: structural accounts distinguish work handling one element, several unconnected elements, several related elements, and a generalisation beyond the task[20]; and skill-acquisition accounts describe the move from following rules, through situational judgement, to fluent practice[18]. Revised taxonomies of educational objectives put creating at the top of the hierarchy[19] — which is the ordering a maker programme depends on and the one that school assessment most often inverts.
Creativity is not one thing at one scale. A useful distinction separates the personally meaningful insight, the everyday creative act, professional-level contribution, and field-changing work[23]. Almost everything a learner produces sits in the first two. That is not a deficiency — but a rubric that grades against professional novelty is measuring something the programme is not trying to produce.
What we cannot yet verify
Hard results are straightforward: the artefact exists, it works, it was tested. The results that facilitators most want to certify — persistence, judgement, collaboration, confidence — are the hardest to evidence, and maker educators report this consistently.
The talk-through and reflection pair is our mitigation. It is not a proof, and we hold that flag open on the certification system rather than closing it with a rubric that implies a precision we do not have. Publishing the limitation is a slower way to build credibility and the only durable one.