Skip to content
The 21st Century Learning Initiative

Proof of Work: Assessment When Product Severs From Process

The honest answer to "how do I prove a student wrote it" is that, from the finished text alone, a teacher usually cannot. Machine writing has severed product from process, and no inspection of the product restores the link. The reliable evidence of learning now lives in the process itself, which assessment must be redesigned to see.

What a graded product used to prove

For a century, assessment ran on a quiet inference. A submitted essay or solved problem set was not valued for itself; it was valued as a proxy, evidence that a chain of invisible cognitive events had occurred inside the student. The product implied the process, because for most students most of the time there was no other way to get the product. The inference was never perfect. Ghostwriting, copying, and parental over-help all exploited the gap between artifact and author. But those channels were narrow, costly, or risky enough that the proxy held for practical purposes, and whole systems of grading, certification, and admission were built on it. It is also worth remembering how recent the proxy is. Oral examination was the norm in universities for centuries, and the written examination's rise in the nineteenth century was itself an efficiency measure, trading the direct observation of a mind for an artifact that could be marked at scale. The current disruption, seen at that distance, is not the end of assessment but the end of one cost-saving shortcut in its history, and the older methods it displaced are still on the shelf.

Large language models did not widen the gap. They removed it. A competent essay on nearly any school topic can now be produced in seconds, at no cost, by a student with no understanding of its contents. The product no longer implies the process for any student on any prose assignment completed out of sight. This is not a discipline problem that better rules will fix; it is an evidentiary collapse. An assessment regime that continues grading unsupervised products as if they certified learning is measuring access to a machine.

The collapse reaches further than a single classroom's gradebook, because the proxy was load-bearing all the way up. Course grades feed transcripts, transcripts feed admissions and employment, and each layer trusted the one beneath it to have verified that products meant learning. When the bottom layer's inference fails, the failure propagates silently: nothing looks different on the transcript. That is why the redesign described below is not a matter of pedagogical taste. Institutions that certify learning have a duty to know what their certificates rest on, and at present many rest on an inference that quietly stopped being true.

Why detection cannot rebuild the bridge

The first institutional instinct was to inspect the artifact harder: run submitted text through software that estimates whether a machine produced it. The instinct is understandable and the approach cannot bear the weight placed on it. Statistical detection offers probabilities, not proof, and its error rates are intolerable in exactly the setting where it is used, where a false accusation attaches to a child's record and an accused student has no way to prove a negative. The published evidence is not reassuring: a 2023 study by Liang and colleagues at Stanford found that automated detectors flagged a majority of essays written by non-native English speakers as machine generated, while passing native speakers' essays, because the detectors were reading fluency statistics, not authorship. Paraphrasing tools defeat detection trivially; honest students learn to fear their own clean prose. A tribunal that convicts on such evidence is not upholding integrity, it is outsourcing judgment to an unreliable witness. The editorial position of this publication is that the question "did a machine write this" is, for most classroom purposes, the wrong question asked at the wrong point in the pipeline.

Nor is the weakness a passing state of the technology that patience will cure. Detection and generation are locked in an asymmetric contest: every public improvement in detection describes exactly what the next paraphrase must avoid, while the detector learns nothing it can rely on tomorrow. Proposals to watermark machine text founder on the same asymmetry, since text is trivially rewritten and unmarked systems will always exist. A school that builds its integrity process on detection has therefore built on the losing side of an arms race, and will be renegotiating its foundations annually. Process evidence does not date this way. A draft trail was good evidence of authorship in 1990 and will be in 2040, because it certifies the one thing no future system changes: that the student's thinking happened, observably, over time.

Process as evidence

The right question is asked earlier: what did this student's work look like while it was happening? Process evidence is old technology. Mathematics teachers have always demanded shown work; art teachers keep portfolios of studies and revisions; doctoral committees examine candidates orally on the thesis they claim to have written. Each practice embodies the same principle: authorship is demonstrated by command of the process, not by possession of the product.

Translated into the present, the principle yields a familiar toolkit. Drafts and notes submitted alongside final work, so the trajectory is visible. Version history in tracked documents, which records the actual sequence of composition. In-class writing and problem solving, where the process happens in view. Brief oral defenses, three minutes of "walk me through your second paragraph and what you rejected," which are difficult to fake and diagnostically rich. Annotated disclosure of machine assistance where it is permitted: what was asked, what was kept, what was overruled.

The practical objections deserve straight answers, because they are the reason good ideas stall. Oral defense of every assignment would be impossible, and is unnecessary: sampling does the work. If any submission might be the one discussed, the incentive travels with all of them, the way an audit regime disciplines returns it never opens. Three minutes per sampled student, twice a term, is an affordable price for an evidence base that detectors cannot supply. Version history costs nothing and reads quickly once a teacher knows the shapes: composition over days looks unmistakably different from a single large paste, and the point is not forensic certainty but a reasonable basis for the follow-up conversation. Draft trails can be skimmed, not marked; their existence matters more than their annotation. And a portfolio assembled from this material, drafts, defenses, disclosures, gives the year-end grade a footing no stack of unsupervised products ever had.

None of this requires surveillance software, and the distinction matters. Keystroke recorders and lockdown monitoring attempt to make the old unsupervised product trustworthy again by watching students harder. Process-based design makes the work itself carry its own provenance, which is both more humane and more informative. Our essay on writing when machines write first details what this looks like inside composition assignments specifically.

The dividend: better assessment, not just safer assessment

There is a deeper lineage here than crisis management, and it is the one this publication exists to keep visible. Assessment that watches process is the apprenticeship principle applied to evaluation: the same argument for making thinking visible that Collins, Brown, and Holum made about instruction in 1991 applies, clause for clause, to how learning is judged. A master never graded chairs sight unseen; the judgment and the teaching happened in the same act of watching. Schools separated them for efficiency, and the machine has now called in the cost of the separation.

Here the integrity argument joins the learning argument, and the joint is load-bearing. The same process evidence that establishes authorship is what formative assessment has wanted all along. Black and Wiliam's 1998 synthesis, Inside the Black Box, argued that the largest gains available to teachers come from assessment that looks inside the work as it develops and feeds judgment back into it. A teacher reading drafts and conducting oral checks is not merely verifying provenance; she is finally seeing the thinking she was previously asked to infer from products. Meanwhile the components of process-based design carry their own learning effects. Retrieval-heavy checks exploit the testing effect, Roediger and Karpicke's 2006 demonstration that being made to recall material strengthens memory more than restudying it. Explaining one's work aloud is generative practice. Assessment designed to see process does not trade rigor for security; it purchases both with the same coin.

Teachers who make the shift report a change the research would predict but the policy debate rarely mentions: the work gets more honest in both directions. Students who know the process will be seen stop optimizing the artifact and start attending to the work, and teachers stop grading a performance of competence and start responding to actual thinking. Assessment that watches process is harder to deceive, but more importantly it is harder to be deceived by, including by the student's own confident final draft, which has misled teachers since long before machines wrote any of it.

There is also a proportionality principle worth stating plainly. Not every assignment needs proof of authorship. Low-stakes practice can tolerate ambiguity; certifying assessments cannot. A sane regime concentrates its process evidence where the stakes are, keeps supervised and unsupervised work in deliberate balance, and applies the same honesty to homework, the largest mass of unsupervised product a school assigns.

Implications for practice

For a working teacher, the redesign reduces to four habits. Require the trail: drafts, notes, or version history accompany any substantial out-of-class product, and the trail is part of the grade. Talk to the work: short oral defenses, sampled rather than universal, make command of process a normal expectation instead of an accusation. Split the stakes: let unsupervised work be formative and low-stakes, and anchor certifying grades in work whose process was visible. Replace suspicion with disclosure: a clear policy stating what assistance is permitted and how it must be documented converts most integrity cases into teachable ones. For department heads and policymakers, the counterpart obligation is to stop asking teachers to prove authorship from artifacts, and to say so in policy; the Briefings pillar takes up that institutional layer. Proof of work is not a slogan here. It is the observation that in learning, as elsewhere, the work is the proof.