Diagnostic Specification · Engine Architecture

Three outcomes, one taxonomy.

Each submission is parsed into a structured schema: the mark scheme's criteria on one side, the student's step-by-step working on the other, validated before classification begins.

00

Intake Parsing & Schema Validation

Pre-classification validation pipeline

Dual-Channel Normaliser
Channel A · Assessment LogicCriteria Matrix

Official Mark-Scheme Criteria

Discrete assessment criteria decomposed into method targets, dependency chains, and accuracy boundaries (M-type, A-type, B-type milestones).

MarkScheme(criteria=[...]) # classifier/schema.py
Channel B · Script IngestionStep Sequence

Student Step-by-Step Working

Linear line-by-line script transcription mapped to logical units, isolating isolated transformations, notation, and substitution chains.

StudentStep(step_index=1, content="3x=12") # classifier/schema.py
Validation Status: Schema verified deterministicNext: Classification Dispatch
CLS_01/#correct
Correct
Full Credit
The step satisfies the relevant mark-scheme criterion outright, full credit, no ambiguity.
Mark-Scheme Criterion Mapped

Criterion M1 satisfied: isolates variable x via inverse operations

Student Observed Execution

2x + 7 = 19 –> 2x = 12 –> x = 6

Engine Resolution Logic

Method criterion matched; algebraic step preserved without deviation.

Crediting OutputMethod mark awarded (M1). Accuracy mark awarded (A1).
CLS_02/#process-error
Process Error
Partial Credit
The method is right but execution slipped (e.g. an arithmetic or sign error), method is still credited even where a mark is lost.
Mark-Scheme Criterion Mapped

Criterion M1 satisfied: applies valid quadratic formula substitution

Student Observed Execution

x = (-(-4) ± √((-4)² – 4(1)(3))) / 2(1) –> x = (4 ± √(16 – 12)) / 2 –> writes 4 ± 4 / 2

Engine Resolution Logic

Methodology verified valid. Calculation error flagged at root extraction; downstream accuracy withheld.

Crediting OutputMethod mark preserved (M1). Dependent accuracy mark penalized (A0).
CLS_03/#knowledge-gap
Knowledge Gap
Zero Credit
The method itself is wrong, the step shows the student doesn't understand what this part of the question requires.
Mark-Scheme Criterion Mapped

Criterion B1 required: identifies angle sum in parallel transversals

Student Observed Execution

Assumes alternate angles sum to 180° rather than being equal; writes 3x + 45 = 180

Engine Resolution Logic

Core geometric postulate violated. No mark-scheme branch matches working.

Crediting OutputCriterion missed entirely. Foundational intervention flagged.