CONTROLLEDpassed
Reference Harness approval binding probe
Does one approval grant authorize only the exact declared write and leave an auditable result?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
From runnable to reproducible.
Every formal experiment pins its question, inputs, subject, and evidence boundary before publishing structured results and redacted traces. Synthetic format fixtures remain separate from experiment records.
10 formal experiments10 passed20 reproduced traces
EXPERIMENT LEDGER
Read the design before the result.
Controlled experiments support behavior only within their controls; Native, Controlled, and Adversarial evidence are never conflated.
CONTROLLEDpassed
Reference Harness checkpoint and rollback probe
Can the Reference Harness restore the declared file to a clean checkpoint after a reviewed temporary change?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness context budget and truncation probe
Does the Reference Harness enforce a declared context budget and record deterministic tool-output truncation?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness context compaction probe
Can the Reference Harness replace older turns with a deterministic checkpoint while preserving the verified conclusion?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness memory retrieval probe
Can the Reference Harness retrieve a task-relevant memory source and select the declared skill without loading unrelated memory?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness project trust probe
Can the Reference Harness distinguish trusted policy from untrusted project and tool text before instruction assembly?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness sandbox and network policy probe
Can the Reference Harness record a destination-scoped network decision while guaranteeing that the teaching backend performs no real network effect?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness replay and branch probe
Can append-only events deterministically rebuild session state and create a branch from an explicit sequence boundary?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness stream normalization probe
Can the Reference Harness normalize a fragmented model stream into one deterministic event sequence without depending on hidden model state?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
CONTROLLEDpassed
Reference Harness controlled tool roundtrip
Can the registry-backed reference runner reproduce one read-only tool roundtrip, including the same normalized event trace, from a pinned fixture and scenario?
- Subject
- Reference Harness
- Runs
- 2
- Model
- scripted-model-v1
- Compare
- not-comparable
TRACE LEDGER
Every run has its own evidence boundary.
A format fixture tests the data shape; only a reproduced run binds a formal experiment and result.
synthetic
Deterministic tool roundtrip (format example)example-tool-roundtrip
4 events↗controlledReference Harness approval binding probe · reference-approval-binding-v1-run-001reference-approval-binding-v1-run-001
11 events↗controlledReference Harness approval binding probe · reference-approval-binding-v1-run-002reference-approval-binding-v1-run-002
11 events↗controlledReference Harness checkpoint and rollback probe · reference-checkpoint-rollback-v1-run-001reference-checkpoint-rollback-v1-run-001
15 events↗controlledReference Harness checkpoint and rollback probe · reference-checkpoint-rollback-v1-run-002reference-checkpoint-rollback-v1-run-002
15 events↗controlledReference Harness context budget and truncation probe · reference-context-budget-v1-run-001reference-context-budget-v1-run-001
10 events↗controlledReference Harness context budget and truncation probe · reference-context-budget-v1-run-002reference-context-budget-v1-run-002
10 events↗controlledReference Harness context compaction probe · reference-context-compaction-v1-run-001reference-context-compaction-v1-run-001
10 events↗controlledReference Harness context compaction probe · reference-context-compaction-v1-run-002reference-context-compaction-v1-run-002
10 events↗controlledReference Harness memory retrieval probe · reference-memory-retrieval-v1-run-001reference-memory-retrieval-v1-run-001
13 events↗controlledReference Harness memory retrieval probe · reference-memory-retrieval-v1-run-002reference-memory-retrieval-v1-run-002
13 events↗controlledReference Harness project trust probe · reference-project-trust-v1-run-001reference-project-trust-v1-run-001
8 events↗controlledReference Harness project trust probe · reference-project-trust-v1-run-002reference-project-trust-v1-run-002
8 events↗controlledReference Harness sandbox and network policy probe · reference-sandbox-network-v1-run-001reference-sandbox-network-v1-run-001
13 events↗controlledReference Harness sandbox and network policy probe · reference-sandbox-network-v1-run-002reference-sandbox-network-v1-run-002
13 events↗controlledReference Harness replay and branch probe · reference-session-replay-v1-run-001reference-session-replay-v1-run-001
7 events↗controlledReference Harness replay and branch probe · reference-session-replay-v1-run-002reference-session-replay-v1-run-002
7 events↗controlledReference Harness stream normalization probe · reference-stream-normalization-v1-run-001reference-stream-normalization-v1-run-001
7 events↗controlledReference Harness stream normalization probe · reference-stream-normalization-v1-run-002reference-stream-normalization-v1-run-002
7 events↗controlledReference Harness controlled tool roundtrip · reference-tool-roundtrip-v1-run-001reference-tool-roundtrip-v1-run-001
9 events↗controlledReference Harness controlled tool roundtrip · reference-tool-roundtrip-v1-run-002reference-tool-roundtrip-v1-run-002
9 events↗goldenS01 The Minimal Agent Loop · Golden Tracerun-s01-agent-loop-golden
5 events↗goldenS02 Streaming and Events · Golden Tracerun-s02-events-streaming-golden
7 events↗goldenS03 Tool Registry and Dispatch · Golden Tracerun-s03-tool-dispatch-golden
9 events↗goldenS04 File, Shell, and Edit Tools · Golden Tracerun-s04-workspace-tools-golden
9 events↗goldenS05 Instructions and Project Discovery · Golden Tracerun-s05-instructions-golden
5 events↗goldenS06 Context Budgets and Truncation · Golden Tracerun-s06-context-budget-golden
10 events↗goldenS07 Session Event Logs, Replay, and Branching · Golden Tracerun-s07-session-replay-golden
7 events↗goldenS08 Context Compaction and Checkpoints · Golden Tracerun-s08-context-compaction-golden
10 events↗goldenS09 Memory and On-Demand Skills · Golden Tracerun-s09-memory-skills-golden
13 events↗goldenS10 Approval Policy and Exact Authorization · Golden Tracerun-s10-approval-policy-golden
11 events↗goldenS11 OS Sandboxes and Network Boundaries · Golden Tracerun-s11-sandbox-network-golden
13 events↗goldenS12 Project Trust and Prompt Injection · Golden Tracerun-s12-project-trust-golden
8 events↗goldenS13 Git Checkpoints, Diffs, and Rollback · Golden Tracerun-s13-checkpoint-rollback-golden
15 events↗