Concepts
Evidence and the snapshot
Why SwiftCNS fixes the success criteria and the evidence at two moments, and why Not met and Unclear still count.
Before you start
Two things get fixed, at two moments: the success criteria when you approve the experiment, and the evidence when you complete the tracker. Fixing them is what makes the result trustworthy later.
Steps
Criteria are fixed on approval
Once the experiment is approved, the success criteria can't move. The result can only be read against the criteria you set before you saw any data.
Evidence is saved as a snapshot
Complete tracker saves the rows as a fixed snapshot and completes the experiment. The Learning, its insights and the decision all point at that snapshot, so anyone can check exactly what you were looking at.
You call the result
SwiftCNS drafts observations from the snapshot. Then you say whether the result Met the criteria, did Not met, or is Unclear. If the evidence is thin, say so: Unclear, followed by Test again, is an honest record.
What you get
In the running example, 15 rows were saved. The success criteria were 3 of 15 paying within 7 days; 4 did. SwiftCNS also noted that one more or one fewer payment would flip the result, and that a late payer (day 10) fell outside the window. The team called it Met and said in the Learning that the margin was small.
A Not met result is a result too. It tells you where not to spend the next quarter.
Done when
- You can point to the approved criteria and the snapshot behind any decision.
Common mistakes
- Wanting to edit rows after completing. Run a follow-up experiment instead; the old snapshot stays.
- Calling Not met a failure. The failure is spending the quarter without knowing.
For agents: MCP tools and gotchas
complete_experimentsaves the snapshot; its id appears assnapshotDocumentIdonget_data_trackerandget_learning.list_evidence_assessmentsreturns history from the retired sufficiency step only.- An upload or attachment alone never approves or publishes evidence.