Notary Check — build tracker
Informal live status board, mirrors PROGRESS.md in the repo. Not published product documentation.
Last updated: 2026-09-02
| Area | % | Status | What's left |
|---|---|---|---|
| Track 1 — Verification engine (Evidence) | ~75% | partial | Held-out eval gate at 0% (20 draft, unadjudicated cases); source-pointer round-trip + claim-ambiguity rule designed, not built; 4/18 locked test cases not covered |
| Track 2 — Challenge | 0% | deferred | Correctly not started — deliberately deferred until Track 1 proves repeat value |
| Engine backend for dashboard | 100% | done | Reviews/evidence/usage/org/api-keys/waitlist endpoints built & tested; not deployed live |
| Dashboard frontend | ~90% | done | Overview, reviews (+detail), evidence, usage, settings all built; not deployed live; no live Clerk session exercised end-to-end |
| "Connect to Claude" page | 100% | done | Needs the real connector URL env var once deployed |
| Live MCP connector (mcp.getnotary.ai) | live | working | Confirmed live for the core review loop — running an older build, no Clerk auth, doesn't have this session's fixes yet |
| Live paraphrase-contradiction bug | fixed locally | fixed | Root-caused, fixed, regression-tested (211/215 passing); not deployed, so the live endpoint still has the bug until deploy |
| Clerk OAuth on MCP server | ~85% | unverified live | Code real, never tested against an actual live Claude client |
| Billing | ~85% | test mode | Stripe checkout real in test mode; plan display now reads real data |
| Marketing site (getnotary.ai) | unknown | unscoped | Confirmed live and real; codebase location being tracked down |
| Deploy sync (local → Lightsail) | 0% deployed | blocked | Held back deliberately — needs explicit go-ahead |
| Legal (ToS / Privacy / DPA) | 0% | not started | Blocks a public signup open, not a personal test |
green done / verified
amber real but partial or unverified
red not started
grey correctly deferred / unscoped
What changed most recently
- Fixed the live paraphrase-contradiction bug — operator paraphrase + differing value now correctly reaches CONTRADICTED.
- Built /dashboard/reviews (+ detail), /dashboard/evidence, /dashboard/usage, overview — all on real engine data.
- Built /dashboard/settings — billing migrated off /account, api-keys issue/revoke, connect-to-Claude instructions.
- Corrected docs: mcp.getnotary.ai and clerk.getnotary.ai confirmed live; DD_API_KEY confirmed live; getnotary.ai marketing site discovered.
Next, not started
- Deploy this session's work to Lightsail (needs go-ahead + env var updates).
- Marketing site refresh (blocked on locating its repo).
- Held-out eval set annotation — the actual product-validation blocker.
This page is redeployed by hand as work lands — it is a snapshot, not a live dashboard wired to real data. noindex, not linked from anywhere public.