The problem

An app can display a convincing AI answer while silently returning a mock or fallback. Integration Verifier tests the connection between the provider response and what the browser actually shows.

The product

Run a bundled Node application under unavailable, malformed-response and unique-marker provider conditions. Inspect browser evidence, identify a hidden fallback, then apply the bundled deterministic repair and replay the unchanged regression in a temporary copy. Original source stays intact. This version deliberately targets a controlled sample; it does not claim arbitrary-repository repair.

Sponsor technology and build

The application uses Node.js, JavaScript and Playwright. A real Tavily search retrieved vendor documentation, and NVIDIA Nemotron Lightning (nvidia/Nemotron-3_5-Lightning) on Nebius Token Factory produced a checklist from selected passages. Search and inference have separate receipts; external text is advisory input, never executable instructions.

A second path is implemented for Nemotron-generated patches executed in Token Factory Sandboxes, with separate inference and execution evidence. Sandbox approval and a successful live generated repair are still pending. The pinned Python SDK's offline contract tests do not replace that proof.

Deepgram Aura-2 Thalia generated the narration audio. Decoding, non-silence and clipping checks passed; listening review and the edited video remain unfinished.

What is verified

The actual local browser journey detected a hidden fallback. Its deterministic repair passed all nine evidence checks: the unchanged regression failed before the patch and passed afterward. The standalone full suite passed 152 tests; later focused checks passed 17 research units, two API/browser checks and four SDK checks. These checks overlap and use local fixtures, separate from the live research receipts.

The research contains a supported refusal-handling proposal, but its broader summary exceeds its selected quote. Original outputs remain preserved; a separate assistant review proposes narrower checks without claiming they were executed. Literal citations and successful API transport do not establish semantic correctness.

Run and current access

Repository. As checked on 22 October 2026, this repository is private and its remote revision predates the validated local release. Publication and judge access remain pending; the repository link is not yet a public reproduction path.

The commands below apply to the prepared standalone release after access to that revision is available. Node.js 22+ is required. Live sponsor actions need private environment configuration and explicitly reviewed provider access; local examples work without provider keys.

npm ci
npx playwright install chromium
npm start

Open http://127.0.0.1:4190/verifier. Run npm test without provider credentials for local validation. The server binds to loopback; a public judge-access path is not yet available.

AI tools and development

Codex assisted with implementation, interface refinement, test authoring, debugging and independent review. NVIDIA Nemotron performed the bounded runtime tasks described above; Tavily supplied search results, and Deepgram generated narration. AI output was checked against saved state, validation rules and actual execution evidence. This description does not claim that another assistant's separate hackathon projects are part of this entry.

Built With

Share this project:

Updates