Changelog

Release history and notable changes

v5.0 — v1 Deprecated

March 2026

  • v1 pipeline deprecated — removed BYOLLM, shell executor, browser executor, API executor, assertion verifier, test plan parser, and item classifier
  • Removed signals: CI Bridge, Test Execution, Plan Augmentor, Gap Analysis
  • Vigil now runs a single v2 pipeline with 6 signals on every PR
  • Simplified architecture: read-only diff analysis, no code execution
  • Removed Chromium/Playwright dependency

v4.3 — Signal Quality

March 2026

  • Fixed template literal confusion in diffs — backticks in JSX/TSX code are no longer misread as single quotes
  • Credential scan now reduces severity for test files instead of failing the entire signal
  • Coverage mapper walks up parent directories to find __tests__/ test files
  • Config files (*.config.*, nginx.conf, Dockerfile) excluded from coverage analysis

v4.2 — Dashboard

March 2026

  • New: Dashboard at /dashboard — view PR verification history, scores, and repo metrics
  • GitHub OAuth login with JWT sessions
  • Execution persistence — pipeline results now stored in database with score, signals, and pipeline mode
  • Dashboard API: paginated executions, stats, repos, and execution detail endpoints
  • Dashboard link added to landing navbar and pricing page

v4.1 — Inline Comments & Conversational

March 2026

  • Inline review comments — findings posted directly on diff lines via GitHub Reviews API (Pro only)
  • New commands: @vigil explain, @vigil verify, @vigil recheck, @vigil ignore
  • Repo memory — persistent ignore rules per repository via @vigil ignore

v4.0 — PR Verification

March 2026

  • Vigil now verifies any PR — no test plan required
  • New: Claims Verification — extracts claims from PR title/body, verifies against diff
  • New: Undocumented Change Detection — surfaces changes not mentioned in the PR
  • New: Dual-mode pipeline — v1+v2 with test plan, v2-only without
  • New: v2-specific onboarding tips for repos without test plans
  • Rebalanced signal weights for 10-signal architecture

v3.1 — Commercial Launch

March 2026

  • Dedicated /pricing page with monthly/annual toggle and feature comparison
  • Checkout success page (/checkout/success)
  • Billing endpoints: /api/billing-portal, /api/account
  • Billing documentation page
  • MIT LICENSE added
  • Repo made public
  • GitHub Marketplace listing submitted

v3.0 — Signal Improvements

March 2026

  • New signal: Plan Augmentor — auto-generates verification items the test plan missed
  • New signal: Contract Checker — verifies API/frontend type compatibility
  • Coverage Mapper reform — plan-covered files count as tested
  • Signal coordination: contract-over-assertion trust, pipeline reorder
  • Augmentor reads CLAUDE.md for project context
  • Smart file reader — keyword-directed context extraction
  • Onboarding tips on first Vigil comment per PR

v2.0 — Confidence Score

March 2026

  • Score engine: weighted 0–100 confidence score
  • BYOLLM support: bring your own OpenAI, Groq, or Ollama key
  • 6 new signals: CI Bridge, Credential Scan, Coverage Mapper, Diff Analyzer, Gap Analyzer, Executor Adapter
  • Free/Pro tier gating
  • Failure cap: deterministic signal failures cap score at 70

v1.0 — Core

March 2026

  • GitHub App with webhook integration
  • Test plan parser (markdown checkbox extraction)
  • Item classifier (rule-based + LLM two-pass)
  • Shell executor (Docker sandbox, --network none)
  • API test executor
  • Browser test executor (Playwright)
  • Result reporter (PR comment + Check Run)
← PreviousBilling & Plans