Skip to main content

​
Changelog

​
v1.19.0 — 2026-06-13

Unified on-demand INVEST score + hub icon Work item panel (PO / BA)
  • Unified INVEST score (0–100): the score is now derived deterministically from the 6 LLM-evaluated criteria — the same source as the I/N/V/E/S/T grid. No more contradictory dual grid.
  • On demand, never automatic: the score only appears after clicking “Analyse (INVEST)”. No LLM call fires on panel open.
  • Before → after score: after “Rewrite in ADO”, the panel re-reads the server fields (GET REST — not the form cache, which caused a frozen score) and resets the analysis. Click “Analyse (INVEST)” again to compute the after score and compare improvement.
  • Actionable failure message: when no LLM is configured or the endpoint is unreachable, a descriptive message with a link to the Config tab is shown — no phantom score is displayed.
Hub
  • Hub navigation icon: the TestForge icon now appears in the ADO vertical navigation bar (iconAsset added to testforge-hub).
Definition of Ready
  • The DoR gate now uses the real INVEST LLM score and criterion statuses. Without a prior analysis, generation remains available — no automatic blocking without a score.

​
v1.18.0 — 2026-06-09

8 frameworks live + exhaustive Definition of Ready gate Automated test generation
  • All 8 frameworks now generate end-to-end. Cypress (JavaScript), Playwright (Python) and Playwright (.NET / C#) appeared in the framework selector but raised a “framework not supported” error at generation time because their prompt modules were missing — the three are now fully operational, with idiomatic Page Object structure and conformant file layout.
  • Added — Cucumber (Java): step definitions for io.cucumber.java, with .steps.java / .feature files.
  • Added — Cucumber (Python): pytest-bdd runner, with _steps.py / .feature files.
Quality Gate
  • The gate now covers every generation surface. When a User Story does not meet the Definition of Ready, both the manual and the automated test-generation buttons are disabled — the automated tab can no longer be used to bypass the gate.
  • Clearer feedback: a disabled generation button now shows the current score and the configured threshold (e.g. “score 52, threshold 70”) and links straight to the Product Owner panel so the story can be improved first.
  • Required INVEST criteria are now enforced: a mandatory criterion that is weak or missing blocks generation when an INVEST analysis is available; the offline, score-only check is unchanged.
  • The gate can be switched off without losing its configuration, via a new toggle in the Definition of Ready settings.

​
v1.16.0 — 2026-06-06

Real US ID traceability + Next Steps guide
  • Traceability annotations: generated tests now reference the real work item ID (@us-1234) instead of a placeholder.
  • Quality score — traceability dimension: placeholder and unknown IDs no longer count as a valid annotation; only real work item IDs are accepted.
  • “How to use this code” accordion: shown inline after each generation — install command, directory structure and run command for the selected framework.
  • “Full setup guide →” link: a direct link to the framework section in the documentation.

​
v1.15.1 — 2026-06-06

Hotfix — QA Hub loading
  • Fixed an infinite loading spinner when opening the QA Hub. Admin-role detection now runs fully offline, with no network call at load time.

​
v1.15.0 — 2026-06-06

Quality Gate & Definition of Ready
  • Configurable Definition of Ready: a per-project INVEST threshold (0–100, default 70) plus individual INVEST criteria marked required or optional, with organisation → project inheritance. Editing is restricted to Azure DevOps Project Admins.
  • Enforcement (levels 1 & 2): a warning banner appears in the Product Owner panel when a story is non-compliant, and the “Generate tests” button is disabled in the QA Hub when the story is below threshold or missing a required criterion. The gate runs on the offline heuristic score — no LLM required.
  • Backlog Quality dashboard: a new tab in the QA Hub listing the sprint’s stories with their heuristic score, Definition-of-Ready status and failing criteria. Recomputed on the fly, with no stored data.

​
v1.14.0 — 2026-06-06

Test count control
  • New TestCountPanel in the QA Hub Manual Tests tab.
  • Simple mode: global slider 2–32 with live distribution pills (e.g. 3 Nominal · 4 Boundary · 2 Equivalence · 2 Negative).
  • Advanced mode: individual sliders per typology (1–8 each), running total displayed.
  • Preferences persisted to ADO user account (test-count-config-v1).
  • generateTestCasesByTypology() accepts optional testCountConfig — fully backwards-compatible.

​
v1.13.0 — 2026-06-06

Polish & accessibility
  • ⚙️ Config button in work item panel now navigates correctly to the Hub Config tab.
  • Accent teal button contrast fixed: #1D9E75 + white text — contrast ratio 4.8:1 (WCAG AA).
  • Inline code blocks in Help tab: --surface-hover background — contrast ratio 15:1 (WCAG AAA).
  • All inline buttons migrated to Button design system (primary, ghost-blue, pill-on, pill-off).

​
v1.12.0 — 2026-06-05

Design System Refresh — Direction B “SaaS Arc”
  • Typography: Space Grotesk replaces Segoe UI.
  • Palette: marine #042C53 for hero surfaces, teal accent #22d3a5 for active states.
  • HeuristicScoreCard: hero card with 42px score, coloured level badge.
  • QaHubView: marine topbar with active provider badge.
  • New Card variants: hero and accent. Visual regression guard T-DS-16.

​
v1.11.0 — 2026-06-05

Branding, documentation, unified config
  • Marketplace icon (static/icon.png 128×128) and new overview.md.
  • Help tab in QA Hub: user documentation bundled as Markdown (zero network, offline-ready).
  • Unified configuration: work item panel no longer embeds a ConfigScreen.

​
v1.9.0 — 2026-06-05

Gherkin export, inline INVEST suggestions, AC format toggle
  • InvestSuggestion.criterion: suggestions linked to their INVEST criterion. Click a criterion cell to expand inline.
  • Export format toggle (Classic / Gherkin BDD).
  • Steps/Gherkin pills in TestCaseList: global toggle for all cases in the current US.
  • AC format toggle (Bullet list / Gherkin per AC): persisted per user.

​
v1.6.0 — 2026-06-04

Providers, Gherkin, code quality
  • 6 LLM providers: OpenAI, Mistral, Gemini (browser-direct) + Anthropic (client proxy).
  • Gherkin on manual tests: gherkinScenario field, pushed to System.Description.
  • 8 test frameworks: Cypress JS, Playwright Python/.NET, Cucumber JS/Java/Python added.
  • Code quality score: 5-dimension local score with warnings and Regenerate button.
  • stripHtml fix for ADO rich-text fields.
For the full commit history, see the GitHub repository.