# TesterArmy e2e and Independent Validation With Katalon True Platform *TesterArmy built a strong runner for agentic tests; at enterprise scale the harder job is proving the result, and that takes independent validation.* > Katalon True Platform's lead product manager on TesterArmy's open-source e2e AI testing framework: what the team got right, why enterprise QA in regulated industries like banking (BFSI) and healthcare needs independent validation of AI-generated tests, and how e2e can run as an execution lane under True Platform's versioned test cases, requirements traceability, and audit trail. Published: 2026-10-06 · Reading time: 12 min · Tags: independent-validation, ai-test-verification, qa, ai-testing, agentic-testing, e2e, testerarmy, katalon, katalon-true-platform, enterprise-qa, test-management, requirements-traceability, audit-trail, regulated-industries, bfsi, banking, healthcare, compliance, junit, test-data, release-readiness Canonical URL: https://huytieu.com/blog/e2e-and-katalon-true/ Author: Huy Tieu (huytieu.com) --- TesterArmy shipped something good last week. [e2e](https://github.com/tester-army/e2e) puts natural-language agent steps and exact assertions in the same TypeScript test, replays recorded actions without paying for the model again, and runs the same suite on web and mobile. That is a hard combination to get right, and the team got it right in an open-source 0.17 release. I lead product for [Katalon True Platform](https://katalon.com/platform), so I read the launch with professional interest and a stake in the outcome. We work on a close cousin of the same problem, for banks, insurers, and healthcare companies whose suites run to thousands of cases across many teams. At that scale, running the test stops being the hard part. Proving the result is. The answer that keeps holding up is **independent validation**: whoever writes or runs a test should never be the only one grading it. This is a public-docs read as of 6 October 2026. The e2e and True integration I sketch near the end is a proposal and does not exist yet. ## Launch week on X TesterArmy co-founder Oskar ([@o_kwasniewski](https://x.com/o_kwasniewski)) [announced e2e on 1 October](https://x.com/o_kwasniewski/status/2105675143464763540). Five days later the post sat at 1.1M views, and two days after launch he [posted a star chart](https://x.com/o_kwasniewski/status/2106291635122213342) heading for 2k. Deserved.
Oskar's launch post for e2e: fully open source, mix deterministic and agentic APIs, web and mobile, bring your own agent, run locally or in CI
Launch post, 1 Oct 2026
Oskar's follow-up post with a GitHub star history chart for tester-army/e2e climbing to about 2k in early October
Star history, 3 Oct 2026
## What TesterArmy got right e2e 0.17.0 mixes agent steps with locators, deterministic assertions, fixtures, hooks, retries, and CI support. It runs on Chromium, Firefox, WebKit, [physical mobile devices](https://github.com/tester-army/e2e/blob/e2e%400.17.0/docs/physical-devices.mdx), and [APIs](https://github.com/tester-army/e2e/blob/e2e%400.17.0/docs/api-testing.mdx), and emits JSON, JUnit, and Markdown. With its [assertion API](https://github.com/tester-army/e2e/blob/e2e%400.17.0/docs/reference/expect.mdx), an agent can find its way through the UI while an exact check decides pass or fail. That split is the right instinct. The [replay cache](https://github.com/tester-army/e2e/blob/e2e%400.17.0/docs/cache.mdx) is the other strong call. Agent actions are recorded and replayed without model calls, while `agent.assert`, `agent.waitFor`, and `agent.extract` always run live. Strict mode fails a stale recording with `REPLAY_STALE` before the model can take the step over, which is the kind of loud failure a CI pipeline needs. One [public trial](https://github.com/FlorianRiquelme/friquelme.dev/pull/76) on a small Astro site (e2e 0.16.0) saw median runtime drop from 25.1s to 13.5s and model calls from 5 to 1 on cached runs, with both injected defects caught. A Playwright control caught both too and ran faster, and the author's verdict was "adapt". Early, encouraging, and clear about its limits. ## Independent validation The best pushback in launch week came from [davert](https://x.com/davert), author of CodeceptJS and Codeception, now building Testomat.io. He [asked how anyone decides](https://x.com/davert/status/2105994078517399870) which checks belong in `agent.assert()` and which in `expect()`, and argued for [manual test cases as the blueprint](https://x.com/davert/status/2106497346116661468). The card in his post says it in a few words: a test written from code "repeats the bug"; a test written from approved intent "catches the bug".
davert asking how an agent should know which checks are written as assert versus expect, with an e2e sample test
Assert or expect, 2 Oct 2026
davert: use manual test cases as the blueprint for e2e tests; getting into thousands of slow e2e tests is another dead end
Test cases first, 4 Oct 2026
He is pointing at the oldest rule in quality engineering, and AI makes it urgent again. If the same agent reads the code, writes the test, runs it, and judges the result, a misunderstanding passes every step. Each check needs a different owner: e2e already covers the middle three well: the test code, the runner, and exact assertions that keep the model out of the verdict. The other two, approved intent and an independent record behind the release decision, live outside any single framework. That is the layer we build True Platform for. ## What changes at enterprise scale A small team can keep all five owners in one person's head. The engineer who writes the test also seeds the data, reads the CI failure, and decides whether to ship. In a bank or a hospital network those jobs belong to different people, often in different time zones, and each handoff needs a record that outlives the CI log. Three things get harder. First, intent: thousands of existing manual cases carry domain knowledge nobody wrote down, so someone has to sort which are runnable and resolve ambiguous expectations before an agent turns them into code. Second, data: a refund test depends on payment method, subscription state, and permissions, and the result has to carry the dataset version and row so a reviewer can reproduce a failure. Third, the meaning of a result across runs and frameworks: which tests were expected, which were selected and completed, which passed only after retry, and which failed because of the environment or the model provider. The [e2e Playwright migration guide](https://github.com/tester-army/e2e/blob/e2e%400.17.0/docs/migrate/playwright.mdx) is candid about its own gaps here too, including native HTML reporting and pixel-diff snapshots. ## e2e as a runner in the True flow The natural fit is e2e as one more execution lane under a shared record. Engineers keep writing e2e tests in their repo and running them in CI. QA keeps reviewed, [versioned test cases](https://docs.katalon.com/katalon-platform/create-tests/manage-test-case-versions) and requirement links in True, next to Run with AI, Katalon Studio, Playwright, and manual runs. True's [Report Uploader](https://docs.katalon.com/katalon-platform/integrations/ci-cd/report-uploader-integration) already accepts JUnit, which e2e emits, and the [MCP server](https://docs.katalon.com/katalon-platform/testops-mcp-server) can link those cases to ALM-synced requirements. The adapter's real job is preserving what the runner saw. In the e2e 0.17 [JUnit implementation](https://github.com/tester-army/e2e/blob/e2e%400.17.0/packages/e2e/src/report/junit.ts), a retry-pass becomes a passing testcase with a `flaky:` note, and an interrupted test becomes `` with an `interrupted:` message. That is a sensible choice for a generic format. An independent record should keep flaky and interrupted as states of their own. Completeness needs its own check too. The [CLI docs](https://github.com/tester-army/e2e/blob/e2e%400.17.0/docs/reference/cli.mdx) say a run that stops before its tests leaves the previous report files in place, and [reporter failures](https://github.com/tester-army/e2e/blob/e2e%400.17.0/docs/reference/reporters.mdx) never change the exit code. Reading back what was stored and reconciling it against what was expected to run is what turns an upload into validation. ## Regulated teams: BFSI and healthcare In banking, insurance, and healthcare, independent validation is a requirement. Auditors and regulators ask, months after the release, which requirement a test proved, who approved the expected behavior, which test version ran on which build, and who signed off. With AI steps, they add which model made the judgment and what path the agent took. Katalon builds True Platform for these teams. The [banking and financial services page](https://katalon.com/banking-financial-services-software-testing) describes every edit, run, and result logged for audit and regulatory examination, traceability from each test to a requirement or Jira ticket, and SSO, SCIM, and RBAC. The [healthcare page](https://katalon.com/healthcare-software-testing) frames the same controls around HIPAA, HITECH, and keeping PHI out of test environments, with [insurance](https://katalon.com/insurance-software-testing) and [public sector](https://katalon.com/government-and-public-sector-software-testing) versions alongside. [Katalon's security page](https://katalon.com/security) lists ISO/IEC 27001, 27017 and 42001 certification and a SOC 2 Type II attestation, with more in the [trust center](https://trust.katalon.com). A vendor certification covers the vendor's own controls. The validation process still belongs to the customer, and imported results only inherit an audit trail if the adapter keeps case links, attempts, and evidence intact. ## A pilot worth running Take one important journey with several data variants, run it through e2e, record it in True, and break it on purpose: | Injected condition | What must be true in True afterward | |---|---| | Real product defect | Failed, linked to the right case and row | | Environment error | Distinguishable from a product failure | | Pass only on retry | Marked flaky | | Run interrupted | Incomplete, separate from skipped-by-choice | | Test file renamed | Case link survives | | Same report uploaded twice | No duplicates | | Auditor starts from a requirement | Reaches the run, row, and evidence without an engineer | Credit where it is due: TesterArmy made agentic testing feel like ordinary engineering, which is the hardest part to get right. The next step for the industry is making those results trustworthy to people who never saw the code. e2e as the runner and [Katalon True Platform](https://katalon.com/platform) as the independent record is a combination I would like to see proven.