Testaro - Ensemble Quality Reporting
Node.js and Playwright-based ensemble testing/reporting work associated with CVS Health and published at ACM SIGACCESS ASSETS 2023. Testaro checks about 650 rules across 8 tools and generates unified reports across fragmented tool outputs.
What this project proves
Quality platform and reporting infrastructure
Node.js and Playwright-based ensemble quality tooling connected to ASSETS 2023, covering about 650 rules across 8 tools.
Core challenge
Consolidate fragmented tool outputs into one reportable, repeatable workflow.
Evaluation lens
Aggregation, reporting, and shift-left quality enforcement.
A shared testing/reporting pattern credible enough for ACM ASSETS publication and org use.
Overview
Testaro is an open-source NPM package for ensemble browser-based quality testing. The public arXiv record describes it as checking about 650 rules across 8 tools: alfa, Axe, Equal Access, HTML CodeSniffer, Nu Html Checker, QualWeb, Testaro, and WAVE.
The strongest portfolio signal is the engineering pattern: unify several noisy testing tools into one reportable workflow that teams can operationalize. This is quality-platform work first: aggregation, normalization, repeatability, and reporting.
What I Owned
- Contributed to testing and reporting work around Testaro at CVS Health.
- Helped connect multi-tool findings to practical engineering workflows.
- Worked with Node.js, Playwright, axe-core, and browser-based rule evaluation.
Public Record
- Paper: Testaro: Efficient Ensemble Testing for Web Accessibility
- Venue: Proceedings of the 25th ACM International Conference on Computers and Accessibility (ASSETS ‘23)
- DOI: 10.1145/3597638.3614505
- Scope: about 650 rules across 8 tools, with unified reports designed to find more issues than a single tool alone.
Hard Problems Solved
- Normalize fragmented outputs: tools disagree in structure, coverage, terminology, and severity. A usable system needs one reporting layer.
- Make results actionable: raw findings are not enough; engineers need reports that can support review, remediation, and repeated testing.
- Shift quality checks earlier: ensemble testing is most valuable when it fits development workflows instead of remaining a one-off audit activity.
Key Features
- Multi-Tool Aggregation: Combines checks from several testing engines.
- Unified Reporting: Produces standardized reports over heterogeneous tool output.
- Browser-Based Testing: Uses automated browser execution for repeatable testing.
- Rule Coverage: Evaluates a large rule set across browser-based quality tools.
Why It Matters
Testaro shows platform-style engineering: consolidate fragmented testing signals, make them repeatable, and turn them into an output surface that teams can act on.
Tech Stack
- Runtime: Node.js
- Testing: Playwright, axe-core
- Domain: Browser-based quality evaluation
- Reporting: Unified ensemble reports