Visual Regression Testing
Quick Reference
What & Why
Definition
>= 60% of user-facing pages have automated visual regression tests (Percy, Chromatic) catching UI issues.
Business Value
Catches performance regressions 100% of the time before production and reduces visual bugs by 90% through automated regression testing Achieving >= 60% pages visual regression tested is a key milestone toward this goal.
Context
This capability is part of the Acceleration milestone's focus on scale automation, embed compliance, improve speed & reliability. Essential for teams targeting CFR, LT improvements.
Success Criteria
Target
>= 60% pages visual regression tested
Measurement
Visual test coverage across pages
Evidence
- Percy/Chromatic config
- Visual diff reports
- Approved baseline screenshots
In Practice
Real-World Implementation
Teams capture screenshots of pages in CI, compare to approved baselines, flag diffs for review. Approve or reject visual changes.
Concrete Example
Implementation Guide
Implementation Steps
Follow the measurement approach: Visual test coverage across pages
For detailed step-by-step guidance, refer to the Advanced Testing & Performance Validation Implementation Kit.
Resources
Implementation Kit
Advanced Testing & Performance Validation KitTemplates
Browse all templatesRelated Resources
View learning pathsRelated Capabilities
Complementary
Often adopted together, from the Advanced Testing & Performance Validation epic
Troubleshooting & FAQs
Common Issues
Issue: Target metric not improving
Solution: Verify measurement is accurate, check if prerequisites are fully implemented, review evidence artifacts for completeness
Issue: Team resistance to adoption
Solution: Start with pilot team, demonstrate value with metrics, provide training and support during transition
Issue: Inconsistent implementation across teams
Solution: Create shared templates and guidelines, establish regular sync meetings, use automation to enforce standards
Frequently Asked Questions
Can we implement this before completing prerequisites?
While possible, it's not recommended. Prerequisites ensure foundational practices are in place, making this capability more effective and easier to adopt.
How long does implementation typically take?
Most capabilities can be implemented within 90 days when tackled as part of the Acceleration milestone. Individual timelines vary based on team size and existing practices.