Nova Act Applied to UX Testing
AWS ML Blog · rss · 2026-07-15
AWS introduced a new UX testing approach using Amazon Nova Act. Instead of traditional script-based automation, the model visually understands web pages and executes user flows.
The architecture consists of four layers:
- Document Processing Layer: Stores site documents, user guides, and process specs in S3 and Bedrock Knowledge Base, then uses Claude 4.5 Sonnet to translate user tasks into hierarchical test steps.
- Orchestration Layer: Uses DynamoDB to store flows and metadata, DynamoDB Streams to trigger batch processing, and Lambda to coordinate parallel tests.
- Execution Layer: Runs Nova Act agents on ECS/Fargate to execute user flows in parallel across multiple browser sessions.
- Analysis Layer: Saves inference logs, screenshots, and behavioral data, then uses Bedrock to calculate usability scores and identify friction points.
AWS also provided deployment instructions: one-click deployment via AWS CDK and a sample repo, followed by options to auto-generate, manually define, or use a hybrid approach to create test flows. The article emphasizes that this method can automatically generate baseline coverage from existing documentation, which can then be supplemented with critical and edge-case scenarios.
More from coding & agent
- HeyGen adds a media-sourcing skill for coding agents with 75k images and 10k tracks — HeyGen · 2026-07-22
- Agent search bottlenecks are now about variance, not raw latency — rohanpaul_ai · 2026-07-22
- LangSmith adds tracing for Pipecat, LiveKit, OpenAI Realtime, and Gemini Live — LangChain · 2026-07-22
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22
- Annotated transcript of a Claude Code team interview is now available — trq212 · 2026-07-22
- Claude Code skill uses 10 Markdown rules to make outputs ADHD-friendly — alex_verem · 2026-07-22