Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance. - Design and execute test plans covering AI model outputs, data correctness, and application functionality.
- Create automated tests for APIs and UI where appropriate; maintain regression suites.
- Validate business logic, edge cases, and non-functional requirements (performance, reliability).
- Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
- Triage defects, document reproducible steps, and partner with engineers to resolve issues.
- Contribute to release readiness, quality gates, and continuous improvement of testing practices.