Role overview
Build the quality engineering foundation for a product area, enabling engineering teams to deliver reliable software with confidence. The role combines test architecture, automation frameworks, CI/CD quality controls, and post-release monitoring, while also applying structured evaluation and safeguards to AI-assisted testing and AI-powered features.
Responsibilities
- Design reusable Playwright-based automation frameworks and quality infrastructure that engineers across teams can use.
- Own the CI/CD test pipeline, including parallel execution, test stability targets, artifact collection, and post-deployment monitoring.
- Define test strategy, coverage goals, risk-based priorities, test data practices, and isolated environments for dependable results.
- Apply contract, performance, synthetic, or resilience testing where product risks warrant it; track test health and detection metrics.
- Develop controlled AI-assisted testing workflows and evaluation and regression methods for features with variable outputs.
- Improve release gates, lead quality reviews after incidents, and work with product, platform, and customer teams to address systemic issues.
Requirements
- 4-7 years of software or test engineering experience and a bachelor's degree in computer science, engineering, or a related field.
- Demonstrated ability to design Playwright automation frameworks adopted by other engineers.
- Experience owning CI/CD quality pipelines, including parallelization, flaky-test management, and post-release monitoring.
- Ability to set a test strategy for complex systems using risk priorities and measurable quality indicators.
- Practical AI skills: write specifications with acceptance checks, evaluate agent output against evidence, and track work outside an agent's context.
- Strong analytical and problem-solving skills.
Nice to have
- Experience with agent-based testing harnesses, CI evaluation suites, and reusable checks based on prior failures.
- Background in AI evaluation, contract testing, synthetic monitoring, chaos engineering, or performance and load testing.
- Experience mentoring test engineers or improving quality practices across teams; familiarity with common issue-tracking or test-management tools.
Benefits and work setup
- The listing describes the position as remote.