Software Engineer in Test

Zof AI; San Francisco, Northern (CA, KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Zof AI in San Francisco, CA is seeking a Software Engineer in Test to build robust test frameworks and CI gates for our AI agent platforms.

You will design end-to-end test strategies, reduce flaky tests, and collaborate with product and engineering to improve release quality. This mid-level, on-site role offers hands-on testing across browser automation, unit, and integration layers.

Qualifications

• Experience writing automated tests for production software.
• Working knowledge of a browser automation framework (Playwright, Cypress, or Selenium).
• Ability to write clean code in Python, TypeScript, or Java.
• Understanding of CI pipelines and how tests gate a release.
• Instinct for distinguishing real failures from flaky tests.
• Clear written and verbal communication; comfortable in a fast-moving environment.

Responsibilities

• Design and maintain end-to-end test frameworks using Playwright, Cypress, or Selenium.
• Build unit and integration coverage with pytest or Jest.
• Eliminate flaky tests to keep the suite trustworthy.
• Own coverage strategy across unit, integration, and end-to-end levels.
• Integrate test suites into CI gates that block defects before release.
• Reproduce reported bugs as tight, deterministic tests.
• Collaborate with engineering and product to raise the bar on quality.
• Teach our agent fleets how a strong test engineer reasons and works.
• Must work with AI agents daily to write, maintain, and scale test coverage.

Skills

Automated testing

Playwright/Cypress/Selenium

Python/TypeScript/Java

CI pipelines

Flaky test diagnosis

Code comprehension

Clear communication

Fast-moving environment

Tools

Playwright

Cypress

Selenium

pytest

Jest

Job description

Zof AI is seeking a Software Engineer in Test to bring real test-engineering craft to the agent fleets that find, reproduce, and remediate defects in customer codebases. This role owns the practice our product automates: framework design, flake elimination, coverage strategy, and CI gates that engineering teams actually trust. If you have worked as an SDET, Test Automation Engineer, Quality Engineer, or Software Engineer in Test, this is that discipline at Zof AI. The ideal candidate has built suites that held up against messy real codebases and wants to encode that judgment into agents doing the same work at scale.

Engineering · Mid-level · Full-time · On-site · San Francisco, CA

Responsibilities

• Design and maintain end-to-end test frameworks in Playwright, Cypress, or Selenium.
• Build unit and integration coverage using pytest, Jest, and similar tooling.
• Hunt down and eliminate flaky tests so the suite stays trustworthy.
• Own coverage strategy across the unit, integration, and end-to-end layers.
• Wire suites into CI with gates that block real defects before release.
• Reproduce reported bugs as tight, deterministic failing tests.
• Teach our agent fleets how a strong test engineer reasons and works.
• Partner with engineering and product to raise the bar on what ships.

Requirements

• Experience writing automated tests for production software.
• Working knowledge of a browser automation framework such as Playwright, Cypress, or Selenium.
• Ability to write clean code in a language like Python, TypeScript, or Java.
• Understanding of CI pipelines and how tests gate a release.
• Instinct for the difference between a real failure and a flaky one.
• Comfort reading unfamiliar code well enough to test it.
• Clear written and verbal communication.
• Comfort operating in a fast-moving environment.

Nice to have

• Experience building test infrastructure, fixtures, or test data tooling.
• Experience testing APIs, mobile apps, or performance and load scenarios.
• Experience defining quality metrics and reporting them to engineering leadership.
• Experience with eval or benchmark harnesses for AI systems.

Must work with AI agents daily to write, maintain, and scale test coverage