Software Engineer, Test Frameworks and Tooling | Klaviyo

The Briefed; Boston (MA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Annual bonus

Equity or sign-on payments

Comprehensive health benefits

Job summary

The Briefed in Boston is seeking a software engineer focused on test frameworks and tooling. You will own and expand end-to-end testing across backend and frontend stacks, improve CI feedback times, and help set standards for unit testing and code quality.

You will build tools to simplify complex testing scenarios, backfill coverage gaps with data mocking and service isolation, and explore AI-driven testing techniques to detect regressions and analyze flaky tests.

Qualifications

• 2+ years of software engineering experience with a focus on clean, maintainable code.
• Strong debugging and root-cause analysis skills with a habit of systemic fixes.
• Comfort across the stack: React components in E2E tests to Python integration tests.
• Experience with CI/CD tools and how automated testing fits into modern deployment pipelines.

Responsibilities

• Own and enhance integration and end-to-end testing frameworks across backend and frontend stacks, keeping them fast, reliable, and easy for other teams to adopt
• Optimize how tests run in CI so engineers get feedback in minutes
• Help define repository standards for writing unit tests and measuring code quality
• Develop tools that simplify complex testing scenarios, and backfill critical coverage gaps at scale with data mocking and service isolation
• Lead efforts to apply AI to testing, including automated regression detection, flaky test analysis, and intelligent test generation
• Partner with feature teams to troubleshoot flaky tests and close coverage gaps
• Monitor the health of test suites and CI pipelines to keep the environment stable and performant

Skills

Analytical problem solving

Ownership mindset

Quality advocacy

Collaboration

Tools

Python

Django

Go

React

TypeScript

JavaScript

Playwright

Cypress

Pytest

Jest

AWS

Kubernetes

Terraform

Helm

Buildkite

MySQL

Redis

Kafka

Claude

Cursor

Copilot

Job description

Klaviyo’s Test Frameworks and Tooling team builds the automation and CI/CD frameworks that make deploying to production a non-event. They are infrastructure engineers, not testers, creating the systems, repository standards, and automated guardrails that let every engineer ship quickly and confidently. In this role, you will help drive Sev-1 incidents toward zero by building tools that hundreds of engineers use every day.

Key Responsibilities

• Own and enhance integration and end-to-end testing frameworks across backend and frontend stacks, keeping them fast, reliable, and easy for other teams to adopt
• Optimize how tests run in CI so engineers get feedback in minutes
• Help define repository standards for writing unit tests and measuring code quality
• Develop tools that simplify complex testing scenarios, and backfill critical coverage gaps at scale with data mocking and service isolation
• Lead efforts to apply AI to testing, including automated regression detection, flaky test analysis, and intelligent test generation
• Partner with feature teams to troubleshoot flaky tests and close coverage gaps
• Monitor the health of test suites and CI pipelines to keep the environment stable and performant

Requirements

• 2+ years of software engineering experience with a focus on clean, maintainable code
• Strong debugging and root-cause analysis skills, with a habit of implementing systemic fixes
• Comfort working across the stack, from React components in E2E tests to Python integration tests
• Experience with, or a strong desire to learn, CI/CD tools and how automated testing fits into a modern deployment pipeline
• Education: Not specified

Skills

Technical Skills

• Backend: Python, Django, Go
• Frontend: React, TypeScript, JavaScript
• Testing Frameworks: Playwright, Cypress, Pytest, Jest
• Infrastructure and CI: AWS, Kubernetes, Terraform, Helm, Buildkite
• Data: MySQL, Redis, Kafka
• AI Tools: Claude, Cursor, Copilot, or internal AI enablement frameworks

Soft Skills

• Analytical problem solving
• Ownership mindset and initiative
• Quality advocacy
• Collaboration with feature teams

Benefits

• Total compensation may include an annual cash bonus, equity, and sign-on payments, depending on eligibility
• Comprehensive health, welfare, and wellbeing benefits