Test Frameworks & Tooling Engineer II — CI/CD Automation

Klaviyo

Boston (MA)

On-site

USD 116,000 - 174,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Klaviyo is looking for a Test Frameworks and Tooling Engineer to own and enhance our integration and end-to-end testing frameworks across backend and frontend stacks. You will optimize CI/CD pipelines and help define repository standards to ensure high-quality code.

The role emphasizes AI-driven quality, data mocking, and scalable coverage with impact on production stability, while enabling collaboration across teams in a fast-paced ecommerce tech environment.

Qualifications

  • 2+ years of software engineering experience with a focus on writing clean, maintainable code.
  • You are a Quality Advocate who understands testing is a fundamental part of the development lifecycle.
  • You are comfortable across the stack, debugging React components and Python integration tests.

Responsibilities

  • Own and enhance integration and end-to-end testing frameworks across backend and frontend stacks.
  • CI/CD integration: optimize test execution feedback loops within the CI system.
  • Establish standards for repositories and ensure consistent unit tests and quality metrics.
  • Develop tools for scalable data mocking and service isolation for high-fidelity coverage.
  • Lead AI-driven quality initiatives for automated regression detection and flaky-test analysis.
  • Collaborate with feature teams to improve coverage and reduce gaps in safety nets.
  • Monitor test suites and CI pipelines to maintain a stable, performant engineering environment.

Skills

Analytical Problem Solver
Ownership Mindset
Quality Advocate
Technical Generalist
AI-Forward Thinker
CI/CD Familiarity

Tools

Python
Django
Go
React
TypeScript
JavaScript
Playwright
Cypress
Pytest
Jest
AWS
Kubernetes
Terraform
Helm
Buildkite
MySQL
Redis
Kafka
Claude
Cursor
Copilot

Job description

Klaviyo is looking for a Test Frameworks and Tooling Engineer to own and enhance our integration and end-to-end testing frameworks across backend and frontend stacks. You will optimize CI/CD pipelines and help define repository standards to ensure high-quality code.

The role emphasizes AI-driven quality, data mocking, and scalable coverage with impact on production stability, while enabling collaboration across teams in a fast-paced ecommerce tech environment.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Lead Software Engineer: CI/CD Platform
Lead Software Engineer: CI/CD Platform

Klaviyo Inc. • Boston (MA), Northern (KY)

Hybrid
USD 176,000 - 264,000
Software Engineer II, Test Frameworks & Tooling
Software Engineer II, Test Frameworks & Tooling

Klaviyo • Boston (MA)

On-site
USD 116,000 - 174,000
Lead CI/CD Platform Architect — AI-Driven
Lead CI/CD Platform Architect — AI-Driven

Showcify • Boston (MA)

On-site
USD 176,000 - 264,000
Senior QA Automation Engineer — AI-Driven Testing & CI/CD
Senior QA Automation Engineer — AI-Driven Testing & CI/CD

Fulcronix • Denver (CO)

On-site
USD 110,000 - 160,000
Senior Test Automation Engineer — Frameworks & CI/CD
Senior Test Automation Engineer — Frameworks & CI/CD

Viasat • Carlsbad (CA)

On-site
USD 140,000 - 261,000
Lead Software Engineer, CI/CD & Developer Infra
Lead Software Engineer, CI/CD & Developer Infra

Klaviyo Inc. • Boston (MA)

On-site
USD 176,000 - 264,000
Remote Backend Test Engineer II - Automation & CI
Remote Backend Test Engineer II - Automation & CI

Affirm • Phoenix (AZ)

On-site
USD 146,000 - 206,000
Health coverage
Flexible Spending Wallets
Time off
+1
Backend Test Automation Engineer – Remote
Backend Test Automation Engineer – Remote

Affirm • United States

On-site
USD 140,000 - 190,000
Lead QA Automation Engineer — Frameworks & CI/CD
Lead QA Automation Engineer — Frameworks & CI/CD

RXinsider LTD. • New York (NY), Northern (KY)

Hybrid
USD 90,000 - 110,000
Paid time off
Medical insurance
Dental insurance
+5
QA Automation Engineer — Playwright & CI/CD Specialist
QA Automation Engineer — Playwright & CI/CD Specialist

Intapp • Charlotte (NC), Northern (KY)

Hybrid
USD 90,000 - 120,000
Complimentary lunches
Fully stocked kitchens
Paid volunteer time off