Senior Quality Assurance Engineer

Insight Global (United States)

Atlanta (GA)

On-site

USD 90,000 - 130,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Insight Global is seeking an experienced QA Engineer to own the verification stage after builds, provisioning environments and deploying artifacts for release decisions. You will test backend APIs, ensure API compatibility, and build end-to-end Playwright coverage against deployed environments.

You will gate releases of shared services, manage test environments, and drive secure, scalable testing across nondeterministic systems. Collaboration and clear communication are essential to succeed.

Qualifications

  • 5+ years in software quality engineering or related field, including 3+ years building automated Python test suites.
  • Strong API testing experience against HTTP services with authentication, streaming and timeouts.
  • Deep pytest experience with fixtures, parametrization, async tests, and large, fast, comprehensible suites.
  • Experience testing deployed software from outside the repository; API compatibility and schema drift testing.
  • CI/CD experience, ideally with GitHub Actions; post-build verification stages and release gates.
  • Experience provisioning containerized test environments (Testcontainers, Docker Compose).
  • Ability to reason about nondeterministic systems and manage flakiness in AI or distributed pipelines.
  • Ability to read unfamiliar production code and identify real risk areas; strong debugging in async/distributed contexts.
  • Clear written communication and actionable defect reports; collaborate with engineers on testability.

Responsibilities

  • Own the verification stage after a build: provision the environment, deploy the artifact, run tests, and produce the release decision.
  • Test backend services as black box across APIs (routing, failover, retries, timeouts, rate limits, error mapping).
  • Build API compatibility coverage to catch breaking schema changes.
  • Create end-to-end Playwright coverage against deployed environments: SSO, streaming, long-running generation, and document verification.
  • Gate releases of shared services and libraries to ensure safety before shipping.
  • Manage test environments: containerized dependencies, seeded data, isolation, teardown.
  • Add performance and load coverage for streaming endpoints and long-running jobs.
  • Test security-relevant behavior at service boundaries: auth, session handling, CSRF protection, RBAC, tenant isolation, content handling.
  • Run quality measurement of model output on a schedule and report trends over time.
  • Maintain a trustworthy suite: flake detection, clear diagnostics, actionable failures.
  • Triage external defects: reproduce, narrow, and provide failing cases for owners.
  • Set verification standards that downstream services inherit and document them clearly.

Skills

Python
API testing
Debugging asynchronous systems
Test automation
Communication

Tools

pytest
Testcontainers
Docker Compose
GitHub Actions

Job description

Key Responsibilities:
  • Own the verification stage that runs after a build — provision the environment, deploy the artifact under test, run the suite against it, and produce the result a release decision rests on.
  • Test backend services as a black box across their APIs, covering request routing and provider failover, streaming integrity and early termination, retries and backoff, timeout semantics, rate-limit handling, error mapping, and usage accounting.
  • Build API compatibility coverage against each service's published surface, so that a breaking schema change is caught before the applications consuming it are.
  • Build end-to-end coverage with Playwright against deployed environments: single sign-on, streamed responses, long-running generation, and verification of the files and documents the system produces.
  • Gate releases of shared services and libraries against the applications that depend on them, proving an upgrade is safe before it ships rather than after.
  • Own the test environments — containerized dependencies, seeded data, isolation between runs, and teardown — so that a suite result means the same thing every time it runs.
  • Add performance and load coverage for streaming endpoints, concurrent sessions, long-running jobs, and document conversion.
  • Test security-relevant behavior at the service boundary: authentication and session handling, cross-site request forgery protection, role- and resource-level access control, tenant isolation, and the safe handling of generated content.
  • Run quality measurement of model output on a schedule and report how it moves over time — engineering defines what good looks like, and you make it run, gate where appropriate, and surface the trend.
  • Keep the suite trustworthy: flake detection and quarantine, clear failure diagnostics, and reporting the team acts on rather than ignores.
  • Triage defects found from the outside — reproduce them, narrow them, and hand them back with a failing case the owning engineer can run.
  • Set the verification standard that later services and applications inherit, and document it well enough that another team can adopt it without you.
Required Qualifications:
  • 5+ years in software quality engineering, test automation, or software engineering with a testing focus, including 3+ years building automated test suites in Python.
  • Strong API testing experience against running HTTP services — authentication, streaming and server-sent events, pagination, error and timeout behavior — and fluency asserting at the wire level.
  • Deep, practical pytest experience — fixtures, parametrization, async tests, plugins, and structuring a large suite so that it stays fast and comprehensible.
  • Experience testing deployed or packaged software from the outside, rather than only from inside the repository that builds it.
  • Experience with API compatibility and schema-drift testing — detecting a breaking change to a published interface before its consumers do.
  • CI/CD engineering experience, ideally with GitHub Actions — pipeline design, post-build verification stages, release gates, caching, parallelization, and keeping a suite trustworthy enough to leave blocking.
  • Experience provisioning containerized environments for testing, using Testcontainers, Docker Compose, or an equivalent, including databases and backing services.
  • Has tested systems that do not have a single correct answer — machine learning output, search or recommendation relevance, data quality, OCR or speech pipelines, or genuinely nondeterministic distributed systems — and can explain how you kept assertions meaningful and managed flakiness.
  • Able to read an unfamiliar production codebase and form your own judgment about where the real risk sits, rather than testing what is easiest to test.
  • Strong debugging judgment for asynchronous and distributed systems, including failures that only appear in deployed environments.
  • Clear written communication — test failures that explain themselves, defect reports engineers can act on, and strategy documents that get adopted.
  • Has worked alongside the engineers who own the code under test, and can make the case for testability changes without friction.
Preferred Qualifications:
  • Experience testing LLM-backed or agentic applications — scripted model responses, golden datasets, and regression gates on quality scores.
  • Experience testing an API gateway, proxy, or similar pass-through service, including multi-provider routing and failover behavior.
  • Familiarity with observability and tracing tooling for AI or distributed systems.
  • Performance and load testing with k6, Locust, or similar, against streaming or long-running endpoints.
  • Experience verifying generated documents programmatically, including presentation, PDF, or HTML output.
  • Working knowledge of React and TypeScript, enough to add stable test hooks and write component-level tests.
  • Visual regression testing, including the practicalities of keeping it stable over time.
  • Treats static analysis and type checking as part of the quality picture — linters, type checkers, and architectural or import rules enforced in CI.
  • Experience as the first dedicated quality hire on a team, establishing standards from scratch.
  • Exposure to vector or graph databases in a testing context.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Quality Engineer – Data Platform
Senior Quality Engineer – Data Platform

Millennium Global Technologies • Dallas (TX)

On-site
USD 110,000 - 160,000
Senior Staff SDET (Customer Engineering)
Senior Staff SDET (Customer Engineering)

Hims & Hers Health, Inc. • United States

Remote
USD 180,000 - 240,000
Generous PTO
Full healthcare
401(k) with matching
+1
Python QA
Python QA

R Systems • Dallas (TX)

On-site
USD 110,000 - 180,000
Senior Quality Engineer
Senior Quality Engineer

Compunnel Inc. • New Jersey

On-site
USD 90,000 - 120,000
Quality Engineer AI Test Automation
Quality Engineer AI Test Automation

Five Data Products And Solutions • United States

Remote
USD 110,000 - 160,000
Software Engineer in Test
Software Engineer in Test

Ascendum Solutions • Cincinnati (OH)

On-site
USD 120,000 - 170,000
Senior Quality Assurance Engineer
Senior Quality Assurance Engineer

BusRight Inc. • Raleigh (NC)

On-site
USD 110,000 - 150,000
Quality Assurance Engineer
Quality Assurance Engineer

Complete Farmer LTD • Texas

On-site
USD 11,000 - 14,000
Quality Engineer
Quality Engineer

Upshop • Austin (TX)

On-site
USD 120,000 - 180,000
Senior Quality Assurance Engineer
Senior Quality Assurance Engineer

BusRight • New York (NY)

On-site
USD 125,000 - 180,000