AI Test Engineer: Automation & QA

AI Chopping Block; California, Northern (MO, KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Deepgram is seeking a Software Test Engineer to design, build, and maintain automated test frameworks and exploratory test suites across our products, models, APIs, and data platforms.

You will translate product requirements into automated regression tests, evaluation pipelines, data-quality gates, load tests, and release criteria, partnering with QA, Research, Product, Data, and Engineering to plan testing and communicate risks clearly.

Qualifications

• BS, MS, or PhD in Computer Science, AI, Applied Math, or a related field, or equivalent experience.
• 5+ years of professional software or QA engineering experience, with a track record of shipping test infrastructure or evaluation systems.

Responsibilities

• Define and execute well-designed test plans across Deepgram's products, APIs, SDKs, model-powered features, and data platforms, ensuring production software is robust, reliable, and performs well.
• Design, build, and maintain automated test suites and frameworks for functional, integration, end-to-end, regression, API, browser, and service-level testing across batch and streaming workflows.
• Translate product requirements and customer acceptance criteria into clear test strategies, repeatable test cases, and enforceable release gates.
• Build testing infrastructure, including test harnesses, reusable scripts, test-data tooling, result-aggregation pipelines, dashboards, and visualizations that make quality signals easy to understand and act on.
• Integrate automated tests, quality checks, canaries, and release validation into CI/CD so regressions are detected continuously rather than through manual testing alone.
• Partner with Engineering, Product, Research, Data, Infrastructure, and DevOps to understand system behavior, dependencies, variations, performance limits, and deployment risks, and to establish appropriate test coverage.

Skills

Software testing

QA automation

Python

Rust

Go

Test pipelines

Analytics

Communication

Education

BS/MS/PhD in CS or related field

Tools

CI/CD tooling

Grafana

Job description

Deepgram is seeking a Software Test Engineer to design, build, and maintain automated test frameworks and exploratory test suites across our products, models, APIs, and data platforms.

You will translate product requirements into automated regression tests, evaluation pipelines, data-quality gates, load tests, and release criteria, partnering with QA, Research, Product, Data, and Engineering to plan testing and communicate risks clearly.