Senior AI Test Engineer – Voice & API Platforms

Deepgram; Northern (KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Deepgram is seeking a Software Test Engineer to design, build, and maintain automated test frameworks and exploratory test suites across our products, models, APIs, and data platforms. You translate product requirements and model metrics into automated regression tests, evaluation pipelines, data-quality gates, load tests, and release criteria, partnering with QA, Research, Product, Data, and Engineering.

When issues arise, you provide precise reproduction steps and supporting data, and you help

Qualifications

• BS, MS, or PhD in Computer Science, AI, Applied Math, or related field, or equivalent experience.
• 5+ years of professional software or QA engineering experience, with a track record of shipping test infrastructure or evaluation systems.

Responsibilities

• Define and execute well-designed test plans across products, APIs, SDKs, model-powered features, and data platforms.
• Design, build, and maintain automated test suites and frameworks for functional, integration, end-to-end, and performance testing.
• Translate requirements into test strategies, test cases, and release gates.
• Build representative, real-world test data, fixtures, and environments for edge cases and adversarial inputs.
• Validate model-powered behavior (speech-to-text, text-to-speech, etc.) using metrics and human review.
• Develop test infrastructure, harnesses, scripts, data tooling, dashboards, and release-readiness reporting.
• Integrate automated tests and canaries into CI/CD for continuous regression detection.
• Collaborate with Engineering, Product, Research, Data, Infrastructure, and DevOps to ensure test coverage.

Skills

Python

Rust

Go

Education

BS/MS/PhD in Computer Science or related field

Job description

Deepgram is seeking a Software Test Engineer to design, build, and maintain automated test frameworks and exploratory test suites across our products, models, APIs, and data platforms. You translate product requirements and model metrics into automated regression tests, evaluation pipelines, data-quality gates, load tests, and release criteria, partnering with QA, Research, Product, Data, and Engineering.

When issues arise, you provide precise reproduction steps and supporting data, and you help