Senior AI Test Engineer – Automation & QA for Voice Tech

Deepgram; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Deepgram, a leading voice AI platform in the United States, seeks a Software Test Engineer to design and maintain automated test frameworks across products, models, APIs, and data platforms. You will develop regression tests, build robust test suites, and ensure high-quality releases through close collaboration with QA, Research, Product, Data, and Engineering teams.

You will translate product requirements into test strategies, create representative test data, and validate model-powered features

Qualifications

• BS, MS, or PhD in Computer Science, AI, Applied Math, or related field, or equivalent experience.
• 5+ years of professional software or QA engineering experience, with a track record of shipping test infrastructure or evaluation systems.
• Solid backend/scripting experience in Python, Rust, Go, or similar.
• Experience designing and building automated test pipelines, evaluation frameworks, or data-processing systems.
• Strong analytical skills and comfort reasoning about metrics, thresholds, and statistical variation in results.
• Ability to take charge of ambiguous technical challenges and communicate effectively across teams.

Responsibilities

• Define and execute well-designed test plans across products, APIs, SDKs, model-powered features, and data platforms to ensure robustness and performance.
• Design, build, and maintain automated test suites and frameworks for functional, integration, end-to-end, regression, API, browser, and service-level testing across batch and streaming workflows.
• Translate requirements into clear test strategies, repeatable test cases, and enforceable release gates.
• Build and maintain representative, customer-focused, and adversarial test datasets and environments.
• Validate model-powered behavior (speech-to-text, text-to-speech, and AI features) using metrics, human review, and regression coverage.
• Build testing infrastructure, including harnesses, scripts, data tooling, dashboards, and release-readiness reporting.
• Integrate automated tests, quality checks, canaries, and release validation into CI/CD pipelines.
• Collaborate with Engineering, Product, Research, Data, Infrastructure, and DevOps to understand system behavior and deployment risks.
• Test data ingestion, processing, annotation, and quality-control workflows for data integrity and representativeness.
• Execute staging and production validation, load testing, cross-browser and customer-workflow testing, and user acceptance testing with stakeholders.
• Maintain the test-case repository and ensure clear visibility of coverage and risks.
• Write precise, actionable bug reports with reproducible steps and data; participate in triage.
• Contribute to code reviews and test-design discussions to elevate QA practices.

Skills

Python

Rust

Go

Test automation

QA engineering

Data pipelines

Metrics analysis

Debugging

Education

BS in Computer Science

MS/PhD in CS

Tools

Jenkins

Git

CI/CD

Test harnesses

Job description

Deepgram, a leading voice AI platform in the United States, seeks a Software Test Engineer to design and maintain automated test frameworks across products, models, APIs, and data platforms. You will develop regression tests, build robust test suites, and ensure high-quality releases through close collaboration with QA, Research, Product, Data, and Engineering teams.

You will translate product requirements into test strategies, create representative test data, and validate model-powered features