Software Test Engineer for AI Systems & Data Platforms

Apply; Northern (KY); Hybrid; USD 110,000 - 160,000; Full time

Job summary

Deepgram is seeking a Software Test Engineer to design, build, and maintain automated test frameworks across products, models, APIs, and data platforms. You will break systems, explore edge cases, and automate validation to catch regressions quickly.

You translate requirements and model metrics into automated tests, evaluation pipelines, and release criteria, partnering with QA, Research, Product, Data, and Engineering to plan testing and communicate risks clearly.

Qualifications

• 5+ years of professional software or QA engineering experience, including test infrastructure or evaluation systems.
• Strong backend/scripting experience in Python, Rust, Go, or similar.
• Experience designing and building automated test pipelines, evaluation frameworks, or data-processing systems.
• Solid analytical skills and comfort reasoning about metrics, thresholds, and statistical variation in results.
• Ability to take charge of ambiguous technical challenges and communicate effectively across teams.

Responsibilities

• Define and execute test plans across Deepgram's products, APIs, and data platforms to ensure robustness and performance.
• Design, build, and maintain automated test suites for functional, integration, end-to-end, regression, API, and cross-platform testing.
• Translate requirements into clear test strategies, repeatable test cases, and enforceable release gates.
• Build representative datasets and test environments that exercise real-world inputs and edge cases.
• Validate model-powered features using appropriate metrics, human review, and regression coverage.
• Develop testing infrastructure, including harnesses, tooling, dashboards, and data pipelines to surface quality signals.
• Integrate automated tests and release validation into CI/CD to catch regressions continuously.
• Partner with Engineering, Product, Research, Data, and DevOps to understand system behavior and establish coverage.
• Test data ingestion, processing, and quality-control workflows to ensure data integrity.
• Execute staging and production validation, load testing, and cross-browser testing in collaboration with stakeholders.
• Maintain the test-case repository and release-readiness reporting for visibility.
• Write precise bug reports with reproducible steps and assist in triage.
• Contribute to code reviews and test-design discussions to raise automation quality.

Skills

Software QA experience

Backend scripting (Python)

Go

Rust

Education

BS/MS/PhD in Computer Science or related field

Tools

Grafana

CI/CD tooling

Job description

Deepgram is seeking a Software Test Engineer to design, build, and maintain automated test frameworks across products, models, APIs, and data platforms. You will break systems, explore edge cases, and automate validation to catch regressions quickly.

You translate requirements and model metrics into automated tests, evaluation pipelines, and release criteria, partnering with QA, Research, Product, Data, and Engineering to plan testing and communicate risks clearly.