Staff Test & Release Engineer, Inference Cloud

Showcify, Inc.; United States; In loco; USD 150.000 - 210.000; Tempo pieno

Descrizione del lavoro

d-Matrix is seeking a Staff Test & Release Engineer, Inference Cloud, to own end-to-end testing and release for our inference deployments. You will work with hardware accelerators (GPU, Corsair) and Azure-hosted components, building scalable test infrastructure and defining robust release criteria against platform changes.

You will design CI/CD pipelines, manage canaries and rollout strategies, and collaborate with QE, product, and platform teams to ensure reliable, fast releases.

Competenze

• 6+ years in test infrastructure, software engineering in test, release engineering, or a closely related role.
• Track record of building test or release automation that measurably improved release reliability or speed.
• Experience running test and release infrastructure across on-premises clusters and a public cloud, preferably Azure (AKS, Azure DevOps or GitHub Actions on Azure, Azure networking and identity).
• Strong Kubernetes experience, including deploying and debugging multi-service workloads, Helm, operators and custom resources, and automated test cluster setup and teardown.
• Experience designing CI/CD pipelines (GitLab CI, GitHub Actions, Buildkite, or Argo), including artifact versioning, environment promotion, and rollback.
• Proficiency in Python and pytest or a comparable framework, plus fluency in a second language sufficient to read and test the code under qualification (Rust).
• Experience testing on shared, limited hardware such as GPU or accelerator fleets, accounting for scheduling, contention, and hardware faults.

Mansioni

• Design and build end-to-end test infrastructure for Inference Cloud that stands up homogeneous and heterogeneous inference deployments on demand, runs tests against them, and tears them down.
• Turn user stories and acceptance criteria into automated end-to-end tests, including failure cases such as invalid API keys, unavailable endpoints, and failed draft nodes.
• Bring real hardware into CI by running tests on GPU and Corsair nodes, scheduling fairly on a limited shared pool, and owning test-signal quality, including flaky tests and fast routing of failures to the right owner.
• Own the release strategy for the orchestration platform, Kubernetes tooling, and benchmarking tools, including versioning, cadence, branching, promotion, rollback, release notes, and go/no-go criteria.
• Lead the move from a single platform-wide release to independently released components, defining the component breakdown, cadence, versioning, and compatibility and upgrade testing with platform architects.
• Define release gates covering functional tests, upgrade and compatibility tests, model accuracy evals, and performance baselines (time to first token, time per output token, throughput).
• Partner with QE, product, platform, and infrastructure teams on a shared test strategy, and push for acceptance criteria specific enough to test.
• Enable feature engineers to write and own tests for their own work.

Conoscenze

Test infrastructure

Release automation

Distributed systems

Kubernetes

Python

CI/CD

Azure

Strumenti

AKS

Azure DevOps

GitHub Actions

Helm

Argo

Envtest

Descrizione del lavoro

d-Matrix is seeking a Staff Test & Release Engineer, Inference Cloud, to own end-to-end testing and release for our inference deployments. You will work with hardware accelerators (GPU, Corsair) and Azure-hosted components, building scalable test infrastructure and defining robust release criteria against platform changes.

You will design CI/CD pipelines, manage canaries and rollout strategies, and collaborate with QE, product, and platform teams to ensure reliable, fast releases.