Staff Automation Engineer: AI/ML Testing for Autonomy

Shield; San Diego (CA); Presencial; USD 180.000 - 250.000; Jornada completa

Descripción de la vacante

Shield AI is seeking a Staff Automated Test Engineer to lead the Hivemind testing strategy for autonomous systems. You will architect scalable validation pipelines across ML models, simulation, and hardware-in-the-loop environments, while guiding cross-functional teams to raise the bar on quality and reliability.

The role emphasizes Python-based automation, end-to-end test coverage, GPU workloads testing in Kubernetes, and the creation of observability and failure-triage capabilities to support

Formación

• Typically 8+ years of relevant experience in software engineering, test infrastructure, developer tooling, MLOps, or similar.

Responsabilidades

• Own the technical strategy, architecture, and roadmap for automated testing, verification, and MLOps quality across the Hivemind ecosystem.
• Design and maintain scalable test frameworks for autonomy software, backend services, APIs, operator-facing applications, and distributed hardware environments.
• Lead functional, integration, regression, system, performance, reliability, and end-to-end testing across simulation, edge-compute, software-in-the-loop, and hardware-in-the-loop environments.
• Build automated ML validation pipelines covering data quality, training reproducibility, model accuracy, robustness, regression, latency, resource utilization, and system integration.
• Establish CI/CD and continuous training workflows that provide versioning and traceability for datasets, models, configurations, evaluation results, and deployment artifacts.
• Develop scenario-based validation for autonomy models, including edge cases, degraded sensing or communications, distribution shifts, and representative mission conditions.
• Create observability, analytics, and failure-triage capabilities for software behavior, model and data drift, inference health, test results, and production performance.
• Build Python automation that improves test execution, parallelization, reporting, environment setup, experiment comparison, and developer productivity.
• Create test harnesses, simulators, stubs, mocks, and synthetic data capabilities that improve system testability and coverage.
• Collaborate with software, autonomy, machine learning, data, simulation, and systems engineers to define verification strategies and improve designs before implementation.
• Develop and govern AI-assisted engineering workflows using coding agents and LLM-based tools for test generation, log analysis, debugging, and failure triage while maintaining security, reproducibility, and traceability.

Conocimientos

Python automation

CI/CD pipelines

MLOps

Kubernetes testing

GPU testing

Distributed systems

Test framework design

Automation tooling

Herramientas

Conan

pip

setuptools

Poetry

Nix

Descripción del empleo

Shield AI is seeking a Staff Automated Test Engineer to lead the Hivemind testing strategy for autonomous systems. You will architect scalable validation pipelines across ML models, simulation, and hardware-in-the-loop environments, while guiding cross-functional teams to raise the bar on quality and reliability.

The role emphasizes Python-based automation, end-to-end test coverage, GPU workloads testing in Kubernetes, and the creation of observability and failure-triage capabilities to support