Senior ML Ops Engineer: Scale AI Training on Kubernetes

Energy Jobline ZR; Phoenix (AZ); À distance; USD 184 000 - 272 000; Plein temps

Avantages offerts par ce poste

Health and Wellness benefits (Medical,

Unlimited Vacation

Flexible hours and Work from Home

Daily snacks and catered meals

Team events on-site/off-site/virtual

Résumé du poste

Waabi is seeking a senior software/infrastructure engineer to build and evolve training infra on Kubernetes, emphasizing GPU scheduling, autoscaling, and multi-node jobs. You’ll craft developer-facing surfaces, APIs, and CLIs, and enhance end-to-end experiment workflows.

You will collaborate with researchers and engineers to produce reliable, measurable, and fast tooling, ensuring production-grade systems with security best practices.

Qualifications

• 5+ years in software or infrastructure engineering.
• Excellent Python and API/CLI design experience.
• Hands-on Kubernetes expertise with GPU scheduling and multi-node runs.
• Experience with ML tooling, experiments, and model registries.
• Strong collaboration and written communication.

Responsabilités

• Build and evolve training infra on Kubernetes: GPU scheduling, autoscaling, multi-node jobs.
• Shape developer-facing surfaces: CLIs, SDKs, job submission, templates.
• Shorten inner loop: faster iteration from code to experiment results.
• Promote tooling with prototypes and migration paths.
• Strengthen data layer: dataset versioning and high-throughput loading.
• Turn Python scripts into durable tooling with tests and docs.
• Make experiments legible: dashboards, model registry, lineage.
• Ship CI/CD for models alongside autonomy and simulation.
• Build observability across the ML stack: utilization, throughput, failures.
• Treat docs and onboarding as product surface to reduce friction.
• Drive adoption via real-user feedback and incremental improvements.
• Increase platform reliability with guards and security controls.

Connaissances

Python

Collaboration

System design

DevEx/Developer experience

Autonomy

Outils

Kubernetes

Terraform/Pulumi

PyTorch

AWS

CI/CD

Description du poste

Waabi is seeking a senior software/infrastructure engineer to build and evolve training infra on Kubernetes, emphasizing GPU scheduling, autoscaling, and multi-node jobs. You’ll craft developer-facing surfaces, APIs, and CLIs, and enhance end-to-end experiment workflows.

You will collaborate with researchers and engineers to produce reliable, measurable, and fast tooling, ensuring production-grade systems with security best practices.