ML Cloud Infrastructure Engineer - Build Scalable ML Pipelines

HavocAI Inc.; United States; Remote; USD 120,000 - 170,000; Full time

Benefits offered by this job

Health, Dental & Vision 100% employer"

Life Insurance

401k with matching

Unlimited PTO

Equity package

Work/Home Office stipend

Global Entry

Parental leave

Wellness stipend

Job summary

HavocAI Inc. is seeking a Machine Learning Cloud Infrastructure Engineer to build and operate the ML infrastructure used to train, evaluate, deploy, and monitor models safely and reliably.

You will develop pipelines connecting data lakes, telemetry stores, simulation environments, training workloads, cloud compute, and deployed models, enabling teams to move from raw data to reproducible datasets and production deployments.

Qualifications

• 3+ years of experience in software engineering, infrastructure engineering, data engineering, ML infrastructure, or a related field.
• Strong programming experience in Python, with experience in Go, C++, or another systems-oriented language preferred.
• Experience building and operating production services, APIs, data pipelines, developer platforms, or infrastructure.
• Hands‑on experience with ML workflows such as dataset preparation, model training, evaluation, or deployment.
• Experience with cloud infrastructure, preferably AWS, and Infrastructure as Code.
• Hands‑on experience with Kubernetes and containerized environments.
• Strong understanding of production engineering fundamentals, including reliability, observability, testing, automation, and maintainability.
• Ability to work effectively across engineering disciplines and solve ambiguous technical problems with a high degree of ownership.
• U.S. Citizenship and ability to obtain and maintain a U.S. Government security clearance.

Responsibilities

• Build pipelines that transform raw multi-modal data into curated, versioned training datasets.
• Develop reproducible training and evaluation workflows that scale across cloud compute and GPU resources.
• Build and maintain model deployment infrastructure for packaging, serving, inference, versioning, and rollback.
• Implement experiment tracking, dataset lineage, model versioning, and other capabilities required for reproducible ML development.
• Own data schema versioning and migration across pipelines, data lakes, and services as datasets and models evolve.
• Design, build, and operate scalable AWS infrastructure using Infrastructure as Code.
• Build and maintain Kubernetes/EKS workloads and containerized environments for training, batch processing, evaluation, and model serving.

Skills

Python

Go/C++

Cloud infra

Kubernetes

ML workflows

CI/CD

Data pipelines

Security & compliance

Tools

AWS

Kubernetes

Terraform

CI/CD tools

Job description

HavocAI Inc. is seeking a Machine Learning Cloud Infrastructure Engineer to build and operate the ML infrastructure used to train, evaluate, deploy, and monitor models safely and reliably.

You will develop pipelines connecting data lakes, telemetry stores, simulation environments, training workloads, cloud compute, and deployed models, enabling teams to move from raw data to reproducible datasets and production deployments.