MLOps Engineer — Secure, Air-Gapped Deployments

Gallatin AI, Inc.; Austin (TX); On-site; USD 80,000 - 210,000; Full time

Benefits offered by this job

Equity grant

Full healthcare coverage

401k

Unlimited PTO

Job summary

Gallatin AI, Inc. is seeking an experienced MLOps/ML platform engineer to build training, deployment, and evaluation infrastructure for production models in high-security environments.

You will own end-to-end systems from training runs to deployed capabilities, including CI/CD, reproducibility, and observability, with a focus on IL5/IL6 air-gapped deployments.

Join a mission-driven team delivering decision advantage for defense and logistics challenges at scale.

Qualifications

• 5+ years in MLOps, ML platform, or infrastructure engineering with real users
• Strong Python production code experience, not notebooks
• Deep Kubernetes and containerization experience, plus IaC
• Production experience with AWS ML/Azure infrastructure (SageMaker, EKS) or equivalent
• Hands-on GPU infra experience: scheduling, utilization, memory sizing, cost
• Hands-on deploying/operating production software in IL5/IL6 environments, including restricted-network deployments

Responsibilities

• Own model training, fine-tuning, and batch inference infra across AWS and on-prem GPU hardware.
• Stand up and tune LLM inference serving with scalable, reliable deployment.
• Build CI/CD for models and pipelines with versioned data and a model registry.

Skills

MLOps

Python

Kubernetes

Infrastructure as Code

AWS/Azure ML

GPU infrastructure

Air-gapped/IL5/IL6 deployments

Education

CS/Engineering degree or related field

Job description

Gallatin AI, Inc. is seeking an experienced MLOps/ML platform engineer to build training, deployment, and evaluation infrastructure for production models in high-security environments.

You will own end-to-end systems from training runs to deployed capabilities, including CI/CD, reproducibility, and observability, with a focus on IL5/IL6 air-gapped deployments.

Join a mission-driven team delivering decision advantage for defense and logistics challenges at scale.