Senior AI Infrastructure Engineer

gatikaiinc

Mountain View (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Gatik is seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering its autonomous driving models. You will bridge research and production, enabling distributed training, experiment tracking, and seamless model deployment.

This onsite role is based in Mountain View, CA, requiring collaboration across ML researchers and platform engineers to deliver scalable, resilient AI systems that meet strict latency and reliability targets.

Qualifications

  • 5+ years in ML infrastructure, MLOps, or DevOps.
  • Experience in high-scale compute environments.

Responsibilities

  • Scale research workloads across multi-node setups using PyTorch Distributed and Ray Train.
  • Optimize multi-GPU setups for model and data parallelism.
  • Tune networking hardware (NCCL, InfiniBand, RoCE v2) to reduce latency.
  • Manage resource scheduling with Kubernetes GPU scheduling (NVIDIA GPU Operator, KubeFlow).
  • Deploy and scale model artifacts with TensorRT, ONNX Runtime, and Triton.
  • Build self-healing AI infrastructure with automated triage of hardware failures.

Skills

ML Infrastructure
MLOps
DevOps
Distributed Training
GPU Compute

Tools

Terraform
Helm
Kubernetes
NVIDIA GPU Operator
KubeFlow
TensorRT
ONNX Runtime
Triton Inference Server
MLFlow
Argo Workflows
Airflow
Kafka
Spark
Prometheus
Grafana
OpenTelemetry

Job description

Who we are

Gatik, the leader in autonomous middle-mile logistics, is revolutionizing the B2B supply chain with its autonomous transportation-as-a-service (ATaaS) solution and prioritizing safe, consistent deliveries while streamlining freight movement by reducing congestion. The company focuses on short-haul, B2B logistics for Fortune 500 retailers and in 2021 launched the world's first fully driverless commercial transportation service with Walmart. Gatik's Class 3-7 autonomous trucks are commercially deployed across major markets, including Texas, Arkansas, and Ontario, Canada, driving innovation in freight transportation.

About the role

We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on developing perception, planning, and world models, you will be responsible for the underlying infrastructure that enables distributed training, experiment tracking, and seamless model deployment. You will bridge the gap between research and production, ensuring our AI stack is scalable, resilient, and highly efficient

This role is onsite 5 days a week at our Mountain View, CA office!

What you'll do
Distributed Training & ML Systems Support
  • Scale Research Workloads: Enable researchers to scale complex models (VLA, World Models) across multi-node setups using PyTorch Distributed, and Ray Train.
  • Performance Optimization: Architect and optimize multi-GPU setups, ensuring efficient model parallelism and data parallelism techniques across H100/A100 clusters.
  • Networking & Hardware Tuning: Optimize low-level communication (e.g., NCCL tuning, InfiniBand, or RoCE v2) to minimize latency for 3D Gaussian Splatting (3DGS) and large-scale training.
  • Intelligent Resource Scheduling: Optimize hardware utilization and cost-efficiency through Kubernetes-native GPU scheduling (NVIDIA GPU Operator, KubeFlow).
  • Inference Performance Engineering: Deploy and scale optimized model artifacts using TensorRT, ONNX Runtime, and Triton Inference Server, fine-tuning pipelines for both real-time and batch processing.
Agentic Infrastructure & Automation
  • Self-Healing AI Infrastructure: Architect and deploy Autonomous AI Agents (LangGraph, CrewAI, or AutoGen) to monitor GPU cluster health, enabling automated real-time triage of hardware failures and NCCL timeouts.
  • Agentic DevOps & CI/CD: Develop agent-driven automation, such as Agentic PR Reviewers for infrastructure code and AI agents that proactively suggest model-specific Kubernetes resource optimizations.
  • Agentic Data Curation: Support researchers in building "Data Machines" where AI agents autonomously curate, label, and verify high-priority edge cases from raw data.
Model Management & Lifecycle (MLOps)
  • Automated Lifecycle Management: Design and maintain ML infrastructure leveraging MLFlow, Argo Workflows, and Kubernetes to automate the end-to-end model lifecycle.
  • Experiment & Model Tracking: Integrate feature stores and experiment tracking systems to provide a robust system of record for every model iteration.
  • Deployment Strategies: Implement robust serving mechanisms, including A/B testing, shadow deployments, and rollback mechanisms.
Cloud-Native Foundations & Data Integration
  • Infrastructure as Code: Drive the "Everything as Code" philosophy using Terraform and Helm.
  • Data Pipelines: Collaborate with data teams to scale ETL pipelines using Apache Airflow, Kafka, and Spark for large-scale dataset management.
  • Integrated Data Factories: Collaborate with data engineering teams to scale high-bandwidth ETL pipelines using Apache Airflow, Kafka, and Spark, ensuring seamless data flow from raw sensor logs to optimized storage in S3, GCS, or Delta Lake.
Monitoring & Observability
  • System Metrics: Define and track key ML system metrics, including training convergence, latency, throughput, and drift detection.
  • Infrastructure Health: Maintain deep visibility into platform health using Prometheus, Grafana, OpenTelemetry, and ELK Stack.
  • Deep Stack Observability: Develop comprehensive monitoring using Prometheus, Grafana, and OpenTelemetry to track low-level infrastructure health alongside high-level ML metrics like training convergence and throughput.
  • AI-Specific Metrics & Drift: Define and monitor critical ML system KPIs, including model latency, inference throughput, and feature drift detection.
What we're looking for

Experience: 5+ years in ML infrastructure, MLOps, or DevOps supporting high-scale compute environme

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Simulation Infrastructure Engineer
Senior Simulation Infrastructure Engineer

gatikaiinc • Santa Clara (CA)

On-site
USD 150,000 - 190,000
Principal AI Infrastructure Engineer
Principal AI Infrastructure Engineer

gatikaiinc • Mountain View (CA)

On-site
USD 180,000 - 260,000
Senior ML Infrastructure Engineer: Scalable Data & Training
Senior ML Infrastructure Engineer: Scalable Data & Training

Gatik • Santa Clara (CA)

On-site
USD 180,000 - 260,000
AI Engineer Lead
AI Engineer Lead

Shrive Technologies • San Jose (CA)

On-site
USD 180,000 - 240,000
AI Engineer
AI Engineer

TechDigital Group • San Jose (CA)

On-site
USD 140,000 - 210,000
Technical Lead, Scalable ML Infrastructure
Technical Lead, Scalable ML Infrastructure

Gatik • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Senior AI Engineer - Machine Learning (US)
Senior AI Engineer - Machine Learning (US)

Gauss Labs • Palo Alto (CA)

Hybrid
USD 180,000 - 260,000
Technical Lead, ML Infrastructure Santa Clara, CA
Technical Lead, ML Infrastructure Santa Clara, CA

Gatik • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Technical Lead, ML Infrastructure
Technical Lead, ML Infrastructure

Gatik • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Tech Lead - Scalable ML Infrastructure
Tech Lead - Scalable ML Infrastructure

Gatik • Santa Clara (CA)

On-site
USD 180,000 - 240,000