Senior AI/ML Platform Infra Engineer — Remote

OpenTeams

Northern (KY)

Hybrid

USD 145,000 - 250,000

Full time

22 hours ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

401(k) Match
Unlimited PTO
Fully Remote Setup
Education reimbursement
Disability & Life Insurance
HSA & FSA Options

Job summary

OpenTeams seeks a Senior Infrastructure Engineer to build and operate a Kubernetes-based platform that supports secure AI test and evaluation for Government teams. You will own GPU scheduling, multi-tenant isolation, and GitOps pipelines, while ensuring reliability in restricted environments.

Join a fully remote US-based team, work with open-source tools like Nebari, and contribute to scalable, auditable infrastructure. Strong collaboration and documentation culture are expected.

Qualifications

  • U.S. citizenship and ability to obtain and maintain a Secret security clearance.
  • 6+ years of hands-on infrastructure, platform, DevOps, or SRE experience supporting production systems.
  • Strong understanding of scalability, reliability, observability, security, and automation.
  • Production experience with Kubernetes, including workload scheduling and multi-tenant environments.
  • Experience with automated security tooling (container scanning, SAST/DAST, artifact signing, policy enforcement).
  • Proficiency with infrastructure-as-code tools such as Terraform, OpenTofu, Pulumi, or equivalents.
  • Experience with at least one major cloud platform (AWS/Azure/Google Cloud).
  • Experience implementing monitoring/observability with OpenTelemetry, Prometheus, Grafana.
  • Strong programming or automation skills (Python, Go).
  • Experience CI/CD, GitOps, and infrastructure automation.
  • Experience creating operational runbooks and deployment procedures.
  • Experience leading technical initiatives or mentoring engineers.
  • Ability to work independently in a remote distributed team.

Responsibilities

  • Build and operate the Kubernetes platform supporting AI test/evaluation frameworks.
  • Implement GPU scheduling and multi-tenant isolation across evaluation teams.
  • Design infrastructure-as-code, GitOps workflows, and automated deployment pipelines.
  • Develop reusable modular infrastructure components for independently owned platforms.
  • Contribute to Nebari and other open-source Kubernetes/infrastructure projects.
  • Own platform reliability, capacity planning, upgrade strategies, and runbooks.
  • Design observability, monitoring, logging, tracing, and alerting for large-scale workloads.
  • Develop documentation to enable engineers to deploy, operate, and troubleshoot the platform.
  • Deploy and harden infrastructure in secure, restricted Government environments.
  • Support security/compliance activities through documentation and repeatable deployment.

Skills

Kubernetes
Python
Go
GitOps
Cloud platforms
IaC tools
Security tooling
Observability
Mentoring
Open-source
Nebari

Tools

Nebari

Job description

OpenTeams seeks a Senior Infrastructure Engineer to build and operate a Kubernetes-based platform that supports secure AI test and evaluation for Government teams. You will own GPU scheduling, multi-tenant isolation, and GitOps pipelines, while ensuring reliability in restricted environments.

Join a fully remote US-based team, work with open-source tools like Nebari, and contribute to scalable, auditable infrastructure. Strong collaboration and documentation culture are expected.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Engineering Architect — Secure AI Platform (Remote)
Senior Engineering Architect — Secure AI Platform (Remote)

OpenTeams • Northern (KY)

Hybrid
USD 145,000 - 250,000
401(k) Match
Unlimited PTO
Fully Remote Setup
+3
Remote Internal Platform Engineer for AI Infra
Remote Internal Platform Engineer for AI Infra

OpenTrain AI • Northern (KY)

Hybrid
USD 120,000 - 155,000
Remote AI Platform Engineer - Full-Stack, API-First
Remote AI Platform Engineer - Full-Stack, API-First

Worky • Washington

Hybrid
USD 145,000 - 250,000
Medical, Dental & Vision
401(k) Match
Unlimited PTO
+4
Senior SRE & DevSecOps for AI Platform (Remote)
Senior SRE & DevSecOps for AI Platform (Remote)

OpenTeams • Colorado

Hybrid
USD 145,000 - 250,000
401(k) Match
Unlimited PTO
Fully Remote Setup
+3
Senior AI Platform Engineer - Remote Cloud-Native ML Infra
Senior AI Platform Engineer - Remote Cloud-Native ML Infra

Bright Vision Technologies • Columbus (OH), Dublin (OH)

On-site
USD 130,000 - 180,000
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 280,000 - 420,000
Equity options
Health, vision, dental benefits
Unlimited PTO
+2
Senior AI/ML Evaluation Engineer — Benchmarks (Remote)
Senior AI/ML Evaluation Engineer — Benchmarks (Remote)

OpenTeams • Washington, Denver (CO), Colorado Springs (CO)

Hybrid
USD 145,000 - 250,000
401(k) Match – Up to 5% with full vest
Unlimited PTO – 15 days minimum
Fully Remote Setup – up to $3,000 for
+3
AI Infrastructure & Platform Operations Engineer (remote in the US)
AI Infrastructure & Platform Operations Engineer (remote in the US)

Mirantis • United States

Remote
USD 110,000 - 150,000
Professional development
Conferences attendance
Team events
Senior AI/ML Infra Engineer - Remote-Ready, Multi-Cloud
Senior AI/ML Infra Engineer - Remote-Ready, Multi-Cloud

Predii • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Senior Cloud Infra Engineer (Remote, Equity)
Senior Cloud Infra Engineer (Remote, Equity)

Together • San Francisco (CA)

Hybrid
USD 160,000 - 230,000
Equity
Health insurance
Remote work flexibility