AI Platform Engineer: GPU, Kubernetes & RAG Workflows

Intercontinental Exchange Holdings, Inc.

Atlanta (GA)

On-site

USD 150,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Intercontinental Exchange, Inc. is seeking an AI Platform Engineer to design, deploy, and optimize GPU-based AI/ML infrastructure.

The role focuses on containerized workloads, vector stores, RAG pipelines, and multi-agent workflows, with strong emphasis on reliability and security within a containerized platform. You will build tooling for automation, manage MCP servers, and collaborate with developers, operations staff, and release engineers in a 24/7 production environment.

Qualifications

  • Bachelor's degree preferred.
  • 3+ years in infrastructure engineering, systems administration, or DevOps.
  • 3+ years in scripting and automation skills (Python, Ansible, GitOps).
  • 3+ years hands-on experience with Kubernetes in production.
  • 2+ years experience with Linux administration.
  • Direct experience with GPU infrastructure (NVIDIA preferred).
  • 1+ years experience using MCPs, vector databases, embedding infrastructure, RAG pipelines, and agent memory patterns.
  • Fluent English in professional contexts.

Responsibilities

  • Deploy, configure, and maintain GPU clusters and associated infrastructure.
  • Design and maintain the workflow automation platform using AI capabilities (LLM/MCP/Agentic).
  • Manage NVIDIA drivers, CUDA toolkits, and container runtimes.
  • Build and maintain container images with ML frameworks (PyTorch, TensorFlow, etc.).
  • Implement monitoring, alerting, and observability for GPU infrastructure.
  • Maintain vector store infrastructure for RAG pipelines and semantic search.
  • Develop automation to improve platform reliability and efficiency.
  • Provide L2/L3 technical support and vendor escalation.

Skills

Python scripting
Kubernetes
Linux administration
CI/CD automation
GPU infrastructure
Observability
English communication

Education

Bachelor's degree preferred

Tools

NVIDIA drivers
CUDA toolkit
GitHub Actions
Run:AI
NVIDIA AI Enterprise
DGX systems

Job description

Intercontinental Exchange, Inc. is seeking an AI Platform Engineer to design, deploy, and optimize GPU-based AI/ML infrastructure.

The role focuses on containerized workloads, vector stores, RAG pipelines, and multi-agent workflows, with strong emphasis on reliability and security within a containerized platform. You will build tooling for automation, manage MCP servers, and collaborate with developers, operations staff, and release engineers in a 24/7 production environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineer — GPU & Vector AI Infra
AI Platform Engineer — GPU & Vector AI Infra

ICE • Jacksonville (FL)

On-site
USD 120,000 - 180,000
AI Platform Engineer: GPU Infra & MLOps
AI Platform Engineer: GPU Infra & MLOps

ICE • Atlanta (GA)

On-site
USD 120,000 - 180,000
AI Platform Engineer: GPU Infra & MLOps
AI Platform Engineer: GPU Infra & MLOps

ICE Clear Europe Limited • Georgia

Hybrid
USD 140,000 - 200,000
Engineer, Platform Engineering - AI
Engineer, Platform Engineering - AI

ICE Clear Europe Limited • Georgia

Hybrid
USD 140,000 - 200,000
Engineer, Platform Engineering - AI
Engineer, Platform Engineering - AI

ICE • Jacksonville (FL)

On-site
USD 120,000 - 180,000
Senior LLMOps Platform Engineer (GPU/Kubernetes)
Senior LLMOps Platform Engineer (GPU/Kubernetes)

Robotic Technologies Automation • Jersey City (NJ)

On-site
USD 140,000 - 200,000
AI Platform Engineer: Kubernetes, GitOps & Multicloud
AI Platform Engineer: Kubernetes, GitOps & Multicloud

Intapp • United States

Remote
USD 140,000 - 200,000
Public company
Modern offices
Training reimbursement
+3
Senior AI Platform Engineer
Senior AI Platform Engineer

ICE • Omaha (NE)

On-site
USD 110,000 - 170,000
Engineer, Platform Engineering - AI
Engineer, Platform Engineering - AI

Intercontinental Exchange Holdings, Inc. • Atlanta (GA)

On-site
USD 150,000 - 230,000
Senior Platform Engineer — AI/ML & GPU Compute
Senior Platform Engineer — AI/ML & GPU Compute

Cisco Systems, Inc • San Jose (CA)

On-site
USD 168,000 - 245,000