AI Platform Engineer: GPU, Kubernetes & RAG Workflows

Intercontinental Exchange Holdings, Inc.; Atlanta (GA); On-site; USD 150,000 - 230,000; Full time

Job summary

Intercontinental Exchange, Inc. is seeking an AI Platform Engineer to design, deploy, and optimize GPU-based AI/ML infrastructure.

The role focuses on containerized workloads, vector stores, RAG pipelines, and multi-agent workflows, with strong emphasis on reliability and security within a containerized platform. You will build tooling for automation, manage MCP servers, and collaborate with developers, operations staff, and release engineers in a 24/7 production environment.

Qualifications

• Bachelor's degree preferred.
• 3+ years in infrastructure engineering, systems administration, or DevOps.
• 3+ years in scripting and automation skills (Python, Ansible, GitOps).
• 3+ years hands-on experience with Kubernetes in production.
• 2+ years experience with Linux administration.
• Direct experience with GPU infrastructure (NVIDIA preferred).
• 1+ years experience using MCPs, vector databases, embedding infrastructure, RAG pipelines, and agent memory patterns.
• Fluent English in professional contexts.

Responsibilities

• Deploy, configure, and maintain GPU clusters and associated infrastructure.
• Design and maintain the workflow automation platform using AI capabilities (LLM/MCP/Agentic).
• Manage NVIDIA drivers, CUDA toolkits, and container runtimes.
• Build and maintain container images with ML frameworks (PyTorch, TensorFlow, etc.).
• Implement monitoring, alerting, and observability for GPU infrastructure.
• Maintain vector store infrastructure for RAG pipelines and semantic search.
• Develop automation to improve platform reliability and efficiency.
• Provide L2/L3 technical support and vendor escalation.

Skills

Python scripting

Kubernetes

Linux administration

CI/CD automation

GPU infrastructure

Observability

English communication

Education

Bachelor's degree preferred

Tools

NVIDIA drivers

CUDA toolkit

GitHub Actions

Run:AI

NVIDIA AI Enterprise

DGX systems

Job description

Intercontinental Exchange, Inc. is seeking an AI Platform Engineer to design, deploy, and optimize GPU-based AI/ML infrastructure.

The role focuses on containerized workloads, vector stores, RAG pipelines, and multi-agent workflows, with strong emphasis on reliability and security within a containerized platform. You will build tooling for automation, manage MCP servers, and collaborate with developers, operations staff, and release engineers in a 24/7 production environment.