Platform AI Infra Engineer

Oracle; United States; On-site; USD 126,000 - 210,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) match

Paid time off

Parental leave

Employee stock purchase plan

Job summary

Oracle is hiring a Platform Software Engineer to help build the execution layer behind OCI’s AI and GPU growth. You’ll work across Oracle data platforms, GPU scheduling, orchestration pipelines, and MLOps tooling — turning customer demand into production-grade systems that scale across our cluster fleet.

This is a builder role on a small, high-leverage team. We value hands‑on experience with Kubernetes, workflow engines, and GPU workloads.

Qualifications

• 3–6 years of software engineering experience, ideally in distributed systems, data platforms, or ML infrastructure.
• Strong Python; working knowledge of Go or Rust is a plus.
• Hands‑on experience with Kubernetes, container runtimes, and at least one workflow engine (Argo, Airflow, Prefect, Temporal).
• Familiarity with GPU workloads, CUDA toolchains, or inference serving frameworks (vLLM, TensorRT-LLM, Triton).
• Experience with LLM agent frameworks (LangGraph, CrewAI, or similar) is a strong plus.

Responsibilities

• Integrate with Oracle data platforms to move training and inference data across pipelines.
• Build and extend GPU schedulers and capacity‑aware placement logic for multiple fleet generations.
• Develop orchestration pipelines for training, fine‑tuning, and inference workloads using Kubernetes, Argo, and Slurm where appropriate.
• Ship MLOps tooling — observability, automated triage, cost and SLO agents — to reduce operator load on large GPU deployments.
• Partner with PMs, SAs, and customer-facing teams to convert field requirements into reusable components.

Skills

Python

Go

Rust

Distributed systems

MLOps

Ambiguity handling

Tools

Kubernetes

Argo

Airflow

Prefect

Temporal

CUDA toolchains

LangGraph

CrewAI

Job description

Oracle is hiring a Platform Software Engineer to help build the execution layer behind OCI’s AI and GPU growth. You’ll work across Oracle data platforms, GPU scheduling, orchestration pipelines, and MLOps tooling — turning customer demand into production-grade systems that scale across our cluster fleet.

This is a builder role on a small, high-leverage team. We value hands‑on experience with Kubernetes, workflow engines, and GPU workloads.