Senior GPU Cloud Infra Engineer | Scale AI workloads

Devopsroles; Nashville (TN); On-site; USD 79,000 - 210,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) Savings and company match

Paid time off

Paid holidays

Parental leave

Job summary

Oracle is seeking an experienced AI Infrastructure Engineer to design and operate a distributed GPU platform for AI/ML/HPC workloads in the US. The role focuses on scalable architecture, health monitoring, triage automation, and diagnostic services across thousands of GPUs using RoCE and InfiniBand.

The candidate will implement replication, automation, and advanced security controls while ensuring compliance and documentation standards are met.

Qualifications

• BS or MS in Computer Science or related field with coding experience
• Deep understanding of operating systems, networks, and high-performance apps
• 6+ years delivering and operating large-scale production systems (1000+ server instances)
• Proficient in one programming language (Java, Python, C, C++, Go, or shell scripting)
• Strong problem-solving, communication, ownership, and lifecycle delivery experience

Responsibilities

• Designs, implements, and optimizes components in distributed systems with a focus on scalability and resiliency.
• Delivers features and load/performance tests; uses data plane platforms for high-volume retrieval, storage, and processing; reviews implementations for scalability.
• Builds fault-tolerant paths with redundancy, replication, failover; implements retries, circuit breakers, and timeouts; contributes runbooks and incident RCA reviews.
• Applies security controls, automation/IaC for troubleshooting and maintenance; ensures change, compliance, and documentation standards.

Skills

Java

Python

C

C++

Go

Shell scripting

Education

BS or MS in Computer Science

Job description

Oracle is seeking an experienced AI Infrastructure Engineer to design and operate a distributed GPU platform for AI/ML/HPC workloads in the US. The role focuses on scalable architecture, health monitoring, triage automation, and diagnostic services across thousands of GPUs using RoCE and InfiniBand.

The candidate will implement replication, automation, and advanced security controls while ensuring compliance and documentation standards are met.