Senior AI Infrastructure Engineer - GPU Platform

Oracle; Nashville (TN); On-site; USD 115,000 - 235,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid time off

Job summary

Oracle’s OCI AI Infrastructure team is building a high-performance GPU platform to run AI/ML/HPC workloads at scale, spanning thousands of GPUs. You’ll drive system design, reliability, and performance for distributed architectures critical to customers’ AI initiatives.

You will collaborate across teams to implement scalable solutions, optimize data planes, and ensure robust operation in multi-tenant cloud environments.

Qualifications

• 6+ years’ experience delivering and operating large-scale production systems (1000+ server instances).
• Deep understanding of operating systems, computer networks, and high-performance applications.
• Proven ability to deliver products and experience with full SDLC lifecycle.

Responsibilities

• Lead the development and implementation of scalable distributed systems.
• Design components for horizontal and vertical scaling to meet demand.
• Define scalability requirements and ensure design meets performance goals.
• Build fault-tolerant architectures with redundancy and failover.

Skills

Distributed systems

Java

Python

C/C++

Go

Shell scripting

Education

BS or MS in Computer Science or related field

Tools

RoCE

Infiniband

Linux

MySQL

Redis

Memcached

Job description

Oracle’s OCI AI Infrastructure team is building a high-performance GPU platform to run AI/ML/HPC workloads at scale, spanning thousands of GPUs. You’ll drive system design, reliability, and performance for distributed architectures critical to customers’ AI initiatives.

You will collaborate across teams to implement scalable solutions, optimize data planes, and ensure robust operation in multi-tenant cloud environments.