Senior GPU Infra Engineer for Scalable AI Platform

Oracle Corporation; Nashville (TN); On-site; USD 130,000 - 190,000; Full time

Job summary

Oracle Cloud Infrastructure AI Infrastructure is building a high-performance GPU platform to support AI/ML/HPC workloads at scale. You will contribute to architectural changes, health monitoring, and diagnostic services across thousands of GPUs.

The role emphasizes distributed systems engineering, low-level debugging, and collaboration with Network/Data Center operations in a fast-growing environment.

Qualifications

• BS or MS in CS or related technical field.
• Deep understanding of operating systems, computer networks, and high-performance applications.
• 4+ years delivering and operating large-scale production systems.
• Proficient in at least one programming language (Java/Python/C/C++/GoLang/shell scripting).

Responsibilities

• Design and develop architectural changes for GPU delivery.
• Implement health monitoring and diagnostic services.
• Develop triage automation for AI/ML workloads.
• Support distributed AI/ML/HPC workloads across thousands of GPUs.

Skills

Distributed systems

Operating systems

Networking

Java

Python

C

C++

Go

Shell scripting

Education

BS or MS in Computer Science or related field

Tools

MySQL

Redis

Memcached

Caching technologies

Job description

OCI (Oracle Cloud Infrastructure) AI Infrastructure is at the forefront of building a cutting-edge, ultra-high-performance GPU platform designed to support AI/ML/HPC workloads. This is your chance to be part of the AI revolution, creating systems that allow customers to scale from tens to thousands of GPUs without compromising performance.

Our team is responsible for designing and developing fundamental architectural changes for GPU delivery, health monitoring, triage automation, and diagnostic services. These are essential for running distributed AI/ML/HPC workloads across thousands of GPUs, leveraging technologies like RoCE and Infiniband.

Why Join Us?

• Innovative Projects:Build groundbreaking solutions for our customers from the ground up.
• Exciting Times:Be part of a young, fast-growing team working on ambitious new initiatives.
• Dynamic Environment:Collaborate in a vibrant, agile environment where learning and adaptability are key.

What We’re Looking For:

• Adaptable Engineers:Self-motivated individuals with a quick learning ability.
• Technical Excellence:Rock-solid developers and distributed systems engineers with a deep understanding of distributed systems and algorithms. Comfortable diving deep into any part of the stack, as well as software debugging and low-level systems troubleshooting.
• Passion for Simplicity and Scale:Value simplicity and scalability in design and implementation.
• Collaborative Spirit:Comfortable working in a collaborative, agile environment and eager to learn. Ability to collaborate effectively with various dependencies, including Network and Data Center operations.

Join us and be a part of the team that's pushing the boundaries of AI technology!

Minimum Qualifications

• BS or MS degree in Computer Science or relevant technical field involving coding or equivalent practical experience
• Deep understanding of operating systems, computer networks, and high-performance applications
• 4+ years’ experience delivering and operating large-scale production systems (1000+ server instances)
• Proficient in one programming language (Java/Python/C/C++/GoLang/shell scripting)

Preferred Qualifications

• Strong background in Linux systems
• Familiarity with system-level architecture, data synchronization, fault tolerance, and state management.
• General enterprise storage, networking, or computing experience
• Good understanding of databases and SQL (MySQL) and caching technologies (Redis, Memcache etc)