Senior AI Systems Engineer - Cloud AI Infrastructure

Oracle; United States; On-site; USD 97,000 - 306,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) Savings and Investment Plan

Paid time off

Holidays

Parental leave

Job summary

Oracle Hardware Platform Development Engineering is seeking a highly driven AI Systems Engineer to evaluate and characterize next-generation GPU and AI accelerator platforms for Oracle Cloud Infrastructure (OCI).

This is a hands-on engineering role focused on bringing up new hardware platforms, enabling AI training and inference software stacks, running representative workloads, and analyzing system performance under real operating conditions.

Qualifications

• Minimum of 8+ years in software infrastructure for large-scale AI systems.
• Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience).
• Strong debugging skills and experience in analyzing and triaging AI applications from the application level to the hardware level.
• Hands-on experience maintaining or building ML training stacks involving CUDA, ROCm, NCCL, XLA, or similar technologies.
• Experience in benchmarking AI workloads across different architectures.
• Background in working with the large scale clusters
• Good understanding on DL frameworks internal PyTorch, TensorFlow, JAX, and Ray

Responsibilities

• Solid knowledge of AI / GPU or/and AI/CPU platform architecture and their capabilities.
• Experience with the architecture, design, and implementation of modern server platforms consisting of multiple architectures and vendors, including x86 and ARM server architectures.
• Strong communications skills and ability to clearly communicate complex technical issue across engineering disciplines as well as clearly and succinctly articulate issues for executives.
• Experience and understanding of the latest high-speed busses and interconnect used in modern Compute and AI platforms. Familiarity with their startup connectivity and operational robustness as well as performance metrics.
• Debugging & Reliability: Troubleshoot complex hardware–software interaction issues, including vLLM compilation failures on ROCm, CUDA memory leaks, distributed runtime failures, and kernel‑level inconsistencies.
• Profiling & Performance Analysis: Conduct detailed profiling of compilation graphs, training workloads, and runtime execution to optimize performance and eliminate bottlenecks.

Skills

AI platform architecture

x86 & ARM servers

Performance profiling

Debugging hardware/software

CPU/GPU interconnects

Communication

Education

Bachelor's degree in CS or related field

Tools

CUDA

ROCm

NCCL

XLA

PyTorch

TensorFlow

JAX

Ray

Job description

Oracle Hardware Platform Development Engineering is seeking a highly driven AI Systems Engineer to evaluate and characterize next-generation GPU and AI accelerator platforms for Oracle Cloud Infrastructure (OCI).

This is a hands-on engineering role focused on bringing up new hardware platforms, enabling AI training and inference software stacks, running representative workloads, and analyzing system performance under real operating conditions.