Principal Core Infrastructure Engineer

Oracle Corporation

Nashville (TN)

On-site

USD 120,000 - 160,000

Full time

3 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Oracle Corporation in Nashville, TN is seeking an experienced software engineer to lead the design and evolution of core distributed systems and data-plane services for hyperscale cloud infrastructure. You will define scalability, elasticity, durability, and availability requirements for owned components and ensure designs meet them.

You will optimize high-throughput data paths, design fault-tolerant systems, and establish SLAs, KPIs, telemetry, dashboards, and alerting to support

Qualifications

  • Bachelor's or master's degree in Computer Science, Computer Engineering, or related field, or equivalent experience.
  • 7+ years of professional software-engineering experience with impact on large-scale distributed systems or cloud infrastructure.
  • Strong experience designing and operating highly available, scalable distributed systems.

Responsibilities

  • Lead design and evolution of core distributed systems and data-plane services for hyperscale environments.
  • Define scalability, elasticity, durability, and availability requirements for owned components.
  • Optimize high-throughput data paths for large-scale retrieval, storage, and processing.
  • Design fault-tolerant systems with in-service updates, automatic failover, and recovery-oriented design.
  • Establish SLAs, KPIs, telemetry, dashboards, and proactive alerting for critical systems.

Skills

Distributed systems
Cloud platforms
Java
C++
C#
Go

Education

Bachelors or Masters in CS/CE

Job description

  • Leads development and begins architecting scalable, container-based services that build, validate, and monitor liquid-cooled GPU infrastructure across factory environments.
  • Develops secure infrastructure, control-plane workflows, and data-plane test capabilities that orchestrate manufacturing test lifecycles, operator workflows, quality gates, fleet status, and business reporting for platforms including GB200, GB300, VR, MI355, and MI455.
  • Automates and maintains GPU test validation; manages consistent firmware, software, and hardware configuration; and develops repair and triage capabilities that identify root causes and guide recovery.
  • Partners with Supply Chain Operations, Hardware Development, external manufacturing partners, data-center operations, NVIDIA, and AMD to resolve issues before racks ship.
  • Establishes manufacturing yield, throughput, quality, and deployment-readiness metrics that reduce rework and downstream failures, improve data-center ingestion, and accelerate reliable hyperscale AI infrastructure delivery.
Internal Responsibilities
  • Lead the design, implementation, and ongoing evolution of core distributed systems and data-plane services at hyperscale.
  • Define scalability, elasticity, durability, and availability requirements for owned components and ensure designs meet them.
  • Optimize high-throughput data paths for large-scale retrieval, storage, and processing using distributed state, replication, and synchronization patterns.
  • Design fault-tolerant systems that support in-service updates through redundancy, automatic failover, and recovery-oriented design.
  • Apply sound distributed-systems tradeoffs for network partitions and reliability, including load shedding, throttling, rate limiting, retries, and timeouts.
  • Establish service-level objectives, key performance indicators, telemetry, dashboards, and proactive alerting for critical systems.
  • Design and lead performance, load, fault-injection, and brownout testing to validate correctness, resilience, and operational readiness.
  • Lead production incident diagnosis and recovery, guide root-cause analysis, and mentor engineers in operational excellence.
  • Build and improve Infrastructure as Code and operational automation that enable safe patching, updates, rollbacks, and change management.
  • Apply robust security controls and remediation practices for multi-tenant cloud infrastructure, including encryption, access controls, and compliance readiness.
Qualifications
  • Bachelor's or master's degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.
  • 7+ years of professional software-engineering experience, with demonstrated impact on large-scale distributed systems or cloud infrastructure.
  • Strong experience designing and operating highly available, scalable, fault-tolerant distributed systems.
  • Proficiency in one or more object-oriented or systems programming languages, such as Java, C++, C#, or Go.
  • Deep understanding of distributed-systems design, data structures, algorithms, operating systems, networking, and secure software-development practices.
  • Experience with system-level test automation, performance/load testing, reliability engineering, and production incident response.
  • Demonstrated experience leading or influencing technical architecture and mentoring engineers.
  • Strong problem-solving, communication, and cross-functional collaboration skills.
Preferred Qualifications
  • Experience with Oracle Cloud, AWS, Azure, Google Cloud, or other large-scale cloud platforms.
  • Experience with data-plane platforms, distributed storage, microservices, replication, state management, or high-throughput data processing.
  • Experience defining SLOs, building observability systems, and operating services in a 24x7 production environment.
  • Experience with Infrastructure as Code, service automation, security controls, and compliance requirements for cloud infrastructure.
External Responsibilities
  • Lead the design, implementation, and ongoing evolution of core distributed systems and data-plane services at hyperscale.
  • Define scalability, elasticity, durability, and availability requirements for owned components and ensure designs meet them.
  • Optimize high-throughput data paths for large-scale retrieval, storage, and processing using distributed state, replication, and synchronization patterns.
  • Design fault-tolerant systems that support in-service updates through redundancy, automatic failover, and recovery-oriented design.
  • Apply sound distributed-systems tradeoffs for network partitions and reliability, including load shedding, throttling, rate limiting, retries, and timeouts.
  • Establish service-level objectives, key performance indicators, telemetry, dashboards, and proactive alerting for critical systems.
  • Design and lead performance, load, fault-injection, and brownout testing to validate correctness, resilience, and operational readiness.
  • Lead production incident diagnosis and recovery, guide root-cause analysis, and mentor engineers in operational excellence.
  • Build and improve Infrastructure as Code and operational automation that enable safe patching, updates, rollbacks, and change management.
  • Apply robust security controls and remediation practices for multi-tenant cloud infrastructure, including encryption, access controls, and compliance readiness.
Qualifications
  • Bachelor's or master's degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.
  • 7+ years of professional software-engineering experience, with demonstrated impact on large-scale distributed systems or cloud infrastructure.
  • Strong experience designing and operating highly available, scalable, fault-tolerant distributed systems.
  • Proficiency in one or more object-oriented or systems programming languages, such as Java, C++, C#, or Go.
  • Deep understanding of distributed-systems design, data structures, algorithms, operating systems, networking, and secure software-development practices.
  • Experience with system-level test automation, performance/load testing, reliability engineering, and production incident response.
  • Demonstrated experience leading or influencing technical architecture and mentoring engineers.
  • Strong problem-solving, communication, and cross-functional collaboration skills.
Preferred Qualifications
  • Experience with Oracle Cloud, AWS, Azure, Google Cloud, or other large-scale cloud platforms.
  • Experience with data-plane platforms, distributed storage, microservices, replication, state management, or high-throughput data processing.
  • Experience defining SLOs, building observability systems, and operating services in a 24x7 production environment.
  • Experience with Infrastructure as Code, service automation, security controls, and compliance requirements for cloud infrastructure.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Core Infrastructure Engineer
Senior Core Infrastructure Engineer

Oracle Corporation • Nashville (TN)

On-site
USD 150,000 - 190,000
GPU Systems Infrastructure Engineer
GPU Systems Infrastructure Engineer

Blue Signal Search • Fremont (CA)

On-site
USD 120,000 - 170,000
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift - An LTTS Company • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
Principal Infrastructure Engineer, AI Cluster Performance & Validation
Principal Infrastructure Engineer, AI Cluster Performance & Validation

Nscale • New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 180,000 - 240,000
Senior Infrastructure Engineer - Infrastructure Security and Core Services
Senior Infrastructure Engineer - Infrastructure Security and Core Services

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 208,000 - 334,000
Equity
Benefits
Senior Solutions Engineer, AI Infrastructure
Senior Solutions Engineer, AI Infrastructure

VAST Data • New York (NY)

On-site
USD 150,000 - 200,000
Sr HPC Hardware Engineer
Sr HPC Hardware Engineer

Career Techniques • Dallas (TX)

Hybrid
USD 120,000 - 180,000
Senior Manager, Compute Core Engineering
Senior Manager, Compute Core Engineering

NVIDIA • Santa Clara (CA)

On-site
USD 248,000 - 391,000
Equity
Benefits
Senior/Staff Software Engineer, Kubernetes Infrastructure
Senior/Staff Software Engineer, Kubernetes Infrastructure

Kindredventures • United States

On-site
USD 140,000 - 190,000
VP of Engineering
VP of Engineering

Hyperbolic • San Francisco (CA)

On-site
USD 200,000 - 300,000