Principal Core Infrastructure Engineer

Oracle; Nashville (TN); On-site; USD 84,900 - 209,500; Full time

Benefits offered by this job

Bonus eligibility

Equity

Job summary

Oracle is seeking a Principal Core Infrastructure Engineer (AI/ML Forward Deployed Infrastructure Engineer) to design, implement, and maintain the infrastructure powering customers' AI/ML workloads. You will collaborate with customer technical teams and Oracle's cloud services to deploy securely, at scale, and with cost-effectiveness.

This hands-on role involves automating provisioning, configuring, and monitoring, tuning performance, and ensuring security and compliance.

Qualifications

• Experience scripting and automation with Ansible, Terraform, Python, and Kubernetes.
• Experience with Docker and orchestration tools for distributed systems.
• Solid networking concepts, security principles, and best practices.
• Excellent problem-solving, communication, and cross-functional collaboration.
• Strong documentation skills and Linux system administration experience.

Responsibilities

• Design, deploy, and manage cloud infrastructure for AI/ML workloads.
• Collaborate with data scientists and engineers to meet training and deployment needs.
• Implement automation for provisioning, configuring, and monitoring infrastructure.
• Tune performance, optimize resources, and apply caching and pre-processing.
• Ensure security, encryption, access controls, and vulnerability management.
• Troubleshoot performance, scalability, and reliability issues.
• Document designs, configurations, and procedures for maintainability.
• Advise customers on best practices for GPU solutions and cloud migrations.

Skills

Scripting & Automation

Networking concepts

Security principles

Problem solving

Communication & Collaboration

Documentation

Linux systems administration

Tools

Ansible

Terraform

Python

Kubernetes

Docker

Slurm

PBS

Job description

Job Title

Principal Core Infrastructure Engineer (AI/ML Forward Deployed Infrastructure Engineer)

Job Description

As a Principal Core Infrastructure Engineer (AI/ML Forward Deployed Infrastructure Engineer), you will play a critical role in designing, implementing, and maintaining the infrastructure that supports our customers' AI and machine learning initiatives.

You will work closely with customer technical teams (data scientists, software engineers, and Infra/IT professionals) and internal cloud services team to ensure their AI/ML solutions are deployed efficiently, securely, and at scale. Your expertise will be crucial in optimizing our infrastructure for performance, reliability, and cost‑effectiveness. In this hands‑on technical role you’ll troubleshoot issues for proof of concept (POC) and production deployments.

Responsibilities

• Work with OCI Strategic customers to grow our business in pre/post‑sales stages in a technical infra expert role.
• Take ownership of problems and work to identify solutions.
• Think through solutions and identify or document potential issues impacting customers.
• Design, deploy, and manage infrastructure components such as cloud resources, distributed computing systems, and data storage solutions to support AI/ML workflows.
• Collaborate with scientists and software/infrastructure engineers to understand infrastructure requirements for training, testing, and deploying machine learning models.
• Implement automation solutions for provisioning, configuring, and monitoring AI/ML infrastructure to streamline operations and enhance productivity.
• Optimize infrastructure performance by tuning parameters, optimizing resource utilization, and implementing caching and data pre‑processing techniques.
• Ensure security and compliance standards are met throughout the AI/ML infrastructure stack, including data encryption, access control, and vulnerability management.
• Troubleshoot infrastructure performance, scalability, and reliability issues and implement solutions to mitigate risks and minimize downtime.
• Stay updated on emerging technologies and best practices in AI/ML infrastructure and evaluate their potential impact on our systems and workflows.
• Document infrastructure designs, configurations, and procedures to facilitate knowledge sharing and ensure maintainability.
• Act as a trusted customer advocate, helping customers and partners understand best practices around advanced GPU solutions and how to migrate workloads to the cloud.
• Educate customers of all sizes on the value proposition of Oracle Cloud and participate in deep architectural discussions.
• Act as a technical liaison between customers, core engineering teams, and support.

Qualifications

• Experience in scripting and automation using tools such as Ansible, Terraform, Python, and/or Kubernetes.
• Experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (e.g., Slurm, PBS) for managing distributed systems.
• Solid understanding of networking concepts, security principles, and best practices.
• Excellent problem‑solving skills, with the ability to troubleshoot complex issues and drive resolution in a fast‑paced environment.
• Strong communication and collaboration skills, with the ability to work effectively in cross‑functional teams and convey technical concepts to non‑technical stakeholders.
• Strong documentation skills with experience documenting infrastructure designs, configurations, procedures, and troubleshooting steps.
• Strong Linux skills, with hands‑on experience in Oracle Linux, RHEL, CentOS, Ubuntu, and Debian distributions.

Preferred Qualifications

• Strong proficiency in at least one programming language such as Python, Rust, Go, Java, or Scala.
• Proven experience designing, implementing, and managing infrastructure for AI/ML or HPC workloads.
• Understanding of machine learning frameworks and libraries such as TensorFlow, PyTorch, or sci‑kit‑learn and their deployment in production environments.
• Familiarity with DevOps practices and tools for continuous integration, deployment, and monitoring (e.g., Jenkins, GitLab CI/CD, Prometheus).
• Strong experience with High‑Performance Computing/GPU systems.

Compensation and Benefits

Salary range: USD $84,900 – $209,500 per year. May be eligible for bonus and equity. Oracle offers a comprehensive benefits package, including medical, dental, and vision insurance; short‑term and long‑term disability; life insurance and AD\&D; supplemental life insurance; health care and dependent care flexible spending accounts; pre‑tax commuter and parking benefits; 401(k) savings and investment plan with company match; paid time off (vacation); paid holidays; paid sick leave; paid parental leave; adoption assistance; employee stock purchase plan; financial planning and group legal; and voluntary benefits.

EEO Statement

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.