Principal Machine Learning Engineer

Oracle; United States; On-site; USD 114,600 - 234,600; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) savings plan

Paid time off and sick leave

Employee Stock Purchase Plan

Job summary

Oracle is looking for a skilled developer to join their Cloud Infrastructure team, focusing on AI software development and building state-of-the-art training infrastructure. You will engage with innovative technologies in a collaborative environment, ensuring high-quality software delivery.

The ideal candidate should have a background in distributed systems, Java, and Python, with experience in cloud-native architectures and strong communication skills. Comprehensive benefits and a competitive compensation package are offered.

Qualifications

• 6–10+ years building and shipping enterprise distributed or cloud-native systems.
• Experience scaling heterogeneous CPU/GPU training infrastructure for large multimodal frontier models.
• Strong verbal and written communication skills, including technical design documentation.

Responsibilities

• Design and develop AI software in Java, Python, and other languages.
• Participate in the entire software lifecycle – development, testing, CI/CD, and production operations.
• Build cloud services on top of modern Infrastructure-as-a-Service (IaaS) building blocks.

Skills

Java

Python

Distributed systems

System design

Cloud architecture

Kubernetes

Docker

Collaborative environments

Education

BS or MS in Computer Science

Job description

About the Role

At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for enterprises as a diverse team of creators and inventors. In the OCI AI Infrastructure organization, we address exciting challenges at the intersection of artificial intelligence and cutting‑edge cloud infrastructure. In this role you will drive the construction of state‑of‑the‑art training infrastructure for massive GPU clusters and design agentic systems deployed on OCI infrastructure at enterprise‑scale, innovating on leading principles of agentic software development and advancing the frontier of infrastructure that maximizes the potential of bleeding‑edge GPU clusters. We are working at the forefront of the Generative AI (GenAI) landscape, collaborating with teams across Oracle on multimodal data generation and leading the framework across the company.

Responsibilities

• Design and develop AI software in Java, Python, and other languages.


• Participate in the entire software lifecycle – development, testing, CI/CD, and production operations.


• Participate in the entire model development cycle – training, fine‑tuning, model serving, evaluation/benchmarking, and human preference learning.


• Apply engineering principles for defining robust and maintainable architectures and designs.


• Build cloud services on top of modern Infrastructure‑as‑a‑Service (IaaS) building blocks at OCI.


• Design and build distributed, scalable, fault‑tolerant software systems to facilitate development of GenAI models.


• Identify requirements, scope solutions, estimate work, and schedule deliverables. Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture.


• Contribute to publications, blogs, and open‑source ML performance submissions partnering with product managers.


• Balance product feature development with production operational concerns such as operations automation, structured logging, instrumentation for metrics, and on‑call participation.

Qualifications

• BS or MS in Computer Science or equivalent experience.


• 6–10+ years building and shipping enterprise distributed or cloud‑native systems.


• Experience scaling heterogeneous CPU/GPU training infrastructure for large multimodal frontier models.


• Strong foundation in system design, distributed systems, and cloud architecture best practices.


• Proficiency in Java, Python, or similar object‑oriented languages.


• Experience building highly available services using service‑oriented design patterns and service‑to‑service communication protocols.


• Proven ability to deliver impact in collaborative, fast‑paced environments.


• Strong verbal and written communication skills, including technical design documentation.


• Hands‑on experience with containers and orchestration technologies such as Kubernetes and Docker.

Preferred Skills and Experience

• Production experience with Cloud and ML technologies.


• Experience with Generative AI modeling, customizing LLMs, and deploying LLMs at scale for large‑scale data generation.


• Familiarity with transformer models, attention mechanisms, and prompt tooling.

Benefits

• Medical, dental, and vision insurance, including expert medical opinion.


• Short‑term and long‑term disability insurance.


• Life insurance and AD&D.


• Supplemental life insurance (Employee/Spouse/Child).


• Health care and dependent care flexible spending accounts.


• Pre‑tax commuter and parking benefits.


• 401(k) savings and investment plan with company match.


• Paid time off: flexible vacation is provided to eligible salaried employees; accrued vacation for eligible employees, with detailed accrual rates and eligibility thresholds.


• 11 paid holidays.


• Paid sick leave – 72 hours upon hire, refreshed annually, with a maximum cap of 112 hours.


• Paid parental leave.


• Adoption assistance.


• Employee Stock Purchase Plan.


• Financial planning and group legal services.


• Voluntary benefits including auto, homeowner, and pet insurance.

Career Level

IC4

Compensation

US: Hiring range from $114,600 – $234,600 per year, with potential eligibility for bonus, equity, and compensation deferral.

Equal Employment Opportunity

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, veteran status, or any other characteristic protected by law.