Consulting Member of Technical Staff

Oracle; Austin (TX); On-site; USD 130,000 - 180,000; Full time

Job summary

A leading tech company in Austin, Texas, is seeking a Consulting Member of Technical Staff to design and build infrastructure for Generative AI services. This role involves leading LLM inference architecture and collaborating with ML engineers. Candidates should have over 10 years in distributed systems and a solid background in programming languages like Go, Java, Python, or C++. A comprehensive benefits package is offered.

Benefits

Medical, dental, and vision insurance

401(k) plan with company match

Paid vacation and sick leave

Qualifications

• 10+ years of production-grade distributed systems and cloud-native engineering.
• Expertise in high-performance computing and ML model serving infrastructure.
• Deep understanding of container orchestration and CI/CD pipelines.

Responsibilities

• Architect and build high-throughput, low-latency serving systems for LLM inference and agent orchestration.
• Design agent-native runtime environments that support dynamic planning.
• Integrate foundational AI components with OCI’s compute and networking layers.

Skills

Proficiency in Go

Proficiency in Java

Proficiency in Python

Proficiency in C++

Strong communication skills

Education

BS degree in Computer Science or equivalent

MS or PhD in Computer Science

Tools

LLM serving frameworks

Container orchestration tools

CI/CD pipelines

Job description

Job Overview

Consulting Member of Technical Staff (IC5) – Generative AI Service, Oracle Cloud Infrastructure (OCI). The role focuses on designing and building LLM infrastructure and agent runtimes for OCI’s global customer base.

Role Summary

As a technical staff member, you will lead the architecture and implementation of low‑latency LLM inference, agent orchestration, and developer platforms. You will work closely with applied scientists, ML engineers, and cloud infrastructure teams to deploy agentic workflows at enterprise scale.

Minimum Qualifications

• BS degree in Computer Science or equivalent professional experience.
• 10+ years of production‑grade distributed systems and cloud‑native engineering.
• Proficiency in Go, Java, Python, or C++.
• Expertise in high‑performance computing and ML model serving infrastructure.
• Deep understanding of container orchestration and CI/CD pipelines.
• Strong communication skills and mentoring experience across teams.

Preferred Qualifications

• MS or PhD in Computer Science with focus on Systems, ML Infrastructure, or Compilers.
• Experience with LLM serving frameworks (vLLM, FasterTransformer, DeepSpeed, Triton).
• Familiarity with agent‑based systems and LLM‑native developer tools.
• Experience with vector databases, tool APIs, and event‑driven workflows.
• Foundation in OS internals, compiler pipelines, and systems programming.
• Proven ability to lead large‑scale architecture efforts.

Responsibilities

• Architect and build high‑throughput, low‑latency serving systems for LLM inference and agent orchestration.
• Design agent‑native runtime environments that support dynamic planning, tool calling, memory, and long‑running context.
• Integrate foundational AI components with OCI’s compute and networking layers.
• Partner with ML research to optimize model training, fine‑tuning, and inference performance on GPU clusters.
• Own critical paths of software delivery from architectural review through implementation and post‑deployment resilience.
• Contribute to OCI’s developer‑facing agent framework and support deep systems‑level challenges.

Benefits

Oracle offers a comprehensive benefits package including medical, dental, and vision insurance; short‑term and long‑term disability; life insurance; and a 401(k) plan with company match. Eligible employees also receive paid vacation, paid sick leave, paid parental leave, adoption assistance, an Employee Stock Purchase Plan, and various voluntary benefits.

EOE Statement

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, and protected veterans’ status, or any other characteristic protected by law.