Member of Technical Staff, ML Performance

Odyssey; Palo Alto (CA); On-site; USD 130,000 - 160,000; Full time

Job summary

A leading AI lab in California seeks an experienced software engineer specialized in machine learning performance. Responsibilities include optimizing models used by extensive user bases, developing distributed training strategies, and collaborating closely with researchers to enhance model architectures. Ideal candidates should have over 8 years of software engineering experience, a strong background in ML optimization, and proficiency with tools like PyTorch and NVIDIA ecosystems. Join our innovative team to push the limits of AI technology.

Qualifications

• 8+ years of software engineering experience with focus on ML performance.
• Strong understanding of modern machine learning architectures.
• Ability to solve problems and adapt to new skills as necessary.

Responsibilities

• Optimize models for real-time usage by hundreds of thousands of users.
• Design and implement distributed training strategies.
• Partner with ML researchers to ensure model performance.
• Develop tools to identify performance bottlenecks.
• Pioneer innovative approaches to enhance performance metrics.

Skills

Performance optimization

Distributed training

Problem-solving

Deep learning architectures

PyTorch

NVIDIA GPU optimization

Job description

Who we are

Odyssey is an AI lab pioneering general‑purpose world models—a new form of multimodal intelligence unlocking entirely new consumer, enterprise, and intelligence applications. World models are the next major frontier in AI, and Odyssey is leading the way with breakthrough models like Odyssey-2 Pro.

What we're looking for

We're seeking those who are obsessed with gaining every last drop of performance from complex systems. We're building inference infrastructure to scale to hundreds of thousands of users within a year, while also working with massive, ever‑growing datasets and models in training. Your focus will be ensuring our models deliver exceptional speed, reliability, and scalability in both the training and inference phases, optimizing efficiency to minimize TFLOPS per user and training compute cost.

What you'll do

• Optimize models that will be used in real‑time by hundreds of thousands of users.

• Design and implement distributed training strategies to reduce training time and resource consumption on large GPU clusters.

• Partner with our elite team of ML researchers and engineers to ensure model architectures are highly performant from conception.

• Develop sophisticated tools to identify performance bottlenecks and stability issues in both training and serving environments.

• Pioneer innovative approaches, frameworks, and system designs that enhance performance metrics across our model development and inference infrastructure.

• Have significant autonomy in technical decisions.

• Use the latest‑generation GPUs.

Who you are

• 8+ years of software engineering experience, with significant work in ML performance.

• Deep insight into modern machine learning architectures with a natural instinct for performance optimization, particularly distributed training and inference.

• Track record of owning projects end to end.

• Problem‑solving mindset with the ability to acquire new skills as needed.

• Proficiency with PyTorch (or TF/JAX) and Triton as well as NVIDIA GPU ecosystems and optimization stacks.

• Highly metric‑based.