Senior AI Inference Engineer — Scale LLMs & PyTorch

Togetherai; San Francisco (CA); On-site; USD 160,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Startup equity

Competitive benefits

Job summary

Togetherai in San Francisco is seeking a skilled Machine Learning Engineer to enhance the performance of AI inference systems. The role involves collaboration with top AI researchers and engineers, with responsibilities including building production systems and optimizing large-scale applications.

The ideal candidate has strong experience with Python and PyTorch, along with a comprehensive understanding of performance-related aspects of systems. This position offers a competitive base salary range of $160,000 - $230,000 plus equity and benefits.

Qualifications

• 3+ years of experience writing high-performance, well-tested, production-quality code.
• Proficiency with Python and PyTorch.
• Excellent understanding of low-level operating systems concepts.

Responsibilities

• Design and build production systems for AI inference engine.
• Develop and optimize runtime inference services.
• Collaborate with researchers and engineers on new features.

Skills

Python

PyTorch

Multi-threading

Memory management

Networking

CUDA

Tools

Rust

Cython

Job description

Togetherai in San Francisco is seeking a skilled Machine Learning Engineer to enhance the performance of AI inference systems. The role involves collaboration with top AI researchers and engineers, with responsibilities including building production systems and optimizing large-scale applications.

The ideal candidate has strong experience with Python and PyTorch, along with a comprehensive understanding of performance-related aspects of systems. This position offers a competitive base salary range of $160,000 - $230,000 plus equity and benefits.