Inference Research Intern: ML Systems & Foundation Models

Togetherai; San Francisco (CA); On-site; USD 80,000 - 96,000; Part time

Benefits offered by this job

Housing stipend

Competitive compensation

Job summary

Together AI, the AI Native Cloud, is seeking an Inference Research Intern to dive into distributed inference, compiler-aware optimization, and novel inference-time strategies. You will co-design cross-layer optimizations across models, systems, and hardware, focusing on KV cache design and large-scale serving architectures.

The internship runs 12 to 14 weeks, from January 4th to April 9th, with housing stipends and competitive benefits, and compensation at $58 to $70 per hour depending on

Qualifications

• Final year of Bachelor's, Master's, or Ph.D. in CS/EE or related field.
• Strong knowledge of Machine Learning and Deep Learning fundamentals.
• Experience with deep learning frameworks (PyTorch, JAX, etc.).
• Strong programming skills in Python.
• Familiarity with Transformer architectures and foundation models.

Responsibilities

• Design and conduct rigorous experiments to validate hypotheses
• Communicate the plans, progress, and results of projects to the broader team
• Document findings in scientific publications and blog posts

Skills

ML fundamentals

DL fundamentals

Python programming

Transformer architectures

Foundation models

Education

Bachelor's degree in CS/EE or related

Master's degree or PhD in related field

Tools

PyTorch

JAX

CUDA

Job description

Together AI, the AI Native Cloud, is seeking an Inference Research Intern to dive into distributed inference, compiler-aware optimization, and novel inference-time strategies. You will co-design cross-layer optimizations across models, systems, and hardware, focusing on KV cache design and large-scale serving architectures.

The internship runs 12 to 14 weeks, from January 4th to April 9th, with housing stipends and competitive benefits, and compensation at $58 to $70 per hour depending on