ML Engineer: Build Real-World AI Evaluation Pipelines

Speedrun Talent Network; San Francisco (CA); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Competitive compensation

Health and wellness benefits

Cutting-edge AI projects

Transparent, collaborative culture

Job summary

Arena Intelligence is seeking a Machine Learning Engineer to scale our model evaluation platform and strengthen core infrastructure for real-world AI benchmarking. You’ll partner with researchers and engineers to turn ideas into reliable, scalable systems and help shape evaluation methods across modalities.

You’ll work on end-to-end data pipelines, model training, and inference, with a focus on reproducibility and robust deployment in a fast-paced, mission-driven team.

Qualifications

• Strong programming across the stack with ML focus.
• Experience with deep learning and language models.
• Experience in fine-tuning, prompt engineering, and function calling with LLMs.

Responsibilities

• Architect core modeling and data/evaluation pipelines.
• Own full data, model training, and evaluation pipelines end-to-end.
• Collaborate with researchers, engineers, and product leadership to ship reliable features.
• Research state-of-the-art evaluation methods for scalable platform growth.

Skills

Full stack development

Deep learning

Language models

Reward model training

LLM fine-tuning

Prompt engineering

Tools

LLM stack

Job description

Arena Intelligence is seeking a Machine Learning Engineer to scale our model evaluation platform and strengthen core infrastructure for real-world AI benchmarking. You’ll partner with researchers and engineers to turn ideas into reliable, scalable systems and help shape evaluation methods across modalities.

You’ll work on end-to-end data pipelines, model training, and inference, with a focus on reproducibility and robust deployment in a fast-paced, mission-driven team.