ML Engineer - AI Evaluation & Benchmarking Platform

Arena Intelligence, Inc.

California

On-site

USD 170,000 - 230,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Comprehensive health benefits
Cutting-edge AI projects
Small, mission-driven team

Job summary

Arena Intelligence, Inc. is building a scalable evaluation platform for AI systems.

This role will architect the core modeling foundation for data and evaluation products, and own end-to-end data, model training, and evaluation pipelines in a fast-paced, mission-driven team. You will push state-of-the-art methods, improve reproducibility, and enable benchmarking across data pipelines and inference APIs, collaborating with researchers, engineers, and product leadership to turn bold ideas into

Qualifications

  • Experience across stacks in recommender/LLM systems.
  • Experience with deep learning or reward model training.
  • Experience with LLM workflows: fine-tuning, prompt engineering, function calling.
  • Ownership mindset and willingness to take initiative.

Responsibilities

  • Architect and build core modeling foundation for Arena Intelligence data and evaluation products.
  • Own end-to-end data, model training, and evaluation pipelines.
  • Drive rapid iteration while shipping new features within a tight-knit team.
  • Research evaluation methods and contribute to scalable evaluation platform vision.
  • Shape benchmarking systems across data pipelines and inference APIs.
  • Partner with researchers, engineers, and product leadership to turn ideas into reliable systems.
  • Improve reproducibility, scale to new modalities, and compare frontier models.

Skills

Programming across stack
Deep learning
Language models
Reward model training
LLM workflows

Job description

Arena Intelligence, Inc. is building a scalable evaluation platform for AI systems.

This role will architect the core modeling foundation for data and evaluation products, and own end-to-end data, model training, and evaluation pipelines in a fast-paced, mission-driven team. You will push state-of-the-art methods, improve reproducibility, and enable benchmarking across data pipelines and inference APIs, collaborating with researchers, engineers, and product leadership to turn bold ideas into

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer: Build Real-World AI Evaluation Pipelines
ML Engineer: Build Real-World AI Evaluation Pipelines

Speedrun Talent Network • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
ML Engineer for Real-World AI Evaluation Platform
ML Engineer for Real-World AI Evaluation Platform

Arena • San Francisco (CA)

On-site
USD 150,000 - 190,000
Competitive compensation
Comprehensive health & wellness"
Cutting-edge AI projects
ML Engineer — Core AI Evaluation Platform
ML Engineer — Core AI Evaluation Platform

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
Machine Learning Engineer
Machine Learning Engineer

Arena Intelligence, Inc. • California

On-site
USD 170,000 - 230,000
Comprehensive health benefits
Cutting-edge AI projects
Small, mission-driven team
Full-Stack Engineer: Build & Ship AI Evaluation Tools
Full-Stack Engineer: Build & Ship AI Evaluation Tools

Arena • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
Equity
Health benefits
+2
Senior Platform Engineer — Go, APIs & AI Evaluation
Senior Platform Engineer — Go, APIs & AI Evaluation

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity
Health benefits
Competitive salary
+1
Platform Infrastructure Engineer for Scalable AI Gateways
Platform Infrastructure Engineer for Scalable AI Gateways

Arena • San Francisco (CA)

On-site
USD 140,000 - 230,000
Software Engineer - Platform
Software Engineer - Platform

Arena • San Francisco (CA)

On-site
USD 140,000 - 230,000
Machine Learning Engineer
Machine Learning Engineer

Speedrun Talent Network • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
Machine Learning Engineer
Machine Learning Engineer

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1