ML Engineer for Real-World AI Evaluation Platform

Arena

San Francisco (CA)

On-site

USD 150,000 - 190,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Comprehensive health & wellness"
Cutting-edge AI projects

Job summary

Arena Intelligence is seeking a Machine Learning Engineer to scale and strengthen its core infrastructure powering real-world AI evaluation. You will help build data and evaluation pipelines, model training systems, and evaluation methodologies across modalities, collaborating with researchers, engineers, and product leadership.

As one of the early ML engineers, you will shape reproducibility, expand capabilities, and help define how frontier models are assessed in practice, contributing to a

Qualifications

  • 4+ years of industry experience in ML or AI engineering
  • Experience in deep learning, language models or reward model training
  • Experience in working with LLMs for fine tuning, prompt engineering, function calling
  • Strong programming skills across the stack

Responsibilities

  • Architect and build core modeling for data and evaluation products
  • Own the full stack data, model training, and eval pipelines
  • Foster a culture of feedback and rapid product iteration while building new features
  • Research state-of-the-art evaluation methods and contribute to a scalable evaluation platform

Skills

LLM stack
Recommendation systems
Deep learning
Prompt engineering
Data pipelines
Ownership mindset

Job description

Arena Intelligence is seeking a Machine Learning Engineer to scale and strengthen its core infrastructure powering real-world AI evaluation. You will help build data and evaluation pipelines, model training systems, and evaluation methodologies across modalities, collaborating with researchers, engineers, and product leadership.

As one of the early ML engineers, you will shape reproducibility, expand capabilities, and help define how frontier models are assessed in practice, contributing to a

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer: Build Real-World AI Evaluation Pipelines
ML Engineer: Build Real-World AI Evaluation Pipelines

Speedrun Talent Network • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
ML Engineer — Core AI Evaluation Platform
ML Engineer — Core AI Evaluation Platform

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
ML Engineer - AI Evaluation & Benchmarking Platform
ML Engineer - AI Evaluation & Benchmarking Platform

Arena Intelligence, Inc. • California

On-site
USD 170,000 - 230,000
Comprehensive health benefits
Cutting-edge AI projects
Small, mission-driven team
Machine Learning Engineer
Machine Learning Engineer

Speedrun Talent Network • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
Machine Learning Engineer
Machine Learning Engineer

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
Machine Learning Engineer
Machine Learning Engineer

Arena • San Francisco (CA)

On-site
USD 150,000 - 190,000
Competitive compensation
Comprehensive health & wellness"
Cutting-edge AI projects
Machine Learning Engineer
Machine Learning Engineer

Arena Intelligence, Inc. • California

On-site
USD 170,000 - 230,000
Comprehensive health benefits
Cutting-edge AI projects
Small, mission-driven team
AI Evaluation Scientist — Real-World ML Research
AI Evaluation Scientist — Real-World ML Research

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 170,000 - 210,000
Competitive compensation
Equity
Health benefits
+2
Full-Stack Engineer: Build & Ship AI Evaluation Tools
Full-Stack Engineer: Build & Ship AI Evaluation Tools

Arena • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
Equity
Health benefits
+2
Real-Time ML Infrastructure Engineer
Real-Time ML Infrastructure Engineer

Arena • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive pay
Equity
Health benefits
+2