ML Engineer — Core AI Evaluation Platform

Arena Intelligence, Inc.

San Francisco (CA)

On-site

USD 140,000 - 210,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
Small mission-driven team

Job summary

As an early ML engineer, you will collaborate with researchers, engineers, and product leadership to turn ideas into robust, scalable features and products for a trusted AI evaluation platform.

Qualifications

  • 4+ years of industry experience or relevant projects.
  • Experience in deep learning, language models or reward model training.
  • Experience in working with LLM for fine tuning, prompt engineering, function calling etc.
  • Strong programming across the stack and ability to own end-to-end systems.

Responsibilities

  • Architect and build core modeling for data and evaluation products.
  • Own the full stack data, model training, and eval pipelines.
  • Foster rapid product iteration with a tight-knit team and strong feedback culture.
  • Research state-of-the-art evaluation methods and contribute to a scalable evaluation platform.

Skills

Programming across the stack
Deep learning
LLM fine tuning
Self-motivated ownership
Shipping quality products
Uncertainty evaluation

Tools

LLM stack
Data pipelines
Model training

Job description

As an early ML engineer, you will collaborate with researchers, engineers, and product leadership to turn ideas into robust, scalable features and products for a trusted AI evaluation platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer for Real-World AI Evaluation Platform
ML Engineer for Real-World AI Evaluation Platform

Arena • San Francisco (CA)

On-site
USD 150,000 - 190,000
Competitive compensation
Comprehensive health & wellness"
Cutting-edge AI projects
ML Engineer: Build Real-World AI Evaluation Pipelines
ML Engineer: Build Real-World AI Evaluation Pipelines

Speedrun Talent Network • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
ML Engineer - AI Evaluation & Benchmarking Platform
ML Engineer - AI Evaluation & Benchmarking Platform

Arena Intelligence, Inc. • California

On-site
USD 170,000 - 230,000
Comprehensive health benefits
Cutting-edge AI projects
Small, mission-driven team
Machine Learning Engineer
Machine Learning Engineer

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
Machine Learning Engineer
Machine Learning Engineer

Speedrun Talent Network • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
Machine Learning Engineer
Machine Learning Engineer

Arena • San Francisco (CA)

On-site
USD 150,000 - 190,000
Competitive compensation
Comprehensive health & wellness"
Cutting-edge AI projects
AI Evaluation Scientist — Real-World ML Research
AI Evaluation Scientist — Real-World ML Research

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 170,000 - 210,000
Competitive compensation
Equity
Health benefits
+2
Machine Learning Engineer
Machine Learning Engineer

Arena Intelligence, Inc. • California

On-site
USD 170,000 - 230,000
Comprehensive health benefits
Cutting-edge AI projects
Small, mission-driven team
Lead ML Engineer — Evaluation & Production AI Platforms
Lead ML Engineer — Evaluation & Production AI Platforms

ASAPP, Inc. • New York (NY)

Hybrid
USD 170,000 - 190,000
Equity grant
Stock options
Health insurance
+3
Senior Platform Engineer — Go, APIs & AI Evaluation
Senior Platform Engineer — Go, APIs & AI Evaluation

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity
Health benefits
Competitive salary
+1