Software Engineer - ML Infrastructure

Arena

San Francisco (CA)

On-site

USD 180,000 - 230,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Competitive pay
Equity
Health benefits
Cutting-edge AI
Transparent culture

Job summary

Arena Intelligence is seeking a Member of Technical Staff - ML Infrastructure software engineer to lead the design and development of scalable, real-time data and API infrastructure. You’ll architect systems handling large volumes of serving requests to power researchers and developers building cutting-edge AI applications.

You will work with AI researchers, product leaders, and engineers to deliver resilient, extensible systems in a fast-moving environment, mentoring teammates on best practices

Qualifications

  • 5+ years of software engineering experience focusing on infrastructure or large-scale data/ML systems
  • Deep expertise in distributed systems and stream processing
  • Proven ability to design low-latency, high-throughput, fault-tolerant services
  • Strong foundations in systems design and performance tuning
  • Comfortable in fast-growth, high-ownership environments
  • PyTorch model development experience is a bonus

Responsibilities

  • Architect and scale real-time API and data systems
  • Design low-latency pipelines for large-scale event streams
  • Ensure data integrity, availability, and consistency across systems
  • Mentor engineers on infrastructure best practices and performance
  • Collaborate with AI researchers, product leaders, and engineers to meet evolving needs

Skills

Distributed systems
Stream processing
Low-latency design
Scalable backend
System design
PyTorch (bonus)

Job description

About Arena Intelligence

Arena is the platform for evaluating how AI models perform in the real world. Founded by researchers from UC Berkeley's SkyLab, we're on a mission to measure and advance the frontier of AI for real-world use, and to build the foundation for everyone to understand, shape, and benefit from it.


Tens of millions of people use Arena each month to evaluate how frontier systems handle the work they actually do. The preferences they share power the most transparent, rigorous, and human-centered evaluations in AI. Leading AI labs, enterprises, and independent researchers rely on our work and open datasets to understand how models behave in real workflows: agentic coding, creative generation, professional productivity, and beyond. We go beyond leaderboards and decompose what human experience reveals about AI, so models advance toward the work people actually do.


We're a team of researchers, academics, builders, and creatives from UC Berkeley, Google, Stanford, and DeepMind. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We're building a company where thoughtful, curious people from all backgrounds can do their best work together, in an office culture that radiates excellence, energy, and focus.

About the Role

Arena Intelligence is seeking a Member of Technical Staff - ML Infrastructure software engineer to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you’ll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world’s most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real‑world use cases.

You’ll
  • Architect and scale high-performance, real-time API and data systems

  • Design and implement low-latency pipelines to process and analyze large-scale event streams

  • Ensure reliability through robust data integrity, availability, and consistency mechanisms

  • Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning

  • Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems

You’ll have
  • 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems

  • Deep expertise in distributed systems, stream processing, and scalable backend architecture

  • Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems

  • Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services

  • Comfortable in a dynamic, high-ownership, fast-growth environment

  • Prior experience with PyTorch model development is a plus.

What we offer
  • We offer competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate’s permanent work location.

  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.

  • The opportunity to work on cutting-edge AI with a small, mission-driven team

  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

Arena Intelligence • Bay (AR)

On-site
USD 120,000 - 180,000
Equity
Health benefits
Work on cutting-edge AI
Site Reliability Engineer
Site Reliability Engineer

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation
Equity
Health benefits
+1
Site Reliability Engineer (SRE)
Site Reliability Engineer (SRE)

Arena • San Francisco (CA)

On-site
USD 180,000 - 250,000
Competitive compensation
Equity
Health benefits
+1
Software Engineer - Data Infrastructure
Software Engineer - Data Infrastructure

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Health benefits
Equity
Cutting-edge AI
AI Solutions Engineer — Customer Relations & Platform Build
AI Solutions Engineer — Customer Relations & Platform Build

Arena • San Francisco (CA)

On-site
USD 160,000 - 210,000
Product Solutions Engineer
Product Solutions Engineer

Arena • San Francisco (CA)

On-site
USD 160,000 - 210,000
Equity
Health benefits
AI at work
+1
Backend Engineer
Backend Engineer

Arena • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity
Health benefits
Cutting-edge AI work
+1
Applied AI Engineer
Applied AI Engineer

Arena • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
Equity
Health benefits
+1
Senior Software Engineer, Product
Senior Software Engineer, Product

Arena • San Francisco (CA)

On-site
USD 170,000 - 250,000
Competitive compensation & equity
Comprehensive health benefits
Cutting-edge AI on a mission-driven团队