Real-Time ML Infrastructure Engineer

Arena

San Francisco (CA)

On-site

USD 180,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive pay
Equity
Health benefits
Cutting-edge AI
Transparent culture

Job summary

Arena Intelligence is seeking a Member of Technical Staff - ML Infrastructure software engineer to lead the design and development of scalable, real-time data and API infrastructure. You’ll architect systems handling large volumes of serving requests to power researchers and developers building cutting-edge AI applications.

You will work with AI researchers, product leaders, and engineers to deliver resilient, extensible systems in a fast-moving environment, mentoring teammates on best practices

Qualifications

  • 5+ years of software engineering experience focusing on infrastructure or large-scale data/ML systems
  • Deep expertise in distributed systems and stream processing
  • Proven ability to design low-latency, high-throughput, fault-tolerant services
  • Strong foundations in systems design and performance tuning
  • Comfortable in fast-growth, high-ownership environments
  • PyTorch model development experience is a bonus

Responsibilities

  • Architect and scale real-time API and data systems
  • Design low-latency pipelines for large-scale event streams
  • Ensure data integrity, availability, and consistency across systems
  • Mentor engineers on infrastructure best practices and performance
  • Collaborate with AI researchers, product leaders, and engineers to meet evolving needs

Skills

Distributed systems
Stream processing
Low-latency design
Scalable backend
System design
PyTorch (bonus)

Job description

Arena Intelligence is seeking a Member of Technical Staff - ML Infrastructure software engineer to lead the design and development of scalable, real-time data and API infrastructure. You’ll architect systems handling large volumes of serving requests to power researchers and developers building cutting-edge AI applications.

You will work with AI researchers, product leaders, and engineers to deliver resilient, extensible systems in a fast-moving environment, mentoring teammates on best practices

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infra Engineer — Real-Time, Scalable Data Systems
ML Infra Engineer — Real-Time, Scalable Data Systems

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive pay
Equity
Health benefits
+2
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
Senior ML Infra Engineer — Real-Time, Low-Latency
Senior ML Infra Engineer — Real-Time, Low-Latency

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
Staff AI Infrastructure Engineer: Scale ML at the Edge
Staff AI Infrastructure Engineer: Scale ML at the Edge

Anduril Industries • Costa Mesa (CA)

On-site
USD 220,000 - 292,000
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
+1
Senior ML Platform Engineer — Real-Time, Scalable AI
Senior ML Platform Engineer — Real-Time, Scalable AI

super • United States

On-site
USD 140,000 - 190,000
Medical / Health Insurance
Open Annual Leave
Employee Assistance Programme
+1
ML Platform Engineer — Build Scalable AI Infra & Inference
ML Platform Engineer — Build Scalable AI Infra & Inference

Not Specified • United States

Remote
USD 140,000 - 180,000
Software Engineer - Platform
Software Engineer - Platform

Arena • San Francisco (CA)

On-site
USD 140,000 - 230,000
Data Infrastructure Engineer — Scale Real‑World AI Pipelines
Data Infrastructure Engineer — Scale Real‑World AI Pipelines

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Health benefits
Equity
Cutting-edge AI