Real-Time ML Infrastructure Engineer

Arena

San Francisco (CA)

On-site

USD 180,000 - 230,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Competitive pay
Equity
Health benefits
Cutting-edge AI
Transparent culture

Job summary

Arena Intelligence is seeking a Member of Technical Staff - ML Infrastructure software engineer to lead the design and development of scalable, real-time data and API infrastructure. You’ll architect systems handling large volumes of serving requests to power researchers and developers building cutting-edge AI applications.

You will work with AI researchers, product leaders, and engineers to deliver resilient, extensible systems in a fast-moving environment, mentoring teammates on best practices

Qualifications

  • 5+ years of software engineering experience focusing on infrastructure or large-scale data/ML systems
  • Deep expertise in distributed systems and stream processing
  • Proven ability to design low-latency, high-throughput, fault-tolerant services
  • Strong foundations in systems design and performance tuning
  • Comfortable in fast-growth, high-ownership environments
  • PyTorch model development experience is a bonus

Responsibilities

  • Architect and scale real-time API and data systems
  • Design low-latency pipelines for large-scale event streams
  • Ensure data integrity, availability, and consistency across systems
  • Mentor engineers on infrastructure best practices and performance
  • Collaborate with AI researchers, product leaders, and engineers to meet evolving needs

Skills

Distributed systems
Stream processing
Low-latency design
Scalable backend
System design
PyTorch (bonus)

Job description

Arena Intelligence is seeking a Member of Technical Staff - ML Infrastructure software engineer to lead the design and development of scalable, real-time data and API infrastructure. You’ll architect systems handling large volumes of serving requests to power researchers and developers building cutting-edge AI applications.

You will work with AI researchers, product leaders, and engineers to deliver resilient, extensible systems in a fast-moving environment, mentoring teammates on best practices

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

ML Infra Engineer — Real-Time, Scalable Data Systems
ML Infra Engineer — Real-Time, Scalable Data Systems

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive pay
Equity
Health benefits
+2
Senior Infrastructure Engineer, Real-Time AI Platform
Senior Infrastructure Engineer, Real-Time AI Platform

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation
Equity
Health benefits
+1
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
Senior ML Infra Engineer — Real-Time, Low-Latency
Senior ML Infra Engineer — Real-Time, Low-Latency

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
+1
Staff AI Infrastructure Engineer – ML Platform & Edge
Staff AI Infrastructure Engineer – ML Platform & Edge

Anduril Industries • Costa Mesa (CA)

On-site
USD 220,000 - 292,000
Senior ML Platform Engineer: Real-Time AI Infra
Senior ML Platform Engineer: Real-Time AI Infra

Harnham • New York (NY)

Hybrid
USD 150,000 - 190,000
Competitive base salary and annual be
Equity participation through RSUs
Opportunity to work on cutting-edge AI
+2
Senior ML Engineer: Scale Real-Time AI (Remote)
Senior ML Engineer: Scale Real-Time AI (Remote)

The Briefed • Northern (KY)

Hybrid
USD 145,000 - 209,000
Equity stake
Discretionary annual bonus
Flexible remote work
+10
Senior Systems ML Engineer: Scalable AI Infrastructure
Senior Systems ML Engineer: Scalable AI Infrastructure

Meta • Providence (RI)

On-site
USD 154,000 - 217,000