ML Infra Engineer — Real-Time, Scalable Data Systems

Arena Intelligence, Inc.

San Francisco (CA)

On-site

USD 180,000 - 230,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Competitive compensation & equity
Health benefits
Cutting-edge AI work
Culture of transparency

Job summary

Arena Intelligence in San Francisco seeks a Member of Technical Staff - ML Infrastructure software engineer to design and build scalable, real-time data and API infrastructure that powers researchers and developers. You will architect low-latency pipelines, ensure reliability, and mentor engineers, collaborating with AI researchers and product teams to meet evolving needs.

This role offers the chance to work on cutting-edge AI with a mission-driven team and a culture of excellence, energy, and

Qualifications

  • 5+ years of software engineering experience in infrastructure or large-scale ML systems.
  • Deep expertise in distributed systems, stream processing, and scalable backend architecture.
  • Proven ability to design and operate low-latency, high-throughput, fault-tolerant systems.
  • Strong foundation in systems design, performance tuning, and building reliable services.
  • Comfortable in a dynamic, high-ownership, fast-growth environment.
  • Prior experience with PyTorch model development is a plus.

Responsibilities

  • Architect and scale high-performance, real-time API and data systems.
  • Design and implement low-latency pipelines to process and analyze large-scale event streams.
  • Ensure reliability through robust data integrity, availability, and consistency mechanisms.
  • Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning.
  • Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems.

Skills

Distributed systems
Stream processing
Backend architecture
Low-latency systems
Performance tuning
Mentoring engineers
PyTorch (optional)

Tools

PyTorch

Job description

Arena Intelligence in San Francisco seeks a Member of Technical Staff - ML Infrastructure software engineer to design and build scalable, real-time data and API infrastructure that powers researchers and developers. You will architect low-latency pipelines, ensure reliability, and mentor engineers, collaborating with AI researchers and product teams to meet evolving needs.

This role offers the chance to work on cutting-edge AI with a mission-driven team and a culture of excellence, energy, and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Real-Time ML Infrastructure Engineer
Real-Time ML Infrastructure Engineer

Arena • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive pay
Equity
Health benefits
+2
Senior ML Infra Engineer — Real-Time, Low-Latency
Senior ML Infra Engineer — Real-Time, Low-Latency

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive pay
Equity
Health benefits
+2
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive compensation & equity
Health benefits
Cutting-edge AI work
+1
ML Infra Architect: Build Scalable Data & Training Pipelines
ML Infra Architect: Build Scalable Data & Training Pipelines

Humble Robotics • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior Infrastructure Engineer, Real-Time AI Platform
Senior Infrastructure Engineer, Real-Time AI Platform

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation
Equity
Health benefits
+1
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

LMArena • San Francisco (CA)

On-site
USD 170,000 - 260,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
+1
ML Infra Engineer (Data Systems)
ML Infra Engineer (Data Systems)

Physical Intelligence • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior ML Platform Engineer — Scale Research ML Infra
Senior ML Platform Engineer — Scale Research ML Infra

techire ai • San Francisco (CA)

On-site
USD 270,000 - 330,000
Stock options
Senior ML Systems Engineer — Scalable AI Infra
Senior ML Systems Engineer — Scalable AI Infra

Meta • Menlo Park (CA)

On-site
USD 347,000 - 403,000