Senior ML Infra Engineer — Real-Time, Low-Latency

LMArena; San Francisco (CA); On-site; USD 170,000 - 260,000; Full time

Benefits offered by this job

Competitive compensation

Comprehensive health benefits

Opportunity to work on cutting-edge AI

Job summary

A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal applicants have over five years of experience in software engineering with a strong background in distributed systems and a passion for building reliable infrastructure. This role offers competitive compensation and a chance to work with cutting-edge AI technologies in a collaborative environment.

Qualifications

• 5+ years of experience in software engineering, focusing on infrastructure or large-scale data and ML systems.
• Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems.
• Comfortable in a dynamic, high-ownership, fast-growth environment.

Responsibilities

• Architect and scale high-performance, real-time API and data systems.
• Design and implement low-latency pipelines to process and analyze large-scale event streams.
• Mentor engineers on infrastructure best practices and performance tuning.

Skills

Distributed systems

Stream processing

Scalable backend architecture

Performance tuning

Fault-tolerant systems

Job description

A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal applicants have over five years of experience in software engineering with a strong background in distributed systems and a passion for building reliable infrastructure. This role offers competitive compensation and a chance to work with cutting-edge AI technologies in a collaborative environment.