Senior AI Inference Infrastructure Engineer

Modular

United States

Híbrido

USD 167.000 - 273.000

Jornada completa

14 días+

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Competitive salary
Premier insurance plans
Flexible paid time off
Team building events

Descripción de la vacante

A leading AI infrastructure company is seeking a Software Engineer for its Inference Infrastructure team. This role involves building LLM-focused inference services and creating distributed systems for high performance AI solutions. The ideal candidate will possess over 5 years of backend engineering experience and a strong background in ML inference infrastructure. Candidates can work hybrid from Los Altos, CA or remotely, making a significant impact in a collaborative team. Competitive compensation and comprehensive benefits are offered.

Formación

  • 5+ years of experience working in backend engineering.
  • Experience working on high-scale ML inference infrastructure.
  • Experience with Kubernetes and managing services.

Responsabilidades

  • Build and ship modular’s LLM focused inference services.
  • Create distributed systems for high performance inference.
  • Collaborate with kernels and genAI teams for application performance.

Conocimientos

Backend engineering
Machine learning inference
Kubernetes
Problem-solving

Herramientas

vLLM
TensorRT-LLM
Golang

Descripción del empleo

A leading AI infrastructure company is seeking a Software Engineer for its Inference Infrastructure team. This role involves building LLM-focused inference services and creating distributed systems for high performance AI solutions. The ideal candidate will possess over 5 years of backend engineering experience and a strong background in ML inference infrastructure. Candidates can work hybrid from Los Altos, CA or remotely, making a significant impact in a collaborative team. Competitive compensation and comprehensive benefits are offered.
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Backend Engineer, AI Inference Platform
Senior Backend Engineer, AI Inference Platform

Together AI • San Francisco (CA)

Presencial
USD 160.000 - 250.000
Competitive compensation
Startup equity
Health insurance
Senior Infrastructure Engineer — AI Inference at Scale (Remote)
Senior Infrastructure Engineer — AI Inference at Scale (Remote)

Inferact • San Francisco (CA)

Híbrido
USD 200.000 - 400.000
Generous health benefits
Dental and vision benefits
401(k) company match
Senior AI Inference Performance Engineer (Remote)
Senior AI Inference Performance Engineer (Remote)

DigitalOcean, Inc. • San Francisco (CA)

A distancia
USD 167.200 - 209.000
Competitive salary
Flexible time off policy
Employee Assistance Program
+2
Senior ML Infra Engineer - Real-Time AI Backends
Senior ML Infra Engineer - Real-Time AI Backends

Acceler8 Talent • San Francisco (CA)

Híbrido
USD 247.500 - 302.500
Senior AI Model Serving Engineer — Low-Latency Inference
Senior AI Model Serving Engineer — Low-Latency Inference

Neon • San Francisco (CA)

Presencial
USD 166.000 - 225.000
Annual performance bonus
Equity options
Comprehensive benefits package
Senior ML Systems Engineer - Distributed AI Inference
Senior ML Systems Engineer - Distributed AI Inference

Amazon Web Services (AWS) • Seattle (WA)

Presencial
USD 120.000 - 160.000
Inference Engineer
Inference Engineer

Acceler8 Talent • Palo Alto (CA)

Presencial
USD 180.000 - 320.000
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Anthropic Limited • San Francisco (CA)

Híbrido
USD 315.000 - 560.000
Competitive compensation
Generous vacation and parental leave
Flexible working hours
ML Infrastructure & Platform Engineer
ML Infrastructure & Platform Engineer

Odyssey • Palo Alto (CA)

Presencial
USD 180.000 - 250.000
Senior ML Infra Engineer — Real-Time, Low-Latency
Senior ML Infra Engineer — Real-Time, Low-Latency

LMArena • San Francisco (CA)

Presencial
USD 170.000 - 260.000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI