Senior ML Infrastructure Engineer – Distributed Inference

FDE Times

Ontario (CA)

Presencial

USD 180.000 - 260.000

Jornada completa

Hace 12 días

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Competitive Compensation
Equity Donation Matching
Generous Vacation
Parental Leave
Flexible Working Hours

Descripción de la vacante

FDE Times is designing, building, and operating distributed inference systems to serve Claude at scale. This role focuses on intelligent routing, load balancing, autoscaling, accelerator orchestration, and reliable model deployment to improve compute efficiency and researcher infrastructure.

You will work on production-grade ML infrastructure, optimizing routing, deployment pipelines, and multi-region deployments, with a strong emphasis on performance and observability.

Formación

  • Requires significant software engineering experience, particularly with distributed systems.
  • Preferred qualifications include large-scale distributed systems, production machine learning, routing or traffic management, LLM inference optimization, Kubernetes and cloud infrastructure.
  • A bachelor's degree or equivalent education, training, or experience is the stated minimum.

Conocimientos

Distributed Systems
Machine Learning Systems
High-Performance Computing
Inference Optimization
Request Routing
Load Balancing
Traffic Management
Autoscaling
Fleet Orchestration
Deployment Pipelines
Kubernetes
Cloud Infrastructure
Python
Rust
Observability
Multi-Region Deployments

Educación

Bachelor's degree or equivalent

Herramientas

Kubernetes
Cloud Platforms
Python
Rust

Descripción del empleo

FDE Times is designing, building, and operating distributed inference systems to serve Claude at scale. This role focuses on intelligent routing, load balancing, autoscaling, accelerator orchestration, and reliable model deployment to improve compute efficiency and researcher infrastructure.

You will work on production-grade ML infrastructure, optimizing routing, deployment pipelines, and multi-region deployments, with a strong emphasis on performance and observability.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Distributed Systems Engineer, Inference at Scale
Senior Distributed Systems Engineer, Inference at Scale

Anthropic Limited • New York (NY)

Híbrido
USD 320.000 - 485.000
Staff + Senior Software Engineer, Inference
Staff + Senior Software Engineer, Inference

FDE Times • Ontario (CA)

Presencial
USD 180.000 - 260.000
Competitive Compensation
Equity Donation Matching
Generous Vacation
+2
Senior AI/ML Infra Engineer: Scalable Environments, Equity
Senior AI/ML Infra Engineer: Scalable Environments, Equity

FDE Times • Mountain View (CA)

Presencial
USD 150.000 - 230.000
Annual Performance Bonus
Equity
Staff Software Engineer, Scalable Inference Infrastructure
Staff Software Engineer, Scalable Inference Infrastructure

Anthropic Limited • Seattle (WA)

Híbrido
USD 320.000 - 485.000
Competitive compensation and benefits
Equity donation matching (optional)
Generous vacation and parental leave
+2
Staff ML Inference Infra Engineer (Safety)
Staff ML Inference Infra Engineer (Safety)

FDE Times • San Francisco (CA)

Híbrido
USD 320.000 - 485.000
Senior Systems Engineer - Scalable AI Inference
Senior Systems Engineer - Scalable AI Inference

FDE Times • San Francisco (CA)

Híbrido
CAD 140.000 - 200.000
Competitive compensation
Hybrid work model
Generous vacation policy
Senior/Staff Software Engineer — Scalable AI Inference Systems
Senior/Staff Software Engineer — Scalable AI Inference Systems

EngineersOfAI • New York (NY)

Presencial
USD 180.000 - 280.000
Staff Backend Engineer, AI Platform & Model Serving
Staff Backend Engineer, AI Platform & Model Serving

FDE Times • San Francisco (CA)

Presencial
USD 190.000 - 260.000
ML Infrastructure Engineer — Scalable AI Inference
ML Infrastructure Engineer — Scalable AI Inference

Abridge • San Francisco (CA)

Presencial
USD 170.000 - 210.000
Generous Time Off
Comprehensive Health Plans
Generous 401(k) Matching
+4
Senior ML Infra Engineer - Large-Scale Training & Pipelines
Senior ML Infra Engineer - Large-Scale Training & Pipelines

Kindredventures • San Francisco (CA)

Presencial
USD 160.000 - 220.000