Senior/Principal LLM Serving Performance Engineer On-site

Microsoft Corp.

United States

On-site

USD 121,000 - 163,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Microsoft Corp. in Redmond, WA is seeking a Senior and/or Principal Software Engineer focused on LLM serving performance. This on-site role develops scalable inference systems, reduces latency, and improves throughput for production-grade language models.

You will work with a motivated team to ship robust ML infrastructure, share ownership of critical components, and drive performance improvements in a large-scale Microsoft environment.

Job description

Microsoft Corp. in Redmond, WA is seeking a Senior and/or Principal Software Engineer focused on LLM serving performance. This on-site role develops scalable inference systems, reduces latency, and improves throughput for production-grade language models.

You will work with a motivated team to ship robust ML infrastructure, share ownership of critical components, and drive performance improvements in a large-scale Microsoft environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior and/or Principal Software Engineer- LLM Serving Performance
Senior and/or Principal Software Engineer- LLM Serving Performance

Microsoft Corp. • United States

On-site
USD 121,000 - 163,000
ML Inference Engineer — High-Performance LLM Serving
ML Inference Engineer — High-Performance LLM Serving

Amazon Inc. • Bellevue (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Software Engineer, LLM Performance & Systems
Software Engineer, LLM Performance & Systems

Baseten • Seattle (WA)

On-site
USD 165,000 - 330,000
Competitive compensation & equity
US medical/dental/vision insurance for
flexible PTO including Winter Break
+3
MLOps & LLM Performance Engineer — Remote
MLOps & LLM Performance Engineer — Remote

Mercor • San Francisco (CA)

Hybrid
GBP 94,000 - 125,000
Senior ML Inference Engineer - LLM Serving on Accelerators
Senior ML Inference Engineer - LLM Serving on Accelerators

Annapurna Labs • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+1
LLM Inference Engineer: Peak-Performance AI Serving
LLM Inference Engineer: Peak-Performance AI Serving

Majestic Labs ai • Los Altos (CA)

On-site
USD 210,000 - 350,000
Senior LLM Inference Engineer, Performance Lead
Senior LLM Inference Engineer, Performance Lead

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 240,000
LLM Systems Architect — Bay Area (Onsite)
LLM Systems Architect — Bay Area (Onsite)

Harnham • San Francisco (CA)

On-site
USD 450,000 - 550,000
Senior LLM-Powered Backend Engineer
Senior LLM-Powered Backend Engineer

Amazon Inc. • Seattle (WA)

On-site
USD 168,000 - 227,000
Senior ML Inference Engineer — High-Performance LLM Serving
Senior ML Inference Engineer — High-Performance LLM Serving

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+2