Senior / Staff LLM Serving Engineer – Cloud AI Inference

SAM Seamless Network

San Diego (CA)

On-site

USD 162,000 - 243,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Qualcomm Technologies, Inc. is seeking an LLM Serving Engineer (Cloud AI Engineering) to help build a scalable inference platform and contribute to a range of serving packages.

The role spans research, development, and deployment, requiring deep knowledge of transformer architectures and practical software engineering. The team works across compiler, firmware, and platform groups to deliver optimized AI solutions, with emphasis on performance, scalability, and reliability in a fast-paced

Qualifications

  • Bachelor's degree with 4+ years of Hardware/Software/Systems Engineering experience.
  • Master's degree with 3+ years of related work experience.
  • PhD with 2+ years of related work experience.

Responsibilities

  • Build a scalable LLM inference platform using state-of-the-art techniques.
  • Contribute to LLM Serving packages (e.g. vLLM, SGLang, TGI, Triton-Inference server).
  • Collaborate with customers and internal teams across compiler, firmware and platform domains.
  • Advance GenAI knowledge by studying attention mechanisms, MoEs, and numerics for optimization opportunities.
  • Drive autoscaling, load balancing, and routing for efficient serving.
  • Engage with open-source communities to evolve the framework.

Skills

Python development
PyTorch
Distributed systems
CS fundamentals
Problem solving
LLM serving
Communication

Education

MS in Computer Science/Engineering/ML
PhD in CS/Engineering/ML
Bachelor's degree in CS/Engineering/Info Systems

Tools

Triton-Inference Server
vLLM
SGLang
Ollama
llm-d
KServe
MoonCake
LMCache

Job description

Qualcomm Technologies, Inc. is seeking an LLM Serving Engineer (Cloud AI Engineering) to help build a scalable inference platform and contribute to a range of serving packages.

The role spans research, development, and deployment, requiring deep knowledge of transformer architectures and practical software engineering. The team works across compiler, firmware, and platform groups to deliver optimized AI solutions, with emphasis on performance, scalability, and reliability in a fast-paced

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior LLM Inference Engineer — Cloud & Accelerators
Senior LLM Inference Engineer — Cloud & Accelerators

SAM Seamless Network • San Diego (CA)

On-site
USD 162,000 - 243,000
Principal AI Systems Engineer - LLM Inference (Cloud)
Principal AI Systems Engineer - LLM Inference (Cloud)

Qualcomm • San Diego (CA)

On-site
USD 224,000 - 335,000
Senior LLM Inference Engineer: Infra & Accelerators
Senior LLM Inference Engineer: Infra & Accelerators

QUALCOMM, Inc. • Santa Clara (CA)

On-site
USD 162,000 - 243,000
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer

Qualcomm • San Diego (CA)

On-site
USD 158,400 - 237,600
Competitive annual discretionary bonus program
Potential RSU grants
Comprehensive benefits package
Senior LLM Inference Engineer — Distributed Systems
Senior LLM Inference Engineer — Distributed Systems

QUALCOMM, Inc. • Santa Clara (CA)

On-site
USD 162,000 - 243,000
Senior Cloud AI LLM Serving Engineer
Senior Cloud AI LLM Serving Engineer

Qualcomm • San Diego (CA)

On-site
USD 158,400 - 237,600
Competitive annual discretionary bonus program
Potential RSU grants
Comprehensive benefits package
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer

QUALCOMM, Inc. • Austin (TX)

On-site
USD 158,400 - 237,600
Competitive salary
Annual discretionary bonus
RSU grants opportunity
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer

SAM Seamless Network • San Diego (CA)

On-site
USD 162,000 - 243,000
Principal SW Engineer - LLM Serving (Cloud AI)
Principal SW Engineer - LLM Serving (Cloud AI)

Qualcomm • San Diego (CA)

On-site
USD 224,000 - 335,000
LLM Serving Engineer, Cloud AI Platform Architect
LLM Serving Engineer, Cloud AI Platform Architect

QUALCOMM, Inc. • Austin (TX)

On-site
USD 158,400 - 237,600
Competitive salary
Annual discretionary bonus
RSU grants opportunity