Senior LLM Inference Engineer — Distributed Systems

QUALCOMM, Inc.

Santa Clara (CA)

On-site

USD 162,000 - 243,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Qualcomm Technologies, Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms in Santa Clara, CA.

You will work across open-source LLM serving projects, distributed systems, cloud-native infrastructure, and accelerator software to enable scalable, production-grade LLM workloads. You will contribute to llm-d and related tools, integrate with Qualcomm AI accelerators, and collaborate with upstream communities to shape

Qualifications

  • Bachelor's degree with 4+ years in hardware/software/systems engineering or related work experience.
  • Master's degree with 3+ years in hardware/software/systems engineering or related work experience.
  • PhD with 2+ years in hardware/software/systems engineering or related work experience.

Responsibilities

  • Contribute features, improvements, bug fixes, and architectural enhancements to open-source LLM inference projects.
  • Develop and improve support for Qualcomm AI accelerators in open-source LLM serving frameworks.
  • Work with upstream maintainers to design, review, and upstream Qualcomm-related functionality.
  • Develop and enhance inference engine integrations for Qualcomm platforms, including device abstraction and memory management.
  • Design and implement distributed LLM inference capabilities such as multi-node inference and autoscaling.
  • Integrate LLM inference software with Kubernetes and cloud-native infrastructure.
  • Profile, benchmark, and optimize end-to-end inference performance.
  • Diagnose complex issues across multiple layers of the stack.
  • Collaborate with hardware, firmware, compiler, runtime, and product teams to deliver end-to-end solutions.
  • Develop documentation, reference deployments, and best practices for deploying LLM workloads.
  • Participate in architecture discussions and influence Qualcomm's open-source LLM strategy.

Skills

Software engineering
Debugging
Python
C++
Go
Rust
Distributed systems
ML inference
Cloud-native/Kubernetes
Open-source

Education

Bachelor's degree in Computer Science/Engineering/Information Systems or related (4+ years)
Master's degree in related field (3+ years)
PhD in related field (2+ years)

Tools

llm-d
KServe
Kubernetes Gateway API
Kubernetes operators
cloud-native AI infrastructure

Job description

Qualcomm Technologies, Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms in Santa Clara, CA.

You will work across open-source LLM serving projects, distributed systems, cloud-native infrastructure, and accelerator software to enable scalable, production-grade LLM workloads. You will contribute to llm-d and related tools, integrate with Qualcomm AI accelerators, and collaborate with upstream communities to shape

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior LLM Inference Engineer — Cloud & Accelerators
Senior LLM Inference Engineer — Cloud & Accelerators

SAM Seamless Network • San Diego (CA)

On-site
USD 162,000 - 243,000
Senior LLM Inference Engineer: Infra & Accelerators
Senior LLM Inference Engineer: Infra & Accelerators

QUALCOMM, Inc. • Santa Clara (CA)

On-site
USD 162,000 - 243,000
Senior / Staff LLM Serving Engineer – Cloud AI Inference
Senior / Staff LLM Serving Engineer – Cloud AI Inference

SAM Seamless Network • San Diego (CA)

On-site
USD 162,000 - 243,000
Principal AI Systems Engineer - LLM Inference (Cloud)
Principal AI Systems Engineer - LLM Inference (Cloud)

Qualcomm • San Diego (CA)

On-site
USD 224,000 - 335,000
Senior/Staff Software Engineer - LLM Inference Systems & Open-Source
Senior/Staff Software Engineer - LLM Inference Systems & Open-Source

SAM Seamless Network • San Diego (CA)

On-site
USD 162,000 - 243,000
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer
LLM Serving Engineer (Cloud AI Engineering), Senior / Staff Engineer

Qualcomm • San Diego (CA)

On-site
USD 158,400 - 237,600
Competitive annual discretionary bonus program
Potential RSU grants
Comprehensive benefits package
Principal SW Engineer - LLM Serving (Cloud AI)
Principal SW Engineer - LLM Serving (Cloud AI)

Qualcomm • San Diego (CA)

On-site
USD 224,000 - 335,000
Senior LLM Inference Systems Engineer
Senior LLM Inference Systems Engineer

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 310,000
Medical insurance
Bonus & equity plan
401(k) retirement plan
+1
Senior LLM Inference Systems Engineer
Senior LLM Inference Systems Engineer

Snowflake • Menlo Park (CA)

On-site
USD 236,000 - 310,000
Bonus and equity plan
Medical, dental, vision insurance
401(k) retirement plan
+1
Senior/Staff Software Engineer - LLM Inference Systems & Open-Source
Senior/Staff Software Engineer - LLM Inference Systems & Open-Source

QUALCOMM, Inc. • Santa Clara (CA)

On-site
USD 162,000 - 243,000