LLM Serving Engineer, Cloud AI Platform Architect

Qualcomm; Austin (TX); On-site; USD 158,400 - 237,600; Full time

Benefits offered by this job

Competitive salary

Annual discretionary bonus

RSU grants opportunity

Job summary

A leading technology company in Austin is seeking an LLM Serving Engineer to build scalable inference platforms. The role requires hands-on experience with LLM serving packages and strong Python skills. Candidates should be proactive learners familiar with developing language models using PyTorch. A collaborative mindset and excellent communication skills are essential for success in this fast-paced environment. The position offers a competitive compensation package along with growth opportunities and a dynamic work culture.

Qualifications

• Hands-on experience in one or more LLM serving/Orchestration packages.
• Strong experience in developing language models using PyTorch.
• Strong Python development skills for large-scale projects.

Responsibilities

• Build a scalable LLM inference platform using advanced techniques.
• Contribute to LLM Serving packages development.
• Work closely with customers to drive solutions.

Skills

LLM Serving/Orchestration packages

Deep understanding of foundational LLMs

Experience in developing language models using PyTorch

Strong computer science fundamentals

Understanding of computer architecture

Strong Python development skills

Experience in analyzing deep learning workloads

Proactive learning on inference optimization techniques

Communication and problem-solving skills

Education

Bachelor's degree in Computer Science or related field

Master's degree in Computer Science or related field

PhD in Computer Science or related field

Job description

A leading technology company in Austin is seeking an LLM Serving Engineer to build scalable inference platforms. The role requires hands-on experience with LLM serving packages and strong Python skills. Candidates should be proactive learners familiar with developing language models using PyTorch. A collaborative mindset and excellent communication skills are essential for success in this fast-paced environment. The position offers a competitive compensation package along with growth opportunities and a dynamic work culture.