Cloud AI LLM Inference Engineer

Qualcomm; Cork; On-site; EUR 90,000 - 170,000; Full time

Benefits offered by this job

Salary, stock and performance related

Maternity/Paternity Leave

Employee stock purchase scheme

Relocation and immigration support

Life, Medical, Travel Insurance

Education Assistance

Job summary

QT Technologies Ireland Limited in Cork invites experienced engineers to join our Qualcomm Cloud AI team as LLM Serving Engineers at multiple levels. The role spans from cutting‑edge research to commercial deployment and demands strategic thinking, strong execution, and excellent communication.

You will build scalable LLM inference platforms, contribute to serving packages, and work with customers and internal teams on performance optimization.

Qualifications

• Hands-on experience in one or more LLM serving/Orchestration packages such as Triton-Inference Server, vLLM, SGLang, Ollama, llm-d, KServe, LMCache or MoonCake.
• Deep understanding of foundational LLMs, VLMs, SLMs and transformer-based architectures.
• Strong experience in developing language models using PyTorch.
• Strong CS fundamentals - algorithms, data structures, parallel and distributed programming.

Responsibilities

• Build a scalable LLM inference platform using advanced techniques (disaggregated serving, KV-Cache management, parallelism, model optimization, kernels).
• Contribute to the development of LLM Serving packages (e.g. vLLM, SGLang, TGI, Triton-Inference server, Dynamo, LLM-d).
• Collaborate with customers and internal teams (compiler, firmware, platform) to drive solutions.
• Work with GenAI concepts (attention, MoEs) to identify optimization opportunities.
• Drive autoscaling, load balancing and routing for efficient serving.
• Engage with open-source communities to evolve the framework.

Skills

Python development

PyTorch

Distributed systems

Algorithms & data structures

C/C++/Java

LLM serving packages

Open-source contributions

Education

Bachelor's degree in Engineering, Information Systems, Computer Science, or related field

Master's degree in Engineering, Information Systems, Computer Science, or related field

PhD in Engineering, Information Systems, Computer Science, or related field

Tools

Triton-Inference Server

vLLM

SGLang

Ollama

llm-d

KServe

LMCache

MoonCake

Job description

QT Technologies Ireland Limited in Cork invites experienced engineers to join our Qualcomm Cloud AI team as LLM Serving Engineers at multiple levels. The role spans from cutting‑edge research to commercial deployment and demands strategic thinking, strong execution, and excellent communication.

You will build scalable LLM inference platforms, contribute to serving packages, and work with customers and internal teams on performance optimization.