LLM Inference Platform Architect

QuTwo; Helsinki; In loco; EUR 90.000 - 130.000; Tempo pieno

Descrizione del lavoro

QuTwo, Europe’s private Quantum AI Lab, seeks an LLM Inference Platform Architect to design and lead a secure internal serving platform on GPU hardware. You will manage GPU clusters, inference engines, access control, and capacity planning to deliver a reliable AI service across the organization.

Collaborating with security, operations, and LLM scientists, you will set platform standards, ensure regulatory compliance (including DORA), and deploy optimized models while maintaining strict data

Competenze

• Experience designing and running large-scale infrastructure on Kubernetes with GPU workloads.
• Hands-on experience with LLM inference engines (vLLM, SGLang, TensorRT-LLM or similar).
• Infrastructure as code (Terraform or similar), CI/CD and observability tooling.
• Understanding of security, identity and network design in enterprise environments.
• Experience writing architecture guidelines and working with enterprise architecture teams.

Mansioni

• Design and lead a secure, internal LLM serving platform on GPU hardware.
• Manage the full serving stack: GPU clusters, inference engines, access control, capacity planning.
• Set platform standards and ensure regulatory compliance (e.g., DORA).
• Partner with security, operations, and LLM scientists to deploy optimized models.

Conoscenze

Kubernetes GPU workloads

LLM inference engines

Terraform

CI/CD

Observability tooling

Security & network design

Enterprise architecture collaboration

Architecture guidelines

Strumenti

vLLM

SGLang

TensorRT-LLM

CUDA

ROCm

Kubernetes

Descrizione del lavoro

JoinQuTwo - Europe's private Quantum AI Lab, on our quest to bridge the gap between the classical and the quantum world. We partner with the most advanced and forward-thinking customers, solving fundamental real-world problems, side by side.

We are a European AI lab for the quantum era, co-founded by pioneers behind IQM and Silo AI, with a team spanning MIT, UC Berkeley, Cambridge, and Carnegie Mellon, and backed by the founders of Skype, Hugging Face, Quantinuum, Supercell and many more. We work at the intersection of quantum computing, AI, optimization, and simulation — where the answers do not yet exist and the work genuinely matters.

We are seeking LLM Inference Platform Architect. If you are a humble learner, not afraid of the unknown, we encourage you to apply.

Role Description

The Infrastructure Architect designs and leads a secure, internal LLM serving platform on fully controlled GPU hardware, ensuring complete data privacy and independence from external model providers.

Managing the full serving stack—including GPU clusters, inference engines, access control, and capacity planning—this role delivers a reliable AI service for the entire organization. The architect sets platform standards, ensures strict regulatory compliance (such as DORA), and partners closely with security, operations, and LLM scientists to deploy optimized models.

Qualifications

• Experience designing and running large-scale infrastructure on Kubernetes, including GPU workloads

• Hands‑on experience with LLM inference engines (vLLM, SGLang, TensorRT-LLM or similar)

• Infrastructure as code (Terraform or similar), CI/CD and observability tooling

• Understanding of security, identity and network design in enterprise environments

• Experience writing architecture guidelines and working with enterprise architecture teams

Experience in one or more of the following areas is a plus but not a requirement:

• Hands‑on experience configuring and managing enterprise‑grade GPUs (NVIDIA or AMD Instinct) and their respective acceleration stacks (CUDA or ROCm).

• Background in banking or other highly regulated industries, with familiarity with DORA or equivalent compliance frameworks.