Senior LLM Solutions Architect - Remote Production-Grade

Fdetimes; Amsterdam; Remote; EUR 185,000 - 232,000; Full time

Benefits offered by this job

Health Insurance

401(k) Match

Parental Leave

Remote Work Reimbursement

Disability & Life Insurance

Job summary

Nebius is seeking a Principal ML Solutions Architect for Token Factory, our serverless platform for running and customizing open-source LLMs in production. You will set technical direction across strategic accounts, design optimized inference and fine-tuning workflows, and mentor other architects.

This role offers remote work from the United States with global teams; you will collaborate with product, engineering and research to shape the platform roadmap, improve performance, reliability, and

Qualifications

• 8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI.
• Demonstrated technical leadership: owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers.
• Expert knowledge of the LLM ecosystem: model architectures, fine-tuning approaches, and inference internals.
• Deep, hands-on command of inference optimization: quantization, KV-cache management, batching, routing, etc.
• Hands-on experience with running LLMs in production at scale: deploying, operating, and debugging inference workloads down to the framework level.
• LLM fine-tuning, including SFT/LoRA and data preparation/curation; experience with RL-based fine-tuning.
• LLM evaluation: building task-specific benchmarks and offline/online eval pipelines, including LLM-as-a-judge setups.
• Inference frameworks and libraries (vLLM, SGLang, TensorRT-LLM), including the ability to read, modify, and contribute to their internals.
• Deploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models.
• Strong Python programming skills.
• Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences, from engineers to executives.

Responsibilities

• Own the most complex, highest-stakes customer engagements from architecture through production across multiple modalities, driving measurable business value.
• Optimize LLM inference at the framework and hardware level and codify the resulting best practices into reusable playbooks for the team.
• Lead supervised and reinforcement fine-tuning efforts to maximize model quality.
• Design and implement production-ready LLM solutions using Token Factory's inference services.
• Provide deep technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade-offs at scale.
• Partner closely with product, engineering and research to surface customer needs, prototype platform features, and directly influence the roadmap.
• Guide customers from PoC to production with a focus on performance, reliability, and cost efficiency — and define the standards by which the team does so.
• Mentor Senior and mid-level Solutions Architects; raise the technical bar of the team through review, enablement, and knowledge sharing.
• Represent Token Factory externally through talks, blog posts, and conferences

Skills

ML systems

LLMs & genAI

technical leadership

prompt engineering

RAG architectures

cost/perf tradeoffs

Python programming

Tools

Python

vLLM

TensorRT-LLM

SGLang

Transformers

Kubernetes

Docker

Git

OpenAI/Anthropic SDKs

Job description

Nebius is seeking a Principal ML Solutions Architect for Token Factory, our serverless platform for running and customizing open-source LLMs in production. You will set technical direction across strategic accounts, design optimized inference and fine-tuning workflows, and mentor other architects.

This role offers remote work from the United States with global teams; you will collaborate with product, engineering and research to shape the platform roadmap, improve performance, reliability, and