Principal ML Solutions Architect — Remote, LLM Inference

Nebius Group; Amsterdam; Hybride; EUR 187 000 - 234 000; Plein temps

Avantages offerts par ce poste

Health Insurance

401(k) Plan

Parental Leave

Remote Work Reimbursement

Disability & Life Insurance

Résumé du poste

Nebius, Amsterdam-based leader in AI cloud infrastructure, seeks a Principal ML Solutions Architect for Token Factory. You will own complex, customer-facing architecture and scale inference and fine-tuning workflows across major accounts.

You will set technical direction, mentor architects, and shape the platform roadmap with product and research teams, while delivering high-value, production-ready solutions from PoC to production. Remote work from the United States is welcome.

Qualifications

• 8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI.
• Demonstrated technical leadership: owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers.
• Expert knowledge of the LLM ecosystem: model architectures, fine-tuning approaches, and inference internals.
• Deep, hands-on command of inference optimization: quantization, KV-cache management, batching, routing, etc.
• Hands-on experience with: Running LLMs in production at scale; LLM fine-tuning (SFT/LoRA) and data preparation; RL-based fine-tuning.
• LLM evaluation: building benchmarks and evaluation pipelines; LLM-as-a-judge setups.
• Inference frameworks and libraries: vLLM, SGLang, TensorRT-LLM; ability to read/modify internals.
• Deploying LLM-powered applications using OpenAI/Anthropic or open-source models.

Responsabilités

• Own the most complex, highest-stakes customer engagements from architecture through production across multiple modalities, driving measurable business value.
• Optimize LLM inference at the framework and hardware level and codify best practices into reusable playbooks.
• Lead supervised and reinforcement fine-tuning efforts to maximize model quality.
• Design and implement production-ready LLM solutions using Token Factory's inference services.
• Provide deep technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade-offs at scale.
• Partner with product, engineering and research to surface customer needs and influence the roadmap.
• Guide customers from PoC to production with focus on performance, reliability, cost efficiency; define team standards.
• Mentor Senior and mid-level Solutions Architects; raise the technical bar through reviews and enablement.
• Represent Token Factory externally through talks, blogs, and conferences.

Connaissances

Technical leadership

LLM expertise

Inference optimization

LLM production

LLM fine-tuning

LLM evaluation

Frameworks & libraries

Python

Communication

DevOps

Kubernetes

Docker

OpenAI/Anthropic SDKs

SGLang

Transformers

Outils

vLLM

TensorRT-LLM

Kubernetes

Docker

OpenAI/Anthropic SDKs

SGLang

Transformers

Description du poste

Nebius, Amsterdam-based leader in AI cloud infrastructure, seeks a Principal ML Solutions Architect for Token Factory. You will own complex, customer-facing architecture and scale inference and fine-tuning workflows across major accounts.

You will set technical direction, mentor architects, and shape the platform roadmap with product and research teams, while delivering high-value, production-ready solutions from PoC to production. Remote work from the United States is welcome.