Senior ML Solutions Architect: Production LLMs & Fine-Tuning

Nebius; United States; On-site; USD 208,000 - 261,000; Full time

Benefits offered by this job

Health Insurance

401(k) Plan

Parental Leave

Remote Work Reimbursement

Disability & Life Insurance

Job summary

Nebius is seeking a Principal ML Solutions Architect for Token Factory, our serverless platform for LLMs in production. You’ll own complex engagements, optimize inference and fine‑tuning, and set technical direction across strategic accounts while mentoring peers.

Remote work from the United States is welcome. You’ll collaborate with product, research, and engineering to shape platform features and drive scalable, cost‑efficient AI deployments.

Qualifications

• 8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI.
• Demonstrated technical leadership: owning ambiguous, high‑impact problems end to end and influencing decisions across teams and customers.
• Expert knowledge of the LLM ecosystem: model architectures, fine‑tuning approaches, and inference internals.
• Deep, hands‑on command of inference optimization: quantization, KV‑cache management, batching, routing, etc.
• Strong Python programming skills
• Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences, from engineers to executives
• Hands‑on experience with: running LLMs in production at scale; LLM fine‑tuning (SFT/LoRA, data prep/curation; RL-based fine‑tuning); LLM evaluation; inference frameworks and libraries; deploying LLM-powered apps via OpenAI, Anthropic, or open‑source models
• Bonus skills: OSS contributions, publications, multimodal models, DevOps tooling and infrastructure‑as‑code, internal tooling for ML workflows

Responsibilities

• Own the most complex, highest‑stakes customer engagements from architecture through production across multiple modalities, driving measurable business value.
• Optimize LLM inference at the framework and hardware level and codify the resulting best practices into reusable playbooks for the team.
• Lead supervised and reinforcement fine‑tuning efforts to maximize model quality.
• Design and implement production‑ready LLM solutions using Token Factory’s inference services.
• Provide deep technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade‑offs at scale.
• Partner closely with product, engineering and research to surface customer needs, prototype platform features, and directly influence the roadmap.
• Guide customers from PoC to production with a focus on performance, reliability, and cost efficiency — and define the standards by which the team does so.
• Mentor Senior and mid‑level Solutions Architects; raise the technical bar of the team through review, enablement, and knowledge sharing.
• Represent Token Factory externally through talks, blog posts, and conferences

Skills

ML/AI systems

Python programming

Technical leadership

Communication skills

Tools

vLLM

TensorRT-LLM

SGLang

Transformers

OpenAI SDKs

Anthropic SDKs

Kubernetes

Docker

Job description

Nebius is seeking a Principal ML Solutions Architect for Token Factory, our serverless platform for LLMs in production. You’ll own complex engagements, optimize inference and fine‑tuning, and set technical direction across strategic accounts while mentoring peers.

Remote work from the United States is welcome. You’ll collaborate with product, research, and engineering to shape platform features and drive scalable, cost‑efficient AI deployments.