Senior ML Solutions Architect – Remote Token Platform (LLM)

Nebius; United States; On-site; USD 210,000 - 260,000; Full time

Benefits offered by this job

Health Insurance

401(k) Plan

Parental Leave

Remote Work Reimbursement

Disability & Life Insurance

Job summary

Nebius is seeking a Senior ML Solutions Architect to design and implement optimized inference workflows for open-source LLMs, across multimodal models, in production. You will collaborate with clients to build customized LLM-based solutions and work with backend teams to enhance the platform.

The role emphasizes serverless inference, fine-tuning, prompt engineering, and scalable AI applications with Nebius Token Factory. Remote US work is available.

Qualifications

• 5+ years of experience in ML/AI systems, with at least 2 years focused on LLMs and generative AI.
• Deep knowledge of LLM ecosystem, model architectures and fine-tuning approaches.
• Hands-on experience deploying and operating LLM inference workloads in production.
• Experience with SFT/LoRA fine-tuning and data preparation/curation.
• Experience with RL-based fine-tuning is a strong plus.
• Proficiency in Python and modern ML tooling.
• Ability to communicate complex concepts clearly.

Responsibilities

• Optimize LLM inference across modalities to drive business value and customer goals.
• Provide support in supervised and reinforcement learning fine-tuning to maximize model quality.
• Design and implement LLM-based solutions using Nebius Token Factory’s inference services.
• Build production-ready applications leveraging serverless LLM APIs (multimodal models).
• Provide technical expertise in prompt engineering, RAG architectures and model selection.
• Collaborate with product and engineering to surface customer feedback and shape platform roadmap.
• Guide customers in scaling from POC to production focusing on performance, reliability, and cost.

Skills

Python

LLM

Deep learning

Prompt engineering

RAG

Cloud platforms

Tools

vLLM

Transformers

TensorRT-LLM

Kubernetes

Docker

OpenAI SDK

Anthropic SDKs

Job description

Nebius is seeking a Senior ML Solutions Architect to design and implement optimized inference workflows for open-source LLMs, across multimodal models, in production. You will collaborate with clients to build customized LLM-based solutions and work with backend teams to enhance the platform.

The role emphasizes serverless inference, fine-tuning, prompt engineering, and scalable AI applications with Nebius Token Factory. Remote US work is available.