Senior AI Inference Solutions Engineer

Nebius Group; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive compensation

Career growth and learning

Flexibility and ownership

Collaborative and innovative culture

Impactful AI projects

International environment

Job summary

Nebius is hiring a Senior Sales Engineer to become a foundational technical partner for customers, shaping AI workloads from discovery to production feasibility. You will align technical architectures with platform strategy, ensuring rigor, cost awareness, and scalable solutions.

This role blends sales, engineering, and product insights at scale. You’ll collaborate with Sales and Engineering to accelerate PoC to production, manage risk, and advocate for platform capabilities based on real

Qualifications

• Deep understanding of AI inference systems and GPU-backed infrastructure.
• Experience with LLM workloads and performance-sensitive environments.
• Experience with inference frameworks and libraries (e.g., vLLM, SGLang, TensorRT-LLM).
• Ability to reason about latency, throughput, cost, and architecture tradeoffs.
• Strong customer presence with engineering-first organizations.

Responsibilities

• Strategic Technical Discovery Lead deep technical discovery with engineering teams and technical founders Understand model requirements, traffic expectations, latency constraints, GPU economics, and system dependencies
• Translate customer ambition into production‑feasible architectures Identify hidden technical risks early
• Commercial Acceleration Partner tightly with Sales on strategic deals Influence deal strategy through architectural clarity Prevent misaligned commitments before engineering allocation Increase PoC‑to‑production conversion by ensuring technical realism
• PoC Architecture & Validation Define measurable success criteria (latency, TTFT, throughput, cost envelope) Classify workload complexity and required optimization depth Align appropriate resources (ML Solution Architects, engineering, GPU capacity, etc.)
• Drive structured Go / No-Go decisions Prevent uncontrolled customization or hidden R&D
• Pattern Recognition & Platform Leverage Identify recurring configuration patterns across customers Quantify demand for advanced optimizations (quantization, speculative decoding, etc.) Surface structured insights to Product and Engineering Help evolve platform capabilities based on real workload data

Skills

AI inference systems

LLM workloads

Latency/throughput tradeoffs

Customer engagement

Tools

vLLM

SGLang

TensorRT-LLM

OpenAI SDKs

Anthropic SDKs

Langchain

Langsmith

smolagents

FastAPI

Flask

Kubernetes

Docker

Git

AWS SageMaker

Vertex AI

Azure ML

Job description

Nebius is hiring a Senior Sales Engineer to become a foundational technical partner for customers, shaping AI workloads from discovery to production feasibility. You will align technical architectures with platform strategy, ensuring rigor, cost awareness, and scalable solutions.

This role blends sales, engineering, and product insights at scale. You’ll collaborate with Sales and Engineering to accelerate PoC to production, manage risk, and advocate for platform capabilities based on real