MLDevX Engineer: Build Developer Experience at Scale

Anyscale; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Anyscale is seeking a Software Engineer to join the ML Developer Experience (MLDevX) team. You will own the interfaces through which users discover, configure, run, observe, debug, and productionize AI workloads.

This role spans CLI, SDKs, APIs, UI, and Workspaces, building scalable surface areas for distributed computing. As an IC with end-to-end ownership, you’ll work across the stack from tooling to cloud infrastructure, focusing on reliability and developer-friendly experiences for Ray-based

Qualifications

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
• 5+ years of experience writing high-quality production code.
• Solid background in algorithms, data structures, and system design.
• Experience with modern machine learning tooling — PyTorch, MLflow, data catalogs, and similar.
• Hands-on experience building and operating highly available services in production.
• Strong product instincts and a track record of shipping developer-facing tools.

Responsibilities

• Build developer tooling and MLOps capabilities on Ray for developers and coding agents.
• Develop an agent-first CLI and cohesive SDK, API, and MCP surfaces with structured errors and dry-run support.
• Improve path from local code to distributed execution in the Workspaces stack, including environments, dependencies, and debugging.
• Build cohesive experiences, tools and frameworks for the AI development lifecycle (data prep, fine-tuning, evaluation, serving).
• Design and operate highly available backend services and platform architecture across serverless and BYOC environments.
• Collaborate with users and field teams to scope, ship, and iterate on the product.

Skills

Production-grade software development

Algorithms & data structures

System design

Product instincts

Education

Bachelor's degree in Computer Science or equivalent

Tools

PyTorch

MLflow

Data catalogs

OpenTelemetry

Ray

Job description

Anyscale is seeking a Software Engineer to join the ML Developer Experience (MLDevX) team. You will own the interfaces through which users discover, configure, run, observe, debug, and productionize AI workloads.

This role spans CLI, SDKs, APIs, UI, and Workspaces, building scalable surface areas for distributed computing. As an IC with end-to-end ownership, you’ll work across the stack from tooling to cloud infrastructure, focusing on reliability and developer-friendly experiences for Ray-based