Lead ML Infrastructure Architect for Scalable AI Platform

Robinhood; Menlo Park (CA); On-site; USD 200,000 - 320,000; Full time

Job summary

Robinhood is seeking a senior ML platform engineer to lead the architecture and end-to-end delivery of scalable systems for deploying, monitoring, and managing ML models in production. You will own the technical direction for model serving, the feature store, and observability infrastructure, collaborating with ML practitioners, data engineers, and AI teams to accelerate experimentation.

We expect 6+ years in software engineering with ML infrastructure, deep expertise in distributed systems and

Qualifications

• 6+ years of software engineering experience with ML infrastructure, data engineering, or model operations.
• Strong proficiency in Python and C++ or similar languages.
• Hands-on experience with ML frameworks such as TensorFlow or PyTorch.
• Experience with large-scale search/vector DB systems (e.g., Qdrant, ChromaDB, Elasticsearch).
• Knowledge of ML infrastructure tooling (Ray, Kubeflow, SageMaker, TensorFlow Serving, Triton).
• Ability to influence technical direction and mentor engineers across teams.

Responsibilities

• Lead the architecture and end-to-end delivery of scalable ML production systems.
• Own the technical direction for model serving, feature store, and ML observability infrastructure.
• Partner with ML practitioners, data engineers, and applied AI teams to streamline workflows and accelerate experimentation.
• Evolve and scale the feature store for real-time and batch use cases.
• Define observability standards for model performance, data pipelines, and feature freshness.
• Manage cloud compute resources (AWS) for cost-effective training and inference at scale.
• Contribute to technical strategy and mentor engineers through reviews and hands-on guidance.

Skills

Python

C++

TensorFlow

PyTorch

ML Infra

Distributed systems

Vector databases

Qdrant

Elasticsearch

AWS

Model serving

Observability

Education

Bachelor’s degree in CS/SE or related field

Advanced degree a plus

Tools

Kubeflow

Ray

SageMaker

TensorFlow Serving

Triton

Job description

Robinhood is seeking a senior ML platform engineer to lead the architecture and end-to-end delivery of scalable systems for deploying, monitoring, and managing ML models in production. You will own the technical direction for model serving, the feature store, and observability infrastructure, collaborating with ML practitioners, data engineers, and AI teams to accelerate experimentation.

We expect 6+ years in software engineering with ML infrastructure, deep expertise in distributed systems and