Senior AI Infrastructure Engineer ML Pipelines LLM Gateway

Robinhood Markets, Inc.; Bellevue (WA); On-site; USD 196,000 - 230,000; Full time

Benefits offered by this job

100% paid health insurance for موظفون?

Access to the Robinhood Employee Fund

Access to the best AI tools on the市场

Lifestyle wallet

Employer-paid life & disability保险, etc

Time off to recharge including company

Exceptional office experience with…

Job summary

Robinhood Markets, Inc. is seeking a Senior Software Engineer, AI Infrastructure, to join a small, growing team tackling challenging distributed systems and AI infrastructure problems.

You’ll shape GPU efficiency, scale model serving, and build intelligent routing across Robinhood’s ML/AI lifecycle. You will work across traditional ML infrastructure and emerging LLM technologies, with ownership of critical components and opportunities to influence architecture and roadmap in a fast-paced,

Qualifications

• Strong software engineering experience with a focus on infrastructure, distributed systems, or large-scale backend platforms.
• Hands-on experience designing, building, and operating distributed systems in production, with a strong understanding of scalability, reliability, and system performance.
• Experience solving complex infrastructure challenges, including latency optimization, resource utilization, and production system reliability.
• Strong software development and system design skills, with the ability to take ownership of complex technical problems from design through production.
• Experience working with infrastructure technologies and tools in production environments, with an understanding of how to build and operate reliable systems at scale.
• Ability to work independently, navigate ambiguity, and contribute to foundational engineering projects within a small, growing team.
• Interest in machine learning and AI infrastructure, with a willingness to learn and work across both traditional infrastructure and emerging AI technologies.
• Bonus: Experience with ML infrastructure, model training or serving, GPU workload scheduling, LLM gateways, or open-source infrastructure technologies.

Responsibilities

• Design, build, and scale the infrastructure powering machine learning and AI across Robinhood, including feature stores, training pipelines, model serving, inference, and observability.
• Build and optimize distributed systems that support large-scale ML/AI workloads, with a focus on performance, reliability, scalability, and latency.
• Improve GPU utilization and efficiency by developing scheduling solutions for training and inference workloads.
• Help evolve Robinhood's LLM gateway, including intelligent model routing, query and prompt understanding, and context optimization.
• Support infrastructure for serving open-weight and fine-tuned models, enabling reliable access to AI capabilities across the company.
• Partner with engineering teams across Robinhood to understand their infrastructure needs and build scalable, reusable solutions.
• Own the operational health of critical infrastructure, including monitoring, troubleshooting, performance optimization, and participation in an on-call rotation.

Skills

Distributed systems

Backend platforms

Production systems

System design

Independent worker

AI/ML infrastructure

Infra ownership

Tools

LLM gateway

GPU scheduling

Model serving

Observability

Job description

Robinhood Markets, Inc. is seeking a Senior Software Engineer, AI Infrastructure, to join a small, growing team tackling challenging distributed systems and AI infrastructure problems.

You’ll shape GPU efficiency, scale model serving, and build intelligent routing across Robinhood’s ML/AI lifecycle. You will work across traditional ML infrastructure and emerging LLM technologies, with ownership of critical components and opportunities to influence architecture and roadmap in a fast-paced,