Senior AI Operations Engineer

Robinhood; Bellevue (WA); Sur place; USD 119 000 - 180 000; Plein temps

Avantages offerts par ce poste

Bonus opportunities

Equity

Health insurance

Résumé du poste

Robinhood is seeking a Senior AI Operations Engineer to build and operate the enterprise AI infrastructure that powers internal AI capabilities. You will own tooling, automation, and self-service solutions, and lead complex troubleshooting across AI platforms, LLM integrations, and production systems.

You will manage enterprise integrations with LLM providers, optimize performance and token usage, and advance observability, deployment pipelines, and scalable AI workflows.

Qualifications

• 5+ years of IT Operations, Site Reliability Engineering, or AI infrastructure with production system experience.
• Hands-on with enterprise AI platforms and LLM integrations (Anthropic Claude and Google Gemini), including API integrations, prompt operations, and token management.
• Strong Linux administration and scripting/automation in Python, Bash, or similar.
• Experience with infrastructure provisioning & configuration management and orchestration tools (Terraform, Ansible, Chef, Kubernetes).
• Ability to investigate ambiguous technical problems, identify root causes, and deliver scalable solutions.

Responsabilités

• Build internal tooling, automation, and self-service solutions to streamline AI operations and improve developer experience.
• Own complex troubleshooting across AI platforms, resolving issues with LLM integrations, model behavior, APIs, and system performance.
• Manage and optimize enterprise integrations with LLM providers focusing on performance, token usage, reliability, and cost efficiency.
• Develop and improve observability, monitoring, and deployment pipelines for AI workloads, tracking latency, costs, token usage, and error rates.
• Support and optimize agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation (RAG) systems for reliability and scalability.

Connaissances

IT Operations

Site Reliability Engineering

AI infrastructure

Python scripting

Linux administration

Automation scripting

Outils

Terraform

Ansible

Chef

Kubernetes

Bash

Python

Description du poste

Robinhood's Corporate Engineering team is building enterprise AI infrastructure to make AI capabilities reliable, secure, and accessible across the company. As a Senior AI Operations Engineer, you will build, operate, and improve the infrastructure behind Robinhood's enterprise AI capabilities, working across AI platforms, LLM integrations, automation, and production infrastructure.

What You'll Do

• Build internal tooling, automation, and self-service solutions that streamline AI operations, reduce manual intervention, and improve developer experience
• Own complex technical troubleshooting and escalations across AI platforms, working directly with developers and internal teams to resolve issues involving LLM integrations, model behavior, APIs, and system performance
• Manage and optimize enterprise integrations with LLM providers including Anthropic Claude and Google Gemini, focusing on performance, token utilization, reliability, and cost efficiency
• Develop and improve observability, monitoring, and deployment pipelines for AI workloads, tracking metrics such as inference latency, API costs, token usage, and error rates
• Support and optimize agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation (RAG) systems to improve reliability and scalability

What You Need

• 5+ years of experience in IT Operations, Site Reliability Engineering, or AI infrastructure and support with a track record of operating complex production systems
• Hands-on experience with enterprise AI platforms and LLM integrations, particularly Anthropic Claude and Google Gemini, including API integrations, prompt operations, and token management
• Strong Linux administration skills and proficiency in scripting and automation using Python, Bash, or similar languages
• Experience with infrastructure provisioning, configuration management, and orchestration tools such as Terraform, Ansible, Chef, or Kubernetes
• Ability to independently investigate ambiguous technical problems, identify root causes, and develop scalable solutions that prevent recurring issues

Nice to Have

• Experience with GPU clusters, AI workload orchestration (Slurm, Ray), vector databases (Pinecone, Milvus), or AI frameworks (LangChain, LlamaIndex)
• Experience with hybrid cloud and bare-metal infrastructure

Base pay range varies by location: Zone 1 (Menlo Park CA, New York NY, Bellevue WA, Washington DC) $153,000–$180,000 USD; Zone 2 (Denver CO, Westlake TX, Chicago IL) $134,000–$158,000 USD; Zone 3 (Lake Mary FL, Clearwater FL, Gainesville FL) $119,000–$140,000 USD. Eligible for bonus opportunities, equity, and benefits including 100% paid health insurance for employees, 90% coverage for dependents, 401(k) matching, and access to Robinhood Employee Fund.