Senior AI Ops Engineer: Scalable LLM Infra

LinuxCareers; Bellevue (WA); On-site; USD 119,000 - 180,000; Full time

Benefits offered by this job

Bonus opportunities

Equity

Health insurance

Job summary

Robinhood is seeking a Senior AI Operations Engineer to build and operate the enterprise AI infrastructure that powers internal AI capabilities. You will own tooling, automation, and self-service solutions, and lead complex troubleshooting across AI platforms, LLM integrations, and production systems.

You will manage enterprise integrations with LLM providers, optimize performance and token usage, and advance observability, deployment pipelines, and scalable AI workflows.

Qualifications

• 5+ years of IT Operations, Site Reliability Engineering, or AI infrastructure with production system experience.
• Hands-on with enterprise AI platforms and LLM integrations (Anthropic Claude and Google Gemini), including API integrations, prompt operations, and token management.
• Strong Linux administration and scripting/automation in Python, Bash, or similar.
• Experience with infrastructure provisioning & configuration management and orchestration tools (Terraform, Ansible, Chef, Kubernetes).
• Ability to investigate ambiguous technical problems, identify root causes, and deliver scalable solutions.

Responsibilities

• Build internal tooling, automation, and self-service solutions to streamline AI operations and improve developer experience.
• Own complex troubleshooting across AI platforms, resolving issues with LLM integrations, model behavior, APIs, and system performance.
• Manage and optimize enterprise integrations with LLM providers focusing on performance, token usage, reliability, and cost efficiency.
• Develop and improve observability, monitoring, and deployment pipelines for AI workloads, tracking latency, costs, token usage, and error rates.
• Support and optimize agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation (RAG) systems for reliability and scalability.

Skills

IT Operations

Site Reliability Engineering

AI infrastructure

Python scripting

Linux administration

Automation scripting

Tools

Terraform

Ansible

Chef

Kubernetes

Bash

Python

Job description

Robinhood is seeking a Senior AI Operations Engineer to build and operate the enterprise AI infrastructure that powers internal AI capabilities. You will own tooling, automation, and self-service solutions, and lead complex troubleshooting across AI platforms, LLM integrations, and production systems.

You will manage enterprise integrations with LLM providers, optimize performance and token usage, and advance observability, deployment pipelines, and scalable AI workflows.