Staff AI/ML Platform Engineer – Architect Enterprise LLM Gateways

Triwill Group; Redwood City (CA); On-site; USD 190,000 - 238,000; Full time

Job summary

Fanatics Commerce is seeking a Staff-level architect for its AI/ML Platform to define and implement the end-to-end architecture for the AI control plane, gateway, and MCP ecosystem. You will lead multi-provider model routing, secure data access, and scalable retrieval pipelines, collaborating with data scientists and engineers.

The role involves hands-on coding, architectural decisions, and mentorship to build a governed, cost-aware production platform at petabyte scale.

Qualifications

• 8 to 12 years building production software, including 2+ years on AI/ML platform.
• Staff-level impact: system design across multiple services and platforms.
• Strong Python and FastAPI, plus one of Java, Go, Scala, or TypeScript; hands-on with Terraform, Kubernetes, Airflow, Postgres, Grafana, Prometheus; familiar with AWS data science toolkit and PyTorch.

Responsibilities

• Own the end-to-end architecture of the AI control plane: gateway, agent runtime, registry, retrieval, evaluation, and cost.
• Build the enterprise LLM gateway: multi-provider routing, failover, caching, rate limiting, and key management.
• Build the Agent/MCP ecosystem on a managed runtime (e.g., AWS Bedrock) and governance-enabled production agents.
• Own the unified retrieval layer and the data platform: ingestion, embedding, indexing pipelines and vector/backends.
• Build the evaluation and feedback loop: offline evals, tracing, regression gates in CI/CD; integrate prompts, retrieval, tools, models.
• Own governance and cost: RBAC, least-privilege, audit logging, cost attribution, and enterprise AI tool portfolio.
• Raise the bar: set engineering standards, mentor engineers, and communicate trade-offs to leadership.

Skills

Python

FastAPI

Java

Go

Scala

TypeScript

Terraform

Kubernetes

Airflow

Postgres

Grafana

Prometheus

LLMs

Bedrock

Vertex

OpenAI/Glean/DataHub governance

Education

Bachelor's or Master's in Computer Science, Engineering, or a related field

Tools

AWS Bedrock Agent Core

Langfuse

Arize Phoenix

OpenSearch

Job description

Fanatics Commerce is seeking a Staff-level architect for its AI/ML Platform to define and implement the end-to-end architecture for the AI control plane, gateway, and MCP ecosystem. You will lead multi-provider model routing, secure data access, and scalable retrieval pipelines, collaborating with data scientists and engineers.

The role involves hands-on coding, architectural decisions, and mentorship to build a governed, cost-aware production platform at petabyte scale.