Senior Enterprise AI Gateway Architect

Truefoundry; San Mateo (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Hybrid work schedule

Office lunches

Job summary

TrueFoundry is seeking a Senior Technical Customer Architect to lead post-sales technical engagement with Fortune 500 and large regulated enterprises. You will champion platform governance, model routing, and secure tool access across multi-team structures, translating business needs into technical architecture.

You will drive strategic alignments with security, data residency, and compliance teams while guiding product and engineering on customer-driven improvements.

Qualifications

• 7+ years in a technical customer-facing role with enterprise accounts.
• Strong grasp of API gateway concepts and LLM-related considerations.
• Experience translating governance and security tradeoffs into ROI language.

Responsibilities

• Onboard customers onto AI Gateway at scale, including model routing and MCP setup.
• Design access-control models and unified authorization across calls.
• Advise on guardrail strategies and phased rollouts for sensitive data.
• Guide agent governance and identity propagation across calls.
• Run architecture workshops on agent harness adoption and integrations.
• Own technical escalations, response times, and escalation to engineering.
• Serve as the technical owner for accounts with proactive support and CSAT focus.
• Navigate enterprise procurement, security reviews, and governance processes.
• Document architectures and build reusable playbooks.
• Collaborate with Sales/SE on renewals and expansions with proof points.
• Monitor health metrics and translate telemetry into business narratives.

Skills

Enterprise accounts

API gateway concepts

LLM concerns

OAuth token exchange

MCP / Model Context Protocol

Governance & security

Cross-stakeholder communication

Tools

LangGraph

CrewAl

OpenAI Agents SDK

Job description

TrueFoundry is seeking a Senior Technical Customer Architect to lead post-sales technical engagement with Fortune 500 and large regulated enterprises. You will champion platform governance, model routing, and secure tool access across multi-team structures, translating business needs into technical architecture.

You will drive strategic alignments with security, data residency, and compliance teams while guiding product and engineering on customer-driven improvements.