Solution Architect

TrueFoundry; Bengaluru; Hybrid; INR 3,000,000 - 6,000,000; Full time

Benefits offered by this job

Health insurance for you and family

Flexible hybrid work (3 days in office

Lunch and snacks in the office

Travel to other TrueFoundry offices

Job summary

TrueFoundry seeks a Solution Architect to own the technical arc of deals, from discovery and demos to POC and integration glue for enterprise customers.

You will lead architecture discussions, define success criteria, write integration pipelines, and ensure value delivery in customer environments. The role combines hands-on engineering with strategic engagement and product feedback to shape the roadmap.

Qualifications

• 3 to 7 years of backend software engineering experience with production systems you have shipped and owned.
• Strong in Python, Go, or TypeScript; comfortable with Kubernetes or major cloud (AWS, Azure, GCP).
• Experience with LLMs, agents, evals, or ML pipelines in production, familiarity with modern stack (vLLM, SGLang, LangChain, Triton).
• Comfortable leading an architecture discussion with a customer's engineering leaders and then doing the work.

Responsibilities

• Own the technical arc of the deal: discovery and in-depth demo, architecture discussion with the customer's engineering leaders, and the POC through to close.
• Win the POC on technical merit, write the integration glue, agent workflows, and eval pipelines to prove value in their environment.
• Make architecture calls that decide how the customer will run AI in production; act as the technical face of TrueFoundry to enterprise customers.

Skills

Backend engineering

Python

Go

TypeScript

Kubernetes

AWS/GCP/Azure

AI/ML literacy

Architecture design

Tools

LangChain

vLLM

SGLang

Triton

Job description

About TrueFoundry

Every production AI system whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.

That infrastructure layer is being built right now.

We are looking for a Solution Architect

The Problem We're Solving

Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.

The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.

You need a control plane that handles:

• Intelligent routing with observability, cost policies, and fallback logic
• Centralized tool and MCP server management with security and lifecycle controls
• Agent orchestration with governance and guardrails
• A unified compute layer to run self-hosted models, custom tools, and agents

AI Gateway is the control plane five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.

We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.

What you'll do

• Own the technical arc of the deal: discovery and the in-depth demo, the architecture discussion with the customer's engineering leaders, and the POC - all the way through to close.
• Win the POC on technical merit: Co-define the success criteria with the customer, run the execution tracker and the milestones, and write the integration glue, agent workflows, and eval pipelines that prove value in their environment. The goal is delivered impact, not lines of code.
• Make the architecture calls that decide how the customer will run AI in production. You are the technical decision-maker in the room - the CTO in the room - and the person their engineering leaders trust.
• Be the technical face of TrueFoundry to enterprise customers, and earn the credibility that turns an evaluation into a signed contract.
• Steer the product. You see, first-hand, what customers pull toward and where their first production win lands. Compile that field signal and bring structured, data-backed asks to TrueFoundry's engineering and product teams - your intuition helps shape the roadmap.

Who we're looking for

• Backend Engineering Experience: 3 to 7 years of backend software engineering experience with production systems you have shipped and owned. Strong in Python, Go, or TypeScript. Comfortable with Kubernetes or any major cloud (AWS, Azure, GCP).
• Business Acumen: You don’t just question the how but also the why - discovering impact, architecture design and deal-winning opportunities.
• AI and ML literacy: You have worked with LLMs, agents, evals, or ML pipelines in production. Familiarity with the modern stack (vLLM, SGLang, LangChain, Triton, model serving) is a strong plus.
• Design and Architecture: Comfortable leading an architecture discussion with a customer's engineering leaders, then doing the work yourself. High agency and a bias for action.
• We especially welcome founding engineers and CTOs of early-stage startups, as well as engineers from infrastructure, MLOps, and developer-tool companies.

Traits we are looking for: Ownership, ability to execute, hustle and think out of the box, data-driven decision-making, be comfortable with more unknowns than knowns.

Perks of Working at TrueFoundry

• Join a fast-growing Series A, Bay Area-based startup building cutting-edge AI infrastructure.
• Comprehensive health insurance for you and your family.
• Flexible hybrid work, 3 days a week in the office (Tuesday, Wednesday, and Thursday), with flexibility around the schedule.
• Lunch and snacks are on us whenever you come into the office.
• Work from another TrueFoundry office for up to 3 months each year, whether that's our London or Bay Area office, if you'd like a change of scenery.