Senior Software Engineer: AI Gateway & Policy Engine (Remote)

Zuplo, Inc.; San Francisco (CA); Hybrid; USD 180,000 - 250,000; Full time

Benefits offered by this job

Equity options

Unlimited PTO

Team off-sites

MacBook Pro

Continuous learning

Job summary

Zuplo, Inc. is hiring a Senior Software Engineer to design and operate the gateway runtime and control plane across Kubernetes, multiple clouds, and edge.

You will own production features and build guardrails for thousands of model and MCP tool calls, with a focus on security, performance, and reliability. You’ll work in a fast-moving team, using TypeScript/Node.js or Go, and collaborate with product, developer experience, and customers to deliver end-to-end solutions.

Qualifications

• 5+ years of experience building and running distributed systems in production.
• Hands-on Kubernetes experience or show that you can get there quickly.
• Fluency in TypeScript/Node.js or Go, and willingness to work in the other.
• Experience with AWS or GCP.
• Working knowledge of networking: DNS, TLS, and load balancing.
• Experience with CI/CD, observability, and incident response (Prometheus, Grafana, or OpenTelemetry).

Responsibilities

• Design how agents making thousands of model and MCP tool calls are authenticated, metered, rate-limited, and observed.
• Ship new guardrails and routing policies for the AI Gateway, such as model fallback, spend caps, and prompt-injection checks, behind canaries, alerts, and a clear rollback.
• Build and operate the services behind all of this across Kubernetes, multiple clouds, and the edge, mostly in TypeScript and Go, with some Rust.
• Own what you ship in production. When a customer reports something vague, you take it to root cause, a fix, and a dashboard so it can’t hide again.
• Work across Zuplo too. API management (portal, keys, rate limits, GitOps) and our monetization service run on the same policy engine.
• Keep what’s already shipped healthy, including the customer issues that make it to engineering.
• Improve how we ship, from CI/CD to infrastructure as code (Terraform, Pulumi, or similar).
• Work with product, developer experience, and customers to turn a fuzzy idea into a scoped plan, then ship it end to end.

Skills

Distributed systems

Kubernetes

TypeScript/Node.js

Go

Cloud (AWS/GCP)

Networking

CI/CD / Observability

Tools

Prometheus

Grafana

OpenTelemetry

Job description

Zuplo, Inc. is hiring a Senior Software Engineer to design and operate the gateway runtime and control plane across Kubernetes, multiple clouds, and edge.

You will own production features and build guardrails for thousands of model and MCP tool calls, with a focus on security, performance, and reliability. You’ll work in a fast-moving team, using TypeScript/Node.js or Go, and collaborate with product, developer experience, and customers to deliver end-to-end solutions.