Software Engineer, AI Gateway & High-Performance Infra

Xcede

San Francisco (CA)

On-site

USD 150,000 - 190,000

Full time

10 days ago
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Xcede is seeking a Software Engineer to build a high-performance, identity-native AI gateway that sits at the core of enterprise interactions with AI agents, models, and tools. You will develop the data-plane, ensure secure authentication and policy enforcement, and optimize for reliability in production traffic.

You will design and implement components in Go or Rust, deploy in Kubernetes, and collaborate with live enterprise deployments to translate complex requirements into scalable

Qualifications

  • 2–5 years of software engineering experience.
  • Strong experience with Go, Rust, or comparable systems/backend languages.
  • Experience building proxies, gateways, networking infra, service meshes, distributed systems, or high-throughput backends.
  • Strong knowledge of Kubernetes and cloud-native infrastructure.
  • Understanding of OAuth 2.0, OIDC, identity, authentication, and authorization.
  • Experience designing highly available, performance-sensitive production systems.
  • Comfortable debugging complex networking and infra problems.
  • Interest in AI infra, agent architectures, MCP, and enterprise AI security.

Responsibilities

  • Design and build the core AI gateway and proxy/data-plane infrastructure.
  • Develop high-performance services primarily using Go and/or Rust.
  • Build model-routing, load-balancing, resiliency, and failover capabilities.
  • Implement governance and policy enforcement for AI agents, tools, APIs, and MCP servers.
  • Build secure credential-brokering mechanisms for agents accessing enterprise systems.
  • Integrate with identity providers including Okta and Microsoft Entra ID.
  • Integrate with secrets and privileged-access infrastructure such as CyberArk and HashiCorp Vault.
  • Work with OAuth, OIDC, authentication, authorization, and enterprise identity.
  • Deploy, tune, and troubleshoot gateway infrastructure in Kubernetes environments.
  • Diagnose performance, reliability, networking, and scaling issues with live customer traffic.
  • Translate enterprise requirements into scalable product capabilities.

Skills

Go
Rust
Kubernetes
OAuth 2.0 / OIDC
Identity & authentication

Tools

Okta
Microsoft Entra ID
CyberArk
HashiCorp Vault

Job description

Xcede is seeking a Software Engineer to build a high-performance, identity-native AI gateway that sits at the core of enterprise interactions with AI agents, models, and tools. You will develop the data-plane, ensure secure authentication and policy enforcement, and optimize for reliability in production traffic.

You will design and implement components in Go or Rust, deploy in Kubernetes, and collaborate with live enterprise deployments to translate complex requirements into scalable

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer
Software Engineer

Xcede • San Francisco (CA)

On-site
USD 150,000 - 190,000
Enterprise AI Security Engineer
Enterprise AI Security Engineer

Xcede • San Francisco (CA)

On-site
USD 150,000 - 190,000
Enterprise AI Solutions Engineer (Endpoints)
Enterprise AI Solutions Engineer (Endpoints)

Xcede • San Francisco (CA)

On-site
USD 110,000 - 170,000
Client-Facing AI Deployment Engineer
Client-Facing AI Deployment Engineer

Xcede • San Francisco (CA)

Hybrid
USD 170,000 - 400,000
Health insurance
Senior AI Infrastructure Engineer – Gateways & Observability
Senior AI Infrastructure Engineer – Gateways & Observability

Workato • United States

Remote
USD 180,000 - 260,000
Forward-Deployed Real-Time AI Engineer
Forward-Deployed Real-Time AI Engineer

Xcede • New York (NY)

On-site
USD 120,000 - 190,000
Senior AI-Native Engineer: Architect & Ship AI Systems
Senior AI-Native Engineer: Architect & Ship AI Systems

Zohorecruit • O’Fallon (MO)

On-site
USD 140,000 - 170,000
Full Benefits Package
10 Days PTO
6 Sick leaves
+1
Senior Software Engineer: AI Gateway & Policy Engine (Remote)
Senior Software Engineer: AI Gateway & Policy Engine (Remote)

Zuplo, Inc. • San Francisco (CA)

Hybrid
USD 180,000 - 250,000
Equity options
Unlimited PTO
Team off-sites
+2
AI Endpoint Security Engineer
AI Endpoint Security Engineer

Xcede • San Francisco (CA)

On-site
USD 150,000 - 210,000
Remote Lead Enterprise AI Deployment Engineer
Remote Lead Enterprise AI Deployment Engineer

Xcede • United States

Remote
USD 120,000 - 160,000