Software Engineer

Xcede

San Francisco (CA)

On-site

USD 150,000 - 190,000

Full time

9 days ago
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Xcede is seeking a Software Engineer to build a high-performance, identity-native AI gateway that sits at the core of enterprise interactions with AI agents, models, and tools. You will develop the data-plane, ensure secure authentication and policy enforcement, and optimize for reliability in production traffic.

You will design and implement components in Go or Rust, deploy in Kubernetes, and collaborate with live enterprise deployments to translate complex requirements into scalable

Qualifications

  • 2–5 years of software engineering experience.
  • Strong experience with Go, Rust, or comparable systems/backend languages.
  • Experience building proxies, gateways, networking infra, service meshes, distributed systems, or high-throughput backends.
  • Strong knowledge of Kubernetes and cloud-native infrastructure.
  • Understanding of OAuth 2.0, OIDC, identity, authentication, and authorization.
  • Experience designing highly available, performance-sensitive production systems.
  • Comfortable debugging complex networking and infra problems.
  • Interest in AI infra, agent architectures, MCP, and enterprise AI security.

Responsibilities

  • Design and build the core AI gateway and proxy/data-plane infrastructure.
  • Develop high-performance services primarily using Go and/or Rust.
  • Build model-routing, load-balancing, resiliency, and failover capabilities.
  • Implement governance and policy enforcement for AI agents, tools, APIs, and MCP servers.
  • Build secure credential-brokering mechanisms for agents accessing enterprise systems.
  • Integrate with identity providers including Okta and Microsoft Entra ID.
  • Integrate with secrets and privileged-access infrastructure such as CyberArk and HashiCorp Vault.
  • Work with OAuth, OIDC, authentication, authorization, and enterprise identity.
  • Deploy, tune, and troubleshoot gateway infrastructure in Kubernetes environments.
  • Diagnose performance, reliability, networking, and scaling issues with live customer traffic.
  • Translate enterprise requirements into scalable product capabilities.

Skills

Go
Rust
Kubernetes
OAuth 2.0 / OIDC
Identity & authentication

Tools

Okta
Microsoft Entra ID
CyberArk
HashiCorp Vault

Job description

Well-funded AI Infrastructure Start-up - Software Engineer – AI Gateway

They are building the runtime control plane for the agentic enterprise, giving organizations the visibility, security, and governance needed to deploy AI agents safely at scale. The platform helps enterprises discover and monitor agents, understand their behavior, enforce security policies, and control how they interact with models, applications, data, and employee environments.

We’re looking for a Software Engineer to build their identity-native AI gateway.

The gateway sits directly in the path between enterprise users, AI agents, models, tools, and sensitive systems. You’ll work on the core data plane responsible for model routing, authentication, authorization, credential brokering, tool and MCP governance, observability, failover, and high-performance traffic management.

Unlike a traditional backend engineering position, development is closely connected to real enterprise deployments. You’ll build against committed customer requirements and work with live production traffic inside sophisticated enterprise environments.

What You’ll Do
  • Design and build the core AI gateway and proxy/data-plane infrastructure.
  • Develop high-performance services primarily using Go and/or Rust.
  • Build model-routing, load-balancing, resiliency, and failover capabilities.
  • Implement governance and policy enforcement for AI agents, tools, APIs, and MCP servers.
  • Build secure credential-brokering mechanisms for agents accessing enterprise systems.
  • Integrate with identity providers including Okta and Microsoft Entra ID.
  • Integrate with secrets and privileged-access infrastructure such as CyberArk and HashiCorp Vault.
  • Work extensively with OAuth, OIDC, authentication, authorization, and enterprise identity.
  • Deploy, tune, and troubleshoot gateway infrastructure in Kubernetes environments.
  • Diagnose performance, reliability, networking, and scaling issues using real customer traffic.
  • Translate complex enterprise requirements into scalable product capabilities.
What We’re Looking For
  • 2–5 years of software engineering experience.
  • Strong experience with Go, Rust, or comparable systems/backend languages.
  • Experience building proxies, gateways, networking infrastructure, service meshes, distributed systems, or high-throughput backend services.
  • Strong knowledge of Kubernetes and cloud-native infrastructure.
  • Understanding of OAuth 2.0, OIDC, identity, authentication, and authorization.
  • Experience designing highly available, performance-sensitive production systems.
  • Comfortable debugging complex networking and infrastructure problems.
  • Interest in AI infrastructure, agent architectures, MCP, and enterprise AI security.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, AI Gateway & High-Performance Infra
Software Engineer, AI Gateway & High-Performance Infra

Xcede • San Francisco (CA)

On-site
USD 150,000 - 190,000
Software Engineer | Secure AI
Software Engineer | Secure AI

Bestgate Engineering, LLC • Columbia (MD)

On-site
USD 120,000 - 150,000
AI Engineer
AI Engineer

Madison-Davis, LLC • New York (NY)

On-site
USD 140,000 - 210,000
AI Gateway Engineer - Jersey City, Tampa & Dallas
AI Gateway Engineer - Jersey City, Tampa & Dallas

Stradit • Jersey City (NJ)

Hybrid
USD 140,000 - 180,000
AI Gateway Engineer - Jersey City, Tampa & Dallas
AI Gateway Engineer - Jersey City, Tampa & Dallas

Stradit LLC • Jersey City (NJ), Northern (KY)

On-site
USD 180,000 - 260,000
Senior AI Engineer
Senior AI Engineer

Workato • United States

Remote
USD 180,000 - 260,000
AI Platform Engineer
AI Platform Engineer

Job Juncture • Baton Rouge (LA)

Remote
USD 120,000 - 170,000
Fully remote
Certification support
Career growth
+1
Senior AI Infrastructure Engineer – Gateways & Observability
Senior AI Infrastructure Engineer – Gateways & Observability

Workato • United States

Remote
USD 180,000 - 260,000
Security Engineer
Security Engineer

Xcede • San Francisco (CA)

On-site
USD 150,000 - 210,000
Member of Technical Staff, AI Services
Member of Technical Staff, AI Services

Sycamore • Palo Alto (CA)

On-site
USD 180,000 - 300,000