Senior Architect, Secure AI Gateway Platform

Netskope; Santa Clara (CA); On-site; USD 134,000 - 272,000; Full time

Job summary

Netskope in Santa Clara, CA is searching for a Cloud Data Plane Architect to lead the design of a scalable, high-performance security platform processing 10+ Gbps of traffic across LLM providers and AI services. You will own architectural decisions for routing, transformation, and policy application at line rate.

Join a globally distributed team, mentor engineers, and drive best practices for microservices, APIs, and secure data flows while collaborating with product managers to deliver secure

Qualifications

• BSCS or equivalent (required).
• MSCS or equivalent strongly preferred.

Responsibilities

• Design and develop high-performance, scalable cloud-based security systems for LLM APIs and Generative AI applications.
• Set and drive architectural design and strategic directions for the Cloud API Gateway platform.
• Define and drive best practices around scalable microservices, distributed systems, APIs and secure data flows across multiple LLM providers.
• Lead and mentor a world-class engineering organization, fostering innovation and collaboration.
• Collaborate with product management to translate customer requirements into high-quality solutions.
• Build scalable services that route, transform and secure various API protocols (REST, gRPC, LLM APIs).
• Design dynamic routing algorithms for multi-provider LLM orchestration and failover logic.
• Integrate with security features like DLP, Threat protection, UEBA for LLM security.
• Perform architectural reviews and code reviews; stay ahead on GenAI security trends.

Skills

Golang

Cloud-native systems

Architectural leadership

Backend engineering

Docker & Kubernetes

API gateways

Security platforms

Distributed systems

LLM APIs

GenAI knowledge

Education

BSCS or equivalent

MSCS or equivalent strongly preferred

Tools

Docker

Kubernetes

Job description

Netskope in Santa Clara, CA is searching for a Cloud Data Plane Architect to lead the design of a scalable, high-performance security platform processing 10+ Gbps of traffic across LLM providers and AI services. You will own architectural decisions for routing, transformation, and policy application at line rate.

Join a globally distributed team, mentor engineers, and drive best practices for microservices, APIs, and secure data flows while collaborating with product managers to deliver secure