Senior AI-Driven ADC Architect

A10 Networks, Inc.; San Jose (CA); Hybrid; USD 180,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

A10 Networks, Inc. is seeking a Principal Software Engineer to lead the development of AI-driven traffic management and AI Gateway capabilities in San Jose, CA. The role combines ADC/SLB/DNS expertise with practical AI/LLM system experience to deliver intelligent routing and inference-aware load balancing.

The candidate will drive architecture decisions, prototyping, and execution while collaborating with product, platform, and AI strategy teams to scale AI workloads across global deployments.

Qualifications

• Senior staff engineer capable of driving architecture, design, prototyping, and execution.
• Expertise in Application Delivery Controllers (ADC), Server Load Balancing (SLB), DNS/GSLB, and AI/LLM systems.

Responsibilities

• Lead architecture and development of AI Gateway components for intelligent routing of LLM/AI traffic.
• Design and implement LLM-aware load balancing incorporating token, latency, and model-level insights into traffic decisions.
• Develop enhancements for ADC and GSLB platforms to support AI workloads, including token-aware rate limiting and latency-based routing.
• Mentor engineering teams on AI workload behaviors, traffic characteristics, and tuning strategies.
• Collaborate with AI research and platform teams to align architectural decisions with product roadmap.
• Drive system-wide architecture: data plane, control plane, configuration, and distributed state management.

Job description

A10 Networks, Inc. is seeking a Principal Software Engineer to lead the development of AI-driven traffic management and AI Gateway capabilities in San Jose, CA. The role combines ADC/SLB/DNS expertise with practical AI/LLM system experience to deliver intelligent routing and inference-aware load balancing.

The candidate will drive architecture decisions, prototyping, and execution while collaborating with product, platform, and AI strategy teams to scale AI workloads across global deployments.