Senior AI Gateway and Systems Engineering Lead

Alphasense; United States; Remote; USD 300,000 - 600,000; Full time

Benefits offered by this job

Equity

Benefits program

Job summary

Alphasense is seeking a senior leader to head a team delivering a high-throughput AI gateway that routes language-model traffic across providers and models. You will partner with engineering, product, research, and executives to scale the service while balancing availability, latency, cost, and reliability.

You will mentor engineers, define architecture, and align platform roadmaps with business goals, AI research, and stakeholder priorities.

Qualifications

• Experience leading teams of senior or staff engineers.
• Background in high-throughput, low-latency distributed systems.
• Ability to engage in architecture discussions and give technical direction.
• Strong communication and cross-functional partnership across an R&D organization.
• Active use of AI tools in developer workflows.

Responsibilities

• Manage, mentor, and grow a team of up to 10 senior and staff engineers, primarily distributed across North America.
• Build a strong team culture centered on technical quality, predictable delivery, and career development.
• Set the architecture and scaling strategy for a gateway handling very large volumes of model traffic, including routing, caching, queuing, and fallback behavior.
• Guide the integration and evaluation of multiple model providers and dozens of models, balancing latency, cost, and reliability.
• Align the platform roadmap with product needs, AI research, and engineering leadership.
• Establish engineering standards and telemetry for tracking token usage and costs.

Skills

Team leadership

Distributed systems

Architectural design

Cross-functional collaboration

AI tooling adoption

Tools

Temporal

Envoy

Python

Java

Job description

Alphasense is seeking a senior leader to head a team delivering a high-throughput AI gateway that routes language-model traffic across providers and models. You will partner with engineering, product, research, and executives to scale the service while balancing availability, latency, cost, and reliability.

You will mentor engineers, define architecture, and align platform roadmaps with business goals, AI research, and stakeholder priorities.