Senior Engineering Manager, AI

AlphaSense; New York (NY); On-site; USD 361,200 - 496,800; Full time

Job summary

AlphaSense is seeking a Senior Engineering Manager to lead the AI Platform team. This role focuses on building and operating our high-throughput AI gateway, overseeing distributed systems, and coordinating multi-vendor integrations across the R&D organization.

You will mentor senior engineers, drive architectural decisions, ensure low-latency routing, and partner with product and research teams to align the platform roadmap with business goals, at scale in a US-based remote-friendly environment.

Qualifications

• Proven engineering leader with experience managing senior and staff engineers.
• Strong background in designing and operating high-throughput distributed systems.
• Ability to lead architectural discussions and provide strategic technical direction.

Responsibilities

• Strategic team leadership to mentor and grow engineers across North America.
• Own the architecture of the AI Gateway with very high throughput and low latency.
• Guide multi-vendor integrations and model latency/cost trade-offs.
• Partner with product, AI research, and executive teams to align roadmaps.

Skills

Engineering Leadership

Distributed Systems

Architectural Discussions

Strategic Communication

AI-First Mindset

Python

Java

Multi-Vendor Orchestration

Tools

LangChain

LangGraph

LiteLLM

OpenRouter

Temporal

Envoy

Job description

New York, New York, United States; Remote - United States

About AlphaSense:

The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter from content you can trust. Our universe of public and private content includes equity research, company filings, event transcripts, expert calls, news, trade journals, and clients’ own research content.

The acquisition of Tegus by AlphaSense in 2024 advances our shared mission to empower professionals to make smarter decisions through AI-driven market intelligence. Together, AlphaSense and Tegus will accelerate growth, innovation, and content expansion, with complementary product and content capabilities that enable users to unearth even more comprehensive insights from thousands of content sets. Our platform is trusted by over 6,000 enterprise customers, including a majority of the S&P 500. Founded in 2011, AlphaSense is headquartered in New York City with more than 2,000 employees across the globe and offices in the U.S., U.K., Finland, India, Singapore, Canada, and Ireland. Come join us!

About the Role:

To support our growth, we are searching for a Senior Engineering Manager to lead the AI Platform team. This group builds and operates our core AI Gateway, serving as the critical high-throughput highway for all Large Language Model (LLM) traffic across the entire AlphaSense ecosystem. The right leader will bring deep experience running high-performance teams, a strong background in distributed system architecture, and hands-on familiarity with multi-vendor integrations. Superior communication and strategic collaboration skills are critical for managing expectations and aligning stakeholders across the entire R&D organization.

Who You Are:

• Proven Engineering Leadership: Strong track record of managing and growing high-performing teams of senior and staff engineers, with a passion for developing technical leaders and aligning engineering objectives with business strategy.
• Enterprise Scale Experience: Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).
• Technical Thought Leadership: Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.
• Strategic Communication: Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.
• Modern Tooling & AI-First Mindset: Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.
• Relevant Tech Stack Experience (Nice to Have):Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
• Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
• Experience with Python, Java, and highly distributed caching/queueing systems.

What You’ll Do:

• Strategic Team Leadership: Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America).
• Foster a high-performance culture of technical excellence, predictable delivery, and career growth.
• High-Scale Operations & Scaling: Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as SuperAnalyst) - while ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms.
• Multi-Vendor Orchestration: Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers.
• Cross-Functional Alignment: Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
• Technical Governance: Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.

For base compensation, we set standard ranges for all roles based on function and level benchmarked against similar stage growth companies and internal comparables. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors including candidate experience/expertise and may vary from the amounts listed below.

You may also be offered equity, and a generous benefits program.

Compensation Range

$361,200 - $496,800 USD

AlphaSense is an equal-opportunity employer. We are committed to a work environment that supports, inspires, and respects all individuals. All employees share in the responsibility for fulfilling AlphaSense’s commitment to equal employment opportunity. AlphaSense does not discriminate against any employee or applicant on the basis of race, color, sex (including pregnancy), national origin, age, religion, marital status, sexual orientation, gender identity, gender expression, military or veteran status, disability, or any other non-merit factor. This policy applies to every aspect of employment at AlphaSense, including recruitment, hiring, training, advancement, and termination.

In addition, it is the policy of AlphaSense to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations, and ordinances where a particular employee works.