Software Engineer, AI Gateway Hybrid - New York City, San Francisco

vercel.com; San Francisco (CA); On-site; USD 196,000 - 294,000; Full time

Benefits offered by this job

Flexible Time Off

Equity compensation

WFH budget

Job summary

A leading tech company is seeking a Software Engineer for the AI Gateway role in San Francisco. You will develop and enhance the AI Gateway platform, ensuring reliability for AI workloads and integrating multiple AI providers. With a focus on collaborative work, you will gather user feedback and improve functionalities. Ideal candidates have 5+ years in tech, especially in AI/ML, and participation in open-source projects. This role offers a competitive salary of $196,000-$294,000, flexible time off, and opportunities for growth.

Qualifications

• 5+ years of relevant experience in tech roles.
• Experience with AI/ML integrations and API gateways.
• Ability to work effectively in a collaborative team environment.

Responsibilities

• Develop and enhance the AI Gateway platform.
• Collaborate with teams to integrate new AI providers.
• Contribute to the open-source community and projects.

Skills

AI/ML integrations

API gateways

Distributed systems

Communication skills

Open source contributions

Job description

Vercel gives developers the tools and cloud infrastructure to build, scale, and secure a faster, more personalized web. As the team behind v0, Next.js, and AI SDK, Vercel helps customers like Ramp, Supreme, PayPal, and Under Armour build for the AI-native web.

Our mission is to enable the world to ship the best products. That starts with creating a place where everyone can do their best work. Whether you're building on our platform, supporting our customers, or shaping our story: You can just ship things.

About the Role: As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more. What You Will Do:

Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.

Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.

Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.

Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.

Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

About You:

You have at least 5+ years of relevant experience

Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)

Experience contributing to or participating in open source projects

Excellent communication skills and the ability to work effectively in a collaborative team environment

Competitive compensation package, including equity.

Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.

Flexible Time Off.

We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.

The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process. Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.

Apply Now.

Tell us why you’d be a good fit for the Software Engineer, AI Gateway role.

First Name

Last Name

Email Address

Phone Number

Resume Resume should be a PDF under 3.5MB.

Are you currently based in any of these countries? Please note these are the only countries where we are accepting applications

United States Germany United Kingdom Argentina Australia Canada India Japan Other

Will you require Visa Sponsorship now, or in the future?

Yes No

Your authorization to work in the country where you live. Please choose the option that describes your work authorization.

I am authorized to work in the country due to my nationality I am authorized to work in the country based on a valid work permit and do not need a company to sponsor my visa I am authorized to work in the country based on a valid work permit which needs to be sponsored by the company I work for I am not authorized to work in the country and need visa support Other

Do you live in one of the following states?Alabama, Alaska, Delaware, Kansas, Maine, Mississippi, Montana, Nebraska, New Mexico, North Dakota, South Dakota, West Virginia, or Wyoming.

Please double-check all the information provided above. Ensuring accuracy is crucial, as any errors or omissions may impact the review of your application.

I have reviewed and confirmed that all the information provided is accurate and complete.

Optionally, include links to your social media profiles.