AI Infrastructure Engineer

Zoom; Seattle (WA); Hybrid; USD 127,000 - 256,000; Full time

Job summary

Join Zoom as an AI Infrastructure Engineer, where you'll work on revolutionary AI solutions for enterprise search. Collaborate with a world-class team to create a scalable, secure RAG system effectively managing and retrieving knowledge through innovative infrastructure. Your expertise in backend systems and AI tools will enhance your career in a leading tech company focused on employee happiness and growth.

Benefits

Flexible work environment

Health and wellness programs

Retirement benefits

Career growth opportunities

Qualifications

• 4+ years experience in backend or distributed systems engineering.
• Experience with large-scale data ingestion pipelines.
• Familiarity with cloud-native tools such as Docker and Kubernetes.

Responsibilities

• Design and implement a scalable RAG system for real-time Q&A.
• Build robust ingestion and indexing pipelines for semi-structured data.
• Develop APIs and backend systems for efficient querying and ranking.

Skills

Backend Systems Engineering

AI Tools Productivity

Data Ingestion Pipelines

Document-Level Permission

Cloud-Native Tools (Docker, Kubernetes, AWS)

SaaS Integration

Job description

AI Infrastructure Engineer

What you can expect

We’re building the next-generation AI-native knowledge platform to help organizations easily access and retrieve internal knowledge using the power of LLMs. You’ll join a fast-moving engineering team to build scalable, secure, and intelligent Retrieval-Augmented Generation (RAG) infrastructure — powering enterprise search, AI assistants, and knowledge discovery experiences.

About the Team

You’ll collaborate with world-class engineers, designers, and product thinkers to define what "AI-powered search" really means in the enterprise. As a core engineer on this team, you'll work across real-time document pipelines, vector databases, and permission-aware retrieval to push the boundaries of applied LLM systems at scale.

Responsibilities

• Designing and implement a scalable RAG system for real-time Q&A across internal content (meetings, messages, documents, whiteboards, videos, etc.).

• Building robust ingestion and indexing pipelines for semi-structured data sources with fine-grained, permission-aware access control.

• Developing APIs and backend systems to enable efficient querying, retrieval, and ranking.

• Collaborating with ML/NLP engineers to iterate on embedding models and improve search quality.

• Ensuring reliability, low latency, and scalability across the entire data retrieval and augmentation stack.

• Monitoring system performance and optimize for high-throughput, low-latency workloads under real-world load.

What we’re looking for

• Have experience (4+) in backend or distributed systems engineering

• Have a productivity mindset with experience using AI tools effectively

• Have experience designing and operating large-scale data ingestion pipelines (message queues, vector stores, Temporal, Elasticsearch etc.)

• Track record of building highly available, multi-tenant backend services

• Have experience with document-level permission modeling and secure data handling

• Possess with cloud-native tools such as Docker, Kubernetes, and AWS

• Have experience in Go is a bonus

• Have experience integrating with SaaS platforms (Google Workspace, Microsoft 365, Slack, etc.)

Salary Range or On Target Earnings:

Minimum:

$127700,00

Maximum:

$255400,00

In addition to the base salary and/or OTE listed Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus and equity value.

Note: Starting pay will be based on a number of factors and commensurate with qualifications & experience.

We also have a location based compensation structure; there may be a different range for candidates in this and other locations

At Zoom, we offer a window of at least 5 days for you to apply because we believe in giving you every opportunity. Below is the potential closing date, just in case you want to mark it on your calendar. We look forward to receiving your application!

Anticipated Position Close Date:

07/04/25

Ways of Working
Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.

Benefits
As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learnfor more information.

About Us
Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars.
We’re problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.

Our Commitment

At Zoom, we believe great work happens when people feel supported and empowered. We’re committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us know—we’re here to support you at every step.

If you need assistance navigating the interview process due to a medical disability, please submit an Accommodations Request Form and someone from our team will reach out soon. This form is solely for applicants who require an accommodation due to a qualifying medical disability. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed.