Senior Software Engineer, AI Agent & LLM

Cacheflow; Seattle (WA); On-site; USD 185,000 - 230,000; Full time

Job summary

Otter.ai in Seattle seeks a Senior Software Engineer to own our enterprise search stack, focusing on retrieval augmented generation, embeddings, ranking, and scalable infrastructure.

You will design and optimize search components, implement NLP models, and collaborate with cross-functional teams to deliver accurate, fast search results. Requirements include a CS master’s, 5+ years in search/recommendation, and Python/C++ expertise.

Qualifications

• 5+ years of experience in search, recommendation, or question answering systems.
• Strong knowledge of relevance measurement, tuning, and modeling.
• Engineering experience with large language models and RAG systems.
• Familiarity with embedding-based search is a plus.

Responsibilities

• Design, develop, and oversee enterprise search infrastructure using vector databases, full-text search, and relational techniques.
• Develop deep learning NLP algorithms to analyze, reformulate and suggest search queries.
• Design, implement, and deploy ranking algorithms to deliver relevant results and improve UX.
• Evaluate and optimize algorithm accuracy using key metrics.
• Monitor end-to-end system performance and drive improvement initiatives.
• Stay updated with industry trends to align our search system with benchmarks.

Skills

Python

C++

Education

Masters degree in Computer Science

PhD (a plus)

Job description

The Opportunity

We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and infrastructure, including retrieval augmented generation (RAG), semantic search using embeddings, text indexing and retrieval, query understanding, various ranking algorithms etc.. In your crucial role, you'll be responsible for managing every aspect of our sophisticated enterprise search system, spearheading the design, development, and optimization of search system accuracy and performance.

Your Impact

• Design, develop, and oversee our enterprise search infrastructure, employing a mix of vector databases, full-text search engine, and relational database techniques.
• Understand the user's information needs by developing deep learning-based NLP algorithms to analyze, reformulate and suggest search queries effectively.
• Design, implement, and deploy various ranking algorithms to deliver the most relevant results with the best user experience.
• Evaluate and optimize algorithm accuracy by focusing on key metrics..
• Constantly track and analyze end-to-end system performance, leading improvement initiatives as required.
• Stay informed about the latest industry developments and emerging technologies, aligning our search system with, or advancing it beyond, the industry benchmarks.

We're looking for someone who

• Holds a Masters degree in Computer Science, or a relevant field, PhD a plus.
• 5+ years of experience in search, recommendation or question answering systems.
• In-depth knowledge of relevance measurement, tuning, and modeling.
• Engineering experience with large language models and RAG systems.
• Expertise in Python and/or C++.
• Exceptional problem-solving capabilities coupled with meticulous attention to detail.
• Outstanding communication skills to explain complex concepts convincingly to non-technical team members.
• Abilities to contribute individually while functioning effectively as part of a team.
• Familiarity with embedding-based search systems will be considered a major advantage.

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.

Accessibility & Accommodations

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact [e-mail] at least 3 business days before your interview.

Salary range

Salary Range: $185,000 to $230,000 USD per year

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.