Staff Software Engineer, Backend (Infrastructure)

Otter.ai

Town of Montana (WI)

Hybrid

USD 210,000 - 275,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Otter.ai is seeking a Staff Software Engineer, Backend (Infrastructure) to architect and implement scalable web services that power AI-driven products. You will collaborate with AI researchers and product teams to deliver robust systems, optimize data pipelines, and deploy models at scale.

You will own backend design, leverage MySQL, Kafka, Redis, and Elasticsearch, and guide Django-based services across the organization, while ensuring reliability for enterprise clients.

Qualifications

  • Requires advanced degree in CS or related field.
  • Extensive experience in databases, distributed systems, and ML infra.
  • Strong backend design and performance optimization skills.
  • Proficiency in Python is essential; experience with Go/Java/C is a plus.
  • Hands-on AWS deployment and ML model integration experience.

Responsibilities

  • Define and drive architecture of scalable solutions using MySQL, Vitess, Kafka, Cassandra, Redis, and big data platforms.
  • Build backend systems in Python that integrate with ML models and define engineering best practices.
  • Design robust business logic with Django and ensure AI component compatibility.
  • Write reusable, efficient code for high‑performance web services and real‑time analytics.
  • Collaborate with AI teams to streamline data pipelines and model deployment.
  • Serve as technical voice with stakeholders and influence AI infrastructure roadmaps.

Skills

Python
Distributed systems
Backend performance
Go
Java
C
SQL databases
AWS
Communication skills

Education

Bachelor's degree in CS or related field
Master's degree in CS or related field
Ph.D. in CS or related field

Tools

MySQL
Vitess
Kafka
Cassandra
Redis
Elasticsearch
Django
AWS

Job description

The Opportunity

Are you an experienced Staff Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting‑edge AI technologies? We're seeking a talented engineer to lead the development, deployment, and management of web services and infrastructure that empower AI‑driven products and initiatives. As part of our dynamic engineering team, you'll collaborate closely with AI researchers, product managers, and technologists to deliver innovative solutions that transform the experiences of end‑user professionals and enterprise clients across diverse industries.

Your Impact
  • Define and drive the architecture of scalable solutions utilizing technologies like MySQL, Vitess, Kafka, Cassandra, Redis, and big data platforms --- shaping foundational systems that support sophisticated AI applications and workflows across the organization.
  • Leverage your deep expertise in Python to build and enhance backend systems that seamlessly integrate with machine learning and AI models, while establishing engineering best practices for the broader team.
  • Design and implement robust business logic using web frameworks such as Django, ensuring compatibility with AI components and integration with databases --- and influence how these patterns are adopted at scale.
  • Write reusable, efficient, and maintainable code that underpins our high‑performance web services and supports real‑time AI analytics, setting the bar for code quality across teams.
  • Partner with AI teams to streamline data pipelines, optimize model deployment, and ensure backend systems effectively support AI‑based product features --- often driving alignment across multiple teams simultaneously.
  • Serve as a key technical voice with stakeholders across the organization, translating complex infrastructure strategies into clear direction and influencing roadmaps related to AI‑enabled infrastructure.
We're Looking for Someone Who
  • Holds a Bachelor's, Master's, or Ph.D. in Computer Science or a related field.
  • Demonstrates strong expertise in databases, distributed systems, backend performance optimization, and familiarity with backend requirements for machine learning infrastructure.
  • Demonstrates a solid understanding of database internals, transactions, indexing, and experience in schema design optimized for AI data workloads.
  • Has 10 years of experience in developing and architecting large‑scale web services, preferably with exposure to supporting AI systems.
  • Possesses expert proficiency in Python or other programming languages such as Go, Java, or C .
  • Has extensive experience with web frameworks like Django and is comfortable integrating systems with technologies such as MySQL, Redis, Elasticsearch, Kafka, and Cassandra, particularly in support of AI workflows.
  • Has hands‑on experience deploying and managing services on AWS, particularly those interfacing with machine learning platforms.
  • Is driven by ownership and passionate about delivering impactful solutions from conception to deployment, especially in collaborative environments with AI‑focused teams.
  • Brings substantial production server experience or equivalent backend expertise to the table.
  • Has excellent communication skills, a genuine curiosity for technology, and meticulous attention to detail.
Nice to haves
  • Familiarity with HTTP, networking principles, and API design patterns beneficial to AI integrations.
  • Experience with operating systems, particularly Linux, and an understanding of their interactions with AI applications and services.
About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world's leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real‑time automated meeting notes, summaries, and other insights from in‑person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.

Accessibility & Accommodations

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

  • Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.
Salary range

Salary Range: $210,000 to $275,000 USD per year.

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent on several factors. Our base salary is just one component of a comprehensive total rewards package.

#LI-Hybrid

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Backend (Infrastructure)
Senior Software Engineer, Backend (Infrastructure)

Otter.ai • Town of Montana (WI)

On-site
USD 185,000 - 230,000
Senior Software Engineer, AI Agent & LLM
Senior Software Engineer, AI Agent & LLM

Otter.ai • Town of Montana (WI)

On-site
USD 185,000 - 230,000
Software Engineer, Front-End
Software Engineer, Front-End

Cacheflow • Mountain View (CA)

Hybrid
USD 185,000 - 230,000
Staff Machine Learning Engineer
Staff Machine Learning Engineer

Cacheflow • Mountain View (CA)

On-site
USD 210,000 - 275,000
Software Engineer, AI Agent & LLM
Software Engineer, AI Agent & LLM

Cacheflow • Mountain View (CA)

Hybrid
USD 155,000 - 185,000
Senior Software Engineer, Search & Recommendations
Senior Software Engineer, Search & Recommendations

Otter.ai • Town of Montana (WI)

On-site
USD 185,000 - 230,000
Staff Software Engineer (Backend, Infrastructure)
Staff Software Engineer (Backend, Infrastructure)

Cacheflow • Mountain View (CA)

On-site
USD 210,000 - 250,000
Senior Software Engineer, AI Agent & LLM
Senior Software Engineer, AI Agent & LLM

Cacheflow • Mountain View (CA)

Hybrid
USD 185,000 - 230,000
Senior Software Engineer, Backend (Infrastructure)
Senior Software Engineer, Backend (Infrastructure)

Cacheflow • Mountain View (CA)

On-site
USD 185,000 - 210,000
Senior People Operations Partner
Senior People Operations Partner

Otter.ai • Mountain View (CA)

Hybrid
USD 155,000 - 185,000