Senior Software Engineer, Backend (Infrastructure)

Otter.ai

Town of Montana (WI)

On-site

USD 185,000 - 230,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Otter.ai seeks a Senior Software Engineer, Backend (Infrastructure) to lead scalable web services and AI-driven infrastructure. You will architect and deploy backend systems that power AI features for enterprise and end-user applications.

You will collaborate with AI researchers and product teams, mentor engineers, and drive data pipelines, model deployment, and robust integration using MySQL, Redis, Kafka, Elasticsearch, and Django on AWS.

Qualifications

  • Bachelor's/Master's/PhD in CS or related field.
  • 5+ years building and architecting large-scale web services.
  • Strong DB knowledge, distributed systems, and AI infrastructure familiarity.
  • Expert Python and experience with Go, Java, or C/C++.

Responsibilities

  • Architect scalable backend solutions for AI-enabled products.
  • Develop and deploy services and infrastructure for AI workflows.
  • Design robust business logic with Django and integrate with databases.
  • Mentor engineers and drive technical decisions within the team.
  • Collaborate with AI researchers to optimize data pipelines and model deployment.

Skills

Python
Go
Java
C/C++
Distributed systems
Backend performance
Communication

Education

Bachelor's degree in CS
Master's degree
PhD in CS

Tools

MySQL
Vitess
Kafka
Cassandra
Redis
Elasticsearch
Django
AWS

Job description

The Opportunity

Are you an experienced Senior Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting-edge AI technologies? We're seeking a talented engineer to lead the development, deployment, and management of web services and infrastructure that empower AI-driven products and initiatives. As part of our dynamic engineering team, you'll collaborate closely with AI researchers, product managers, and technologists to deliver innovative solutions that transform the experiences of end-user professionals and enterprise clients across diverse industries.

Your Impact
  • Take ownership of architecting scalable solutions utilizing technologies like MySQL, Vitess, Kafka, Cassandra, Redis, and big data platforms to support sophisticated AI applications and workflows.
  • Leverage your extensive experience in Python to build and enhance backend systems that seamlessly integrate with machine learning and AI models --- and mentor junior engineers along the way.
  • Design and implement robust business logic using web frameworks such as Django, ensuring compatibility with AI components and integration with databases.
  • Write reusable, efficient, and maintainable code that underpins our high-performance web services and supports real-time AI analytics.
  • Collaborate closely with AI teams to streamline data pipelines, optimize model deployment, and ensure backend systems effectively support AI-based product features.
  • Drive technical decisions within your team and communicate effectively with stakeholders across multiple teams, clearly articulating technical strategies related to AI-enabled infrastructure.
We're looking for someone who
  • Holds a Bachelor's, Master's, or Ph.D. in Computer Science or a related field.
  • Demonstrates strong expertise in databases, distributed systems, backend performance optimization, and familiarity with backend requirements for machine learning infrastructure.
  • Demonstrates a solid understanding of database internals, transactions, indexing, and experience in schema design optimized for AI data workloads.
  • Has 5 years of experience in developing and architecting large-scale web services, preferably with exposure to supporting AI systems.
  • Possesses expert proficiency in Python or other programming languages such as Go, Java, or C .
  • Has extensive experience with web frameworks like Django and is comfortable integrating systems with technologies such as MySQL, Redis, Elasticsearch, Kafka, and Cassandra, particularly in support of AI workflows.
  • Has hands‑on experience deploying and managing services on AWS, particularly those interfacing with machine learning platforms.
  • Is driven by ownership and passionate about delivering impactful solutions from conception to deployment, especially in collaborative environments with AI‑focused teams.
  • Brings substantial production server experience or equivalent backend expertise to the table.
  • Has excellent communication skills, a genuine curiosity for technology, and meticulous attention to detail.
Nice to haves
  • Familiarity with HTTP, networking principles, and API design patterns beneficial to AI integrations.
  • Experience with operating systems, particularly Linux, and an understanding of their interactions with AI applications and services.
About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world's leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real‑time automated meeting notes, summaries, and other insights from in‑person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.

Accessibility & Accommodations

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

  • Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.
Salary range

Salary Range: $185,000 to $230,000 USD per year.

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent on several factors. Our base salary is just one component of a comprehensive total rewards package.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff Software Engineer, Backend (Infrastructure)
Staff Software Engineer, Backend (Infrastructure)

Otter.ai • Town of Montana (WI)

Hybrid
USD 210,000 - 275,000
Senior Software Engineer, AI Agent & LLM
Senior Software Engineer, AI Agent & LLM

Otter.ai • Town of Montana (WI)

On-site
USD 185,000 - 230,000
Software Engineer, AI Agent & LLM
Software Engineer, AI Agent & LLM

Cacheflow • Mountain View (CA)

Hybrid
USD 155,000 - 185,000
Software Engineer, Front-End
Software Engineer, Front-End

Cacheflow • Mountain View (CA)

Hybrid
USD 185,000 - 230,000
Senior Software Engineer, Backend (Infrastructure)
Senior Software Engineer, Backend (Infrastructure)

Cacheflow • Mountain View (CA)

On-site
USD 185,000 - 210,000
Staff Machine Learning Engineer
Staff Machine Learning Engineer

Cacheflow • Mountain View (CA)

On-site
USD 210,000 - 275,000
Senior Software Engineer, Search & Recommendations
Senior Software Engineer, Search & Recommendations

Otter.ai • Town of Montana (WI)

On-site
USD 185,000 - 230,000
Senior Software Engineer, AI Agent & LLM
Senior Software Engineer, AI Agent & LLM

Cacheflow • Mountain View (CA)

Hybrid
USD 185,000 - 230,000
Senior People Operations Partner
Senior People Operations Partner

Spectrum Equity • Mountain View (CA)

Hybrid
USD 155,000 - 185,000
Hybrid work model
Mountain View office access
Salary range $155k-$185k USD per year
Senior Manager, Sales Enablement
Senior Manager, Sales Enablement

Cacheflow • San Francisco (CA)

On-site
USD 185,000 - 210,000