Director of Cloud Infrastructure & SRE

Otter.ai; Mountain View (CA); On-site; USD 244,000 - 313,000; Full time

Job summary

Otter.ai is seeking a Director of Engineering, Infrastructure to lead the teams powering our products at scale. You will own cloud infrastructure, CI/CD, DevOps, SRE, and production operations, setting strategy while addressing critical technical challenges and partnering with Product, AI/ML, Security, and Finance.

You will drive reliability, scalability, security, and cost efficiency, while mentoring a high‑performing team and communicating priorities to the executive team.

Qualifications

• Bachelor’s degree or higher in Computer Science or a related field.
• 10+ years of software development or engineering experience, including 4+ years in engineering management.
• Significant experience leading infrastructure, DevOps, SRE, or platform teams responsible for production systems at scale.
• Deep experience designing and operating highly available, fault-tolerant distributed systems.
• Strong knowledge of AWS and cloud-native infrastructure including Kubernetes/EKS, EC2, Auto Scaling, load balancing, IAM, monitoring and IaC like Terraform.
• Deep understanding of MySQL operations including performance, replication, clustering, backup and DR.
• Strong knowledge of asynchronous architectures, message queues, retries, idempotency, and failure recovery.
• Experience building production reliability practices including observability, incident management, on-call, DR and multi-region architectures.
• Track record of improving cloud efficiency and infrastructure unit economics without compromising reliability.
• Experience operating latency-sensitive AI inference workloads; GPU inference experience a plus.
• Ability to scale infrastructure to support rapid product/customer growth and enterprise security/compliance needs.
• Ability to move between architecture, data, finance, org design, and executive communication with cross-functional influence.
• Familiarity with Python, Django, FastAPI, and WebSockets.

Responsibilities

• Own the architecture and operation of cloud, compute, networking, database, production, and AI inference infrastructure.
• Translate business plans into infrastructure roadmaps, capacity, staffing, and investments.
• Ensure infrastructure is reliable, scalable, secure, performant, and cost-efficient.
• Establish infrastructure metrics, standards, observability, and accountability; surface risks and opportunities.
• Improve developer velocity through automation, CI/CD, and self-service tooling.
• Strengthen incident response, disaster recovery, and business continuity practices.
• Partner with AI/ML teams to optimize inference performance, reliability, resource use, and cost.
• Embed access control, compliance, and risk management into architecture and operations.
• Recruit, develop, and lead a high-performing infrastructure org as a credible technical leader.
• Communicate priorities, risks, investments, and tradeoffs to executives; work with Finance on cost/capacity decisions.

Skills

Cloud architecture

SRE/DevOps leadership

Distributed systems

AWS cloud native

Kubernetes/EKS

Terraform

MySQL operations

Async architectures

AI inference workloads

Cross-functional influence

Python/Django/FastAPI/WebSockets

Education

Bachelor’s degree or higher in Computer Science or related technical field

Tools

AWS

Kubernetes

Terraform

Job description

Otter.ai is seeking a Director of Engineering, Infrastructure to lead the teams powering our products at scale. You will own cloud infrastructure, CI/CD, DevOps, SRE, and production operations, setting strategy while addressing critical technical challenges and partnering with Product, AI/ML, Security, and Finance.

You will drive reliability, scalability, security, and cost efficiency, while mentoring a high‑performing team and communicating priorities to the executive team.