Senior Data Infrastructure Engineer for Real-Time Data

Cacheflow; Mountain View (CA); Hybrid; USD 185,000 - 230,000; Full time

Job summary

Otter.ai is seeking an experienced Software Engineer to join the Data Platform team and build the backbone of our data infrastructure. You’ll design foundational systems that move, process, and store data to power fast insights and smarter decisions across Otter.ai as we scale.

The role requires 5+ years in data infrastructure, strong programming in Python or Java, and hands-on experience with Snowflake/Databricks, Kafka, Spark, Airflow, Dagster, and Prefect.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• 5+ years in data infrastructure.
• Strong programming skills in Python or Java.
• Expertise with cloud data lakes such as Snowflake or Databricks.
• Experience with streaming and big data processing frameworks (Kafka, Spark).
• Experience with workflow orchestration systems (Airflow, Dagster, Prefect).
• CDC solutions (Debezium, Maxwell).
• Experience with cloud platforms (AWS) and containerization tools (Docker, Kubernetes).

Responsibilities

• Design and build resilient systems for real-time data movement, processing, and storage.
• Scale data infrastructure to support our rapidly growing business needs.
• Unlock actionable insights by enabling seamless, governed access to high-quality, trustworthy data.
• Drive innovation in data ingestion, transformation, and delivery across the company.
• Establish best practices that balance performance, flexibility, and governance at scale.

Skills

Python

Java

Snowflake

Databricks

Kafka

Spark

Airflow

Dagster

Prefect

Debezium

Maxwell

AWS

Docker

Kubernetes

Education

Bachelor's degree

Master's degree

Tools

Docker

Kubernetes

Job description

Otter.ai is seeking an experienced Software Engineer to join the Data Platform team and build the backbone of our data infrastructure. You’ll design foundational systems that move, process, and store data to power fast insights and smarter decisions across Otter.ai as we scale.

The role requires 5+ years in data infrastructure, strong programming in Python or Java, and hands-on experience with Snowflake/Databricks, Kafka, Spark, Airflow, Dagster, and Prefect.