Senior Data Engineer - Real-Time Data Pipelines

Sierra Ventures; United States; Hybrid; USD 126,000 - 180,000; Full time

Benefits offered by this job

Competitive starting pay

Discretionary annual bonus

New hire equity grant

Comprehensive health plans

401K with company matching

Paid Parental Leave

Flexible time off

Job summary

Gemini is seeking a Senior Data Engineer to own end-to-end data products and help transform raw information into actionable intelligence across the business.

You will design and operate scalable data infrastructures, mentor junior engineers, and partner with product, analytics, ML, finance, and engineering teams to move, transform, and model data reliably with observability and resilience.

Qualifications

• 5+ years of experience in data engineering or similar roles.
• Strong ETL/ELT pipeline design, implementation, and optimization.
• Python and SQL production-quality coding experience.
• Experience with large-scale data warehouses (Databricks, BigQuery, Snowflake).
• Solid software engineering fundamentals, data structures, and systems thinking.
• Hands-on data modeling experience (dimensional modeling, normalization, schema design).
• Experience with real-time/streaming data (Kafka, Kinesis, Flink, Spark Streaming).
• Familiarity with orchestration/workflow frameworks (Airflow).
• Knowledge of data governance, lineage, metadata, cataloging, and data quality practices.

Responsibilities

• Design, build, and maintain data infrastructure and pipelines for batch and real-time workloads.
• Develop scalable ETL/ELT pipelines using Python, SQL, Spark, Flink, Beam or equivalent.
• Work on real-time data solutions for timely insights.
• Partner with data scientists, ML engineers, analysts, and product teams to define data requirements and SLAs.
• Establish data quality, observability, and monitoring frameworks (data auditing, lineage).
• Resolve complex production issues: root-cause analysis, performance bottlenecks, data integrity.
• Document data flows, data dictionaries, architecture patterns, and runbooks.

Skills

Five plus years

ETL/ELT design

Python & SQL

Data warehousing

Software fundamentals

Data modeling

Streaming data

Airflow

Data governance

Tools

Databricks

BigQuery

Snowflake

Kafka

Kinesis

Flink

Spark Streaming

Airflow

Job description

Gemini is seeking a Senior Data Engineer to own end-to-end data products and help transform raw information into actionable intelligence across the business.

You will design and operate scalable data infrastructures, mentor junior engineers, and partner with product, analytics, ML, finance, and engineering teams to move, transform, and model data reliably with observability and resilience.