Hybrid Senior Data Platform Engineer - Real-Time Pipelines

Superhuman; San Francisco (CA); Hybrid; USD 225,000 - 275,000; Full time

Benefits offered by this job

Excellent health care

Disability and life insurance

401(k) and RRSP matching

Paid parental leave

20 days of paid time off

Flexible sick time

Annual professional development budget

Job summary

A leading AI productivity platform in San Francisco is seeking a Senior Engineer to join their Data Platform team. In this role, you'll shape the architecture and strategy of their data platform, ensuring efficiency, scalability, and security across systems. Responsibilities include designing and implementing robust solutions, collaborating with cross-functional teams, and mentoring engineers. The ideal candidate has extensive experience in distributed computing and data engineering with proficiency in SQL and modern data storage technologies.

Qualifications

• 10+ years of experience in large-scale distributed computing systems.
• 5+ years in managing live production environments with high-load systems.
• Expert in SQL and proficient in data engineering languages.

Responsibilities

• Architect and develop systems for data pipelines that handle billions of daily events.
• Design scalable and secure data solutions for the platform.
• Collaborate with product teams to enhance data-driven workflows.

Skills

Large-scale distributed computing systems

Data engineering

Data modeling

SQL

Spark

Kafka

Terraform

Python

Scala

Java

Tools

Airflow

dbt

Dagster

Delta Lake

Snowflake

BigQuery

Redshift

Job description

A leading AI productivity platform in San Francisco is seeking a Senior Engineer to join their Data Platform team. In this role, you'll shape the architecture and strategy of their data platform, ensuring efficiency, scalability, and security across systems. Responsibilities include designing and implementing robust solutions, collaborating with cross-functional teams, and mentoring engineers. The ideal candidate has extensive experience in distributed computing and data engineering with proficiency in SQL and modern data storage technologies.