Senior Data Engineer: Data Platform & Pipelines

SpotHero; Chicago (IL); On-site; USD 136,000 - 153,000; Full time

Benefits offered by this job

Medical premiums coverage

Dental & Vision coverage

401(k) with match

Life Insurance

Flexible PTO

Parking stipend

Lunch stipend

Learning budget

Job summary

SpotHero in Chicago seeks a Senior Data Engineer to join the Data Engineering squad, focusing on backend development and building reusable infrastructure services for data modeling, storage, access, processing, and analysis. You will influence technology choices for data‑heavy workloads at SpotHero.

You will partner with Analytics, Data Science, Marketing and other squads, design data platforms from infrastructure to API, and ensure scalable, self‑service data pipelines with Docker, Kubernetes,

Qualifications

• Design and implement high‑quality software in Python.
• Experience using SQL to read and manage data.
• Experience with ETL scheduling tools (Airflow, Luigi, Prefect).
• Infrastructure‑as‑code experience with Terraform, CloudFormation, or Pulumi.
• Hands‑on with data platforms/tools (Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte).
• Experience deploying containerized software in Docker and CI‑driven workflows.
• Ability to deploy Kubernetes or similar technologies (ECS, Mesos).
• Strong communication for both business and technical contexts.

Responsibilities

• Collaborate with Analytics, Data Science, Marketing and other squads on data storage and processing needs.
• Contribute to design and implementation of data platform solutions from infrastructure to API.
• Build robust pipelines ensuring data availability where and when needed at scale.
• Create frameworks to enable self‑service data pipelines for teams.
• Conduct performance testing and engineering to maintain scalable systems.
• Contribute hands‑on to the data platform’s implementation and operation.

Skills

Python

SQL

Airflow

Terraform

Docker

Kubernetes

CI/CD

Shell scripting

Postgres

Redshift

Tools

Terraform

CloudFormation

Pulumi

Kafka

Trino

dbt

Spark

Airbyte

Hightouch

Job description

SpotHero in Chicago seeks a Senior Data Engineer to join the Data Engineering squad, focusing on backend development and building reusable infrastructure services for data modeling, storage, access, processing, and analysis. You will influence technology choices for data‑heavy workloads at SpotHero.

You will partner with Analytics, Data Science, Marketing and other squads, design data platforms from infrastructure to API, and ensure scalable, self‑service data pipelines with Docker, Kubernetes,