Senior Data Engineer, Identity & Marketing Data

ESPN; New York (NY); Vor Ort; USD 180.000 - 241.000; Vollzeit

Zusammenfassung

ESPN Product & Technology is seeking a Principal Data Engineer for Marketing and Consumer Data. You will lead identity and device data initiatives, defining architecture, standards, and a roadmap for a petabyte-scale data platform across Databricks and AWS.

You will mentor senior engineers while coordinating with product and privacy teams. You will drive complex cross-system programs, ensure data governance, and build scalable pipelines, leveraging Spark, Hadoop, and modern cloud technologies to

Qualifikationen

• 10+ years of big data engineering experience building large pipelines.
• 5+ years hands-on performance tuning of distributed systems.
• Experience with Spark, Presto, Hive or similar tools.
• Experience with Snowflake, Redshift, BigQuery or Databricks.
• Knowledge of GDPR/CCPA and data governance practices.
• Proficient in Python, Scala or Java and AWS fundamentals.

Aufgaben

• Define technical strategy for Identity & Device data products and modernization roadmap.
• Lead end-to-end delivery across Identity360 and related datasets.
• Act as SME for identity data, including data modeling and batch/real-time processing.
• Set engineering standards for CI/CD, observability and data governance.
• Mentor engineers through design reviews and coaching.
• Collaborate with Product, QA, Privacy/Legal and other data squads.

Kenntnisse

Python

Scala

Java

AWS

S3

Lambda

IAM

Hadoop

Databricks

Spark

Presto

Hive

Snowflake

Redshift

BigQuery

Airflow

CI/CD

Terraform

SCD

Data Modeling

Data Warehousing

Ausbildung

Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering

Tools

Airflow

Terraform

Jobbeschreibung

ESPN Product & Technology is seeking a Principal Data Engineer for Marketing and Consumer Data. You will lead identity and device data initiatives, defining architecture, standards, and a roadmap for a petabyte-scale data platform across Databricks and AWS.

You will mentor senior engineers while coordinating with product and privacy teams. You will drive complex cross-system programs, ensure data governance, and build scalable pipelines, leveraging Spark, Hadoop, and modern cloud technologies to