Data Engineer II: Scalable AWS Pipelines for Analytics

Comcast Corporation; Willow Grove (PA); On-site; USD 80,000 - 133,000; Full time

Job summary

Comcast Advertising is building large-scale data products to power reliable analytics for many users. This onsite Data Engineering role in Willow Grove, PA focuses on designing high-performance data pipelines on AWS and implementing data lake architectures using Delta Lake and Apache Iceberg.

You will lead data quality, observability, and best-practice governance, and collaborate with Product and Leadership to deliver semantic layers for self-service analytics.

Qualifications

• Bachelor's degree required.
• 2–5 years of data engineering experience preferred.
• Proficiency in Python, SQL, and Spark required.

Responsibilities

• Architect scalable data pipelines for large-scale data processing.
• Develop complex Big Data ETL workflows using Databricks Delta Live Tables (DLT).
• Design and implement data lake architectures (Delta Lake, Apache Iceberg).
• Define and enforce data engineering best practices for quality, integrity, reliability, and performance.
• Lead observability and monitoring across pipelines, including metadata management.

Skills

Python

PySpark

SQL

Databricks

Snowflake

Data Warehouse

Education

Bachelor's Degree

Tools

DLT

Delta Lake

Apache Iceberg

Looker

Tab

Snowflake

AWS

Apache Spark

Job description

Comcast Advertising is building large-scale data products to power reliable analytics for many users. This onsite Data Engineering role in Willow Grove, PA focuses on designing high-performance data pipelines on AWS and implementing data lake architectures using Delta Lake and Apache Iceberg.

You will lead data quality, observability, and best-practice governance, and collaborate with Product and Leadership to deliver semantic layers for self-service analytics.