Lead Data Engineer: Architect Data Pipelines & Platforms

Comcast Corporation; Reston, Northern (VA, KY); Hybrid; USD 158,000 - 237,000; Full time

Benefits offered by this job

Health insurance

Performance bonuses

Commuter benefits

Job summary

Comcast Corporation's FreeWheel unit seeks a Lead Data Engineer to architect and manage advanced data pipelines and storage systems. You will drive data quality, scalability, and accessibility across platforms while guiding cross-functional teams in a data-centric strategy.

You will design standardized methods for data consumption, implement robust QA, and deploy on Kubernetes, AWS, and Databricks, contributing to architectural best practices and data-centric decision making.

Qualifications

• Bachelor's degree required or equivalent combination of coursework and experience.
• 10+ years of relevant work experience.
• Strong knowledge of data pipelines, data storage and data quality processes.

Responsibilities

• Lead design and development of data structures and pipelines to standardize, transform, and deliver data for insights and reporting.
• Ensure data quality throughout the lifecycle from ingestion to processing and loading using robust quality frameworks.
• Design and deploy standardized data access methods including APIs, database views, and data extracts for end-user consumption.
• Build and deploy data solutions on Kubernetes, Teradata, AWS and Databricks to meet business requirements.
• Choose data storage solutions based on sensitivity and access needs using minIO, Teradata, AWS S3 and Redshift.
• Map data lineage and apply transformation rules to streamline troubleshooting and impact analysis.
• Collaborate with cross-functional teams to refine data sourcing, processing and quality, optimizing operations.
• Set design standards and QA protocols to ensure interoperable data flows and storage solutions.

Skills

Apache Spark

Databricks Platform

Data Engineering

Java

SQL

Education

Bachelor's Degree

Job description

Comcast Corporation's FreeWheel unit seeks a Lead Data Engineer to architect and manage advanced data pipelines and storage systems. You will drive data quality, scalability, and accessibility across platforms while guiding cross-functional teams in a data-centric strategy.

You will design standardized methods for data consumption, implement robust QA, and deploy on Kubernetes, AWS, and Databricks, contributing to architectural best practices and data-centric decision making.