Senior Data Engineer, Pipelines & Data Quality

Comcast; Reston, Northern (VA, KY); Hybrid; USD 104,000 - 170,000; Full time

Job summary

Comcast’s FreeWheel unit seeks a data engineer to independently design, develop, and manage advanced data structures and pipelines, ensuring data quality and accessibility. The role strategically implements data solutions across platforms, while maintaining privacy and regulatory compliance.

You will work with SQL, Python, Spark, cloud data warehouses, and modern tools like dbt, Airflow, Looker, and Snowflake to enable reliable data ingestion, processing, and consumption for business insights.

Qualifications

• Strong SQL proficiency.
• Programming language proficiency (Python preferred).
• Proficiency in distributed computing frameworks (e.g., Apache Spark).
• Cloud Data Warehouse management.
• Knowledge of at least one cloud provider (AWS, GCP, or Azure).
• Familiarity with data pipeline design pattern.
• Knowledge of data observability.
• Exposure to Embedded Business Intelligence like Looker is desired but not required.
• Exposure to modern data stack such as dbt, Airflow, Snowflake, Apache Spark is highly desired.
• Exposure to Data Consumption challenges and solutions is highly desired.

Responsibilities

• Designing and constructing data architectures and pipelines to standardize, transform, and ensure the integrity of data for business insights.
• Guaranteeing data quality throughout the ingestion, processing, and loading phases, with a focus on maintaining high standards.
• Engineering robust ingestion frameworks for a variety of data types, while monitoring and reporting on data quality.
• Developing accessible methods for data consumption, including APIs, database views, and data extracts for user applications.
• Implementing data solutions on multiple platforms such as Kubernetes, Teradata, and cloud services like AWS and Databricks.
• Selecting appropriate data storage platforms based on data sensitivity, privacy requirements, and access needs.
• Mastering data lineage and applying transformation rules for effective change management and issue resolution.
• Collaborating with cross-functional teams to refine data sourcing and processing, ensuring optimal data quality and efficiency.
• Consistent exercise of independent judgment and discretion in matters of significance.
• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
• Other duties and responsibilities as assigned.

Skills

Data Lake

Data Warehousing

SQL

Python

Data Lakehouse Architecture

Data Structures

Education

Bachelor's Degree

Tools

dbt

Airflow

Snowflake

Apache Spark

Looker

Kubernetes

Databricks

AWS

Teradata

Job description

Comcast’s FreeWheel unit seeks a data engineer to independently design, develop, and manage advanced data structures and pipelines, ensuring data quality and accessibility. The role strategically implements data solutions across platforms, while maintaining privacy and regulatory compliance.

You will work with SQL, Python, Spark, cloud data warehouses, and modern tools like dbt, Airflow, Looker, and Snowflake to enable reliable data ingestion, processing, and consumption for business insights.