Senior Data Engineer - Cloud Pipelines & Architecture

Comcast; Reston (VA); On-site; USD 158,000 - 237,000; Full time

Job summary

Comcast in Reston, VA seeks a senior data engineer to lead the design and management of advanced data engineering solutions, building robust data pipelines and storage systems to enhance decision-making and operational efficiency.

You will standardize data consumption methods, implement data quality frameworks, and collaborate with cross-functional teams across AWS, Kubernetes, Teradata and Databricks to align data architecture with business goals.

Qualifications

• Bachelor's degree in a related field is preferred.
• 10+ years of relevant work experience.
• Experience designing and deploying data solutions on Kubernetes, Teradata, AWS, and Databricks.
• Strong data quality and governance practices.

Responsibilities

• Leading data structure and pipeline development to standardize, transform, and deliver data for insights and reporting.
• Ensuring data quality throughout the lifecycle with data quality frameworks.
• Designing and implementing standardized methods for data consumption (APIs, views, data extracts).
• Designing and deploying data solutions on Kubernetes, Teradata, AWS, and Databricks.
• Choosing data storage solutions (minIO, Teradata, AWS S3, Redshift).
• Mapping data lineage and applying transformation rules for troubleshooting and impact analysis.
• Collaborating with cross-functional teams to refine data sourcing and processing.

Skills

Data Engineering

Apache Spark

SQL

Java

Databricks Platform

Education

Bachelor's Degree

Tools

Databricks

Kubernetes

Teradata

AWS

Job description

Comcast in Reston, VA seeks a senior data engineer to lead the design and management of advanced data engineering solutions, building robust data pipelines and storage systems to enhance decision-making and operational efficiency.

You will standardize data consumption methods, implement data quality frameworks, and collaborate with cross-functional teams across AWS, Kubernetes, Teradata and Databricks to align data architecture with business goals.