Lead Data Engineer - Freewheel

Comcast; Reston (VA); On-site; USD 158,000 - 237,000; Full time

Job summary

Comcast in Reston, VA seeks a senior data engineer to lead the design and management of advanced data engineering solutions, building robust data pipelines and storage systems to enhance decision-making and operational efficiency.

You will standardize data consumption methods, implement data quality frameworks, and collaborate with cross-functional teams across AWS, Kubernetes, Teradata and Databricks to align data architecture with business goals.

Qualifications

• Bachelor's degree in a related field is preferred.
• 10+ years of relevant work experience.
• Experience designing and deploying data solutions on Kubernetes, Teradata, AWS, and Databricks.
• Strong data quality and governance practices.

Responsibilities

• Leading data structure and pipeline development to standardize, transform, and deliver data for insights and reporting.
• Ensuring data quality throughout the lifecycle with data quality frameworks.
• Designing and implementing standardized methods for data consumption (APIs, views, data extracts).
• Designing and deploying data solutions on Kubernetes, Teradata, AWS, and Databricks.
• Choosing data storage solutions (minIO, Teradata, AWS S3, Redshift).
• Mapping data lineage and applying transformation rules for troubleshooting and impact analysis.
• Collaborating with cross-functional teams to refine data sourcing and processing.

Skills

Data Engineering

Apache Spark

SQL

Java

Databricks Platform

Education

Bachelor's Degree

Tools

Databricks

Kubernetes

Teradata

AWS

Job description

Job Summary

This job leads in the design and management of sophisticated data engineering solutions to enhance decision-making and operational efficiency. It oversees the development of robust data pipelines and storage systems, ensuring high data quality and accessibility. The role is pivotal in strategizing and implementing data architecture across diverse platforms, driving the organization's data-centric objectives.

Job Description

Responsibilities:

• Leading data structure and pipeline development to standardize, transform, and deliver data for insights and reporting, following best practices
• Ensuring data quality throughout the lifecycle, from ingestion to processing and loading, through rigorous data quality frameworks
• Designing and implementing standardized methods for data consumption, including APIs, database views, and data extracts, to facilitate end-user access
• Designing and deploying data solutions on Kubernetes, Teradata, AWS, and Databricks to meet specific business requirements
• Choosing data storage solutions tailored to sensitivity and access needs using platforms like minIO, Teradata, AWS S3, and Redshift
• Mapping data lineage and applying transformation rules to streamline troubleshooting and impact analysis for data modifications
• Collaborating with cross-functional teams to refine data sourcing and processing, enhancing data quality, and optimizing operational processes
• Setting design standards and QA protocols for software/systems development to ensure data flows and storage solutions interoperate effectively
• Consistent exercise of independent judgment and discretion in matters of significance.
• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
• Other duties and responsibilities as assigned.

Employees at all levels are expected to:

• Understand our Operating Principles; make them the guidelines for how you do your job.
• Own the customer experience think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
• Know your stuff be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
• Win as a team make big things happen by working together and being open to new ideas.
• Be an active part of the Net Promoter System a way of working that brings more employee and customer feedback into the company by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
• Drive results and growth.
• Support a culture of inclusion in how you work and lead.
• Do what's right for each other, our customers, investors and our communities.

Disclaimer:

This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Skills:

Data Engineering; Apache Spark; Structured Query Language (SQL); Java (Programming Language); Databricks Platform

Salary:

Virginia Pay Range: $158,057.06 - $237,085.58

Additional Range: This job can be performed in Maryland with a Pay Range of $144,312.96 - $237,085.58

Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

10 Years +