Lead Data Engineer - Freewheel

Comcast (CC) of Willow Grove; Reston (VA); On-site; USD 158,000 - 237,000; Full time

Job summary

FreeWheel, a Comcast company, leads the design and management of sophisticated data engineering solutions to enhance decision-making and operational efficiency. The role oversees robust data pipelines and storage systems with a focus on high data quality and accessibility.

The position involves strategizing data architecture across platforms, driving data-centric objectives, and collaborating across teams to refine sourcing and processing while maintaining QA standards.

Qualifications

• Bachelor's degree required.
• 10+ years of experience in data engineering.
• Experience designing data pipelines and data architecture.

Responsibilities

• Lead data structure and pipeline development to standardize, transform, and deliver data for insights and reporting.
• Ensure data quality throughout the lifecycle with data quality frameworks.
• Design standardized methods for data consumption (APIs, database views, data extracts).
• Design and deploy data solutions on Kubernetes, Teradata, AWS, and Databricks to meet business needs.
• Choose data storage solutions based on sensitivity and access needs (minIO, Teradata, AWS S3, Redshift).
• Map data lineage and apply transformation rules to streamline troubleshooting and impact analysis.
• Collaborate with cross-functional teams to refine data sourcing and processing and optimize operations.
• Set design standards and QA protocols for software/systems development to ensure interoperability.
• Maintain regular attendance and be able to work nights and weekends as needed.

Skills

Apache Spark

Databricks Platform

Data Engineering

Java

SQL

Education

Bachelor's Degree

Tools

Kubernetes

Teradata

AWS

Databricks

MinIO

S3

Redshift

Job description

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.

Job Summary

This job leads in the design and management of sophisticated data engineering solutions to enhance decision-making and operational efficiency. It oversees the development of robust data pipelines and storage systems, ensuring high data quality and accessibility. The role is pivotal in strategizing and implementing data architecture across diverse platforms, driving the organization’s data-centric objectives.

Job Description

Responsibilities

• Leading data structure and pipeline development to standardize, transform, and deliver data for insights and reporting, following best practices
• Ensuring data quality throughout the lifecycle, from ingestion to processing and loading, through rigorous data quality frameworks
• Designing and implementing standardized methods for data consumption, including APIs, database views, and data extracts, to facilitate end-user access
• Designing and deploying data solutions on Kubernetes, Teradata, AWS, and Databricks to meet specific business requirements
• Choosing data storage solutions tailored to sensitivity and access needs using platforms like minIO, Teradata, AWS S3, and Redshift
• Mapping data lineage and applying transformation rules to streamline troubleshooting and impact analysis for data modifications
• Collaborating with cross-functional teams to refine data sourcing and processing, enhancing data quality, and optimizing operational processes
• Setting design standards and QA protocols for software/systems development to ensure data flows and storage solutions interoperate effectively
• Consistent exercise of independent judgment and discretion in matters of significance
• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary. Other duties and responsibilities as assigned

Skills

• Apache Spark
• Databricks Platform
• Data Engineering
• Java (Programming Language)
• Structured Query Language (SQL)

Compensation

• Virginia Pay Range: $158,057.06 - $237,085.58
• This job can be performed in Maryland with a Pay Range of $144,312.96 - $237,085.58 Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience
• The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later
• Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

Education

• Bachelor's Degree

Relevant Work Experience

• 10 Years +

Equal Opportunity Statement

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Disclaimer

Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Company Culture and Additional Information

At Comcast , you have the power to connect the world. Your career options are endless as you grow in your career. Explore your future with access to a variety of teams, locations, and resources in an expanding network. You can also explore additional opportunities at our company, NBCUniversal.