Associate Data Engineer

NBCUniversal; Brentford; On-site; GBP 40,000 - 60,000; Full time

Job summary

A digital media organization is seeking an Associate Data Engineer to develop and maintain data pipelines, contributing to a connected data ecosystem. The ideal candidate will have 1+ years in data engineering, strong OOP skills, and experience with tools such as SQL and Apache Spark. Join a driven team that prioritizes innovation and collaboration in a dynamic environment.

Qualifications

• 1+ years relevant experience in Data Engineering.
• Experience with near real-time & batch data pipeline development.
• Proficient with SQL and programming languages like Java or C++.

Responsibilities

• Develop and maintain data pipelines according to requirements.
• Deliver observable, reliable software with automation focus.
• Operationalize data processing systems and support observability.

Skills

Data Pipeline Development

SQL

OOP Programming

DevOps

Machine Learning

Education

Bachelor's degree in Computer Science or related fields

Tools

Kubernetes

Apache Spark

Google BigQuery

Apache Airflow

Job description

Our Media Group portfolio is a powerhouse collection of consumer-first brands, supported by media industry leaders, Comcast, NBCUniversal, and Sky. When you join our team, you’ll work across our dynamic portfolio including Peacock, NOW, Fandango, SkyShowtime, Showmax, and TV Everywhere, powering streaming across more than 70 countries globally. And the evolution doesn’t stop there. With an unequaled scale, our teams make the most out of every opportunity to collaborate and learn from one another. We’re always looking for ways to innovate faster, accelerate our growth, and consistently offer the very best in the consumer experience. But most of all, we’re backed by a culture of respect. We embrace authenticity and inspire people to thrive.

As part of the Media Group Decision Sciences team, the Associate Data Engineer will be responsible for creating a connected data ecosystem that unleashes the power of our streaming data with a focus on international propositions. We gather data from across all customer/prospect journeys in near real-time, to allow fast feedback loops across territories; combined with our strategic data platform, this data ecosystem is at the core of being able to make intelligent customer and business decisions.

In this role, the Associate Data Engineer will share responsibilities in the development and maintenance of optimized and highly available data pipelines that facilitate deeper analysis and reporting by the business, as well as support ongoing operations related to the Media Group data ecosystem.

Responsibilities include, but are not limited to:

• Develop and maintain batch and streaming data pipelines according to business and technical requirements.
• Deliver observable, reliable and secure software, embracing “you build it, you run it” mentality, and focus on automation.
• Continually work on improving the codebase and have active participation in all aspects of the team, including agile ceremonies.
• Take an active role in story definition, assisting business stakeholders with acceptance criteria.
• Work with Principal Engineers and Architects to share and contribute to the broader technical vision.
• Practice and champion best practices, striving towards excellence and raising the bar within the department.
• Operationalize data processing systems (DevOps) and system observability (SRE)
• Contribute to the team in design, build, testing, scaling and maintaining data pipelines from a variety of source systems and streams (Internal, third party, cloud based, etc.), according to business and technical requirements.
• Develop and champion best practices, striving towards excellence and raising the bar within the department.
• Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning, to better define and curate models, test hypothesis, and deliver key insights
• Operationalize data processing systems (dev ops)

Qualifications

• 1+ years relevant experience in Data Engineering
• Experience of near Real Time & Batch Data Pipeline development in a similar Big Data Engineering role.
• Programming skills with an OOP language (e.g., Java, C++)
• Proficient with SQL
• Experience working in a cloud environment such as Google Cloud Platform or AWS
• Hands on programming experience of the following (or similar) technologies:
• Kubernetes, Docker
• Apache Beam, Apache Flink, Apache Spark
• Google BigQuery, Snowflake
• Google BigTable
• Google Pub/Sub, Kafka
• Apache Airflow
• Experience implementing observability around data pipelines using SRE best practices.
• Experience in processing structured and unstructured data into a form suitable for analysis and reporting with integration with a variety of data metric providers ranging from advertising, web analytics, and consumer devices.
• Bachelors’ degree with a specialization in Computer Science, Engineering, Physics, other quantitative field or equivalent industry experience.

Desired Characteristics

• Strong Test-Driven Development background, with understanding of levels of testing required to continuously deliver value to production.
• Experience with large-scale video assets
• Ability to work effectively across functions, disciplines, and levels
• Team-oriented and collaborative approach with a demonstrated aptitude, enthusiasm and willingness to learn new methods, tools, practices, and skills
• Ability to recognize discordant views and take part in constructive dialogue to resolve them
• Pride and ownership in your work and confident representation of your team to other parts of the business

Additional Information

As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.

If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to [e-mail].