Lead Data Engineer

Itv Plc; London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading company in the broadcast media industry is seeking a Lead Data Engineer to oversee data pipeline infrastructure and lead a team. This role involves designing scalable data solutions, ensuring data quality, and collaborating with cross-functional teams. The ideal candidate will have extensive experience in data engineering and leadership, with a passion for innovation and data-driven solutions.

Qualifications

• Experience leading a small team of data engineers.
• Extensive knowledge as a Data Engineer.
• Proven success in designing data products on Databricks.

Responsibilities

• Lead a team of data engineers, providing technical leadership.
• Design and build scalable data solutions using Databricks.
• Monitor and optimise data pipelines for performance.

Skills

Leadership

Problem Solving

Communication

Collaboration

Tools

Databricks

Snowflake

GCP Big Data

Hadoop

Spark

Tableau

AWS QuickSight

Looker

Job description

Join to apply for the Lead Data Engineer role at ITV.

This range is provided by ITV. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Contract Type: Perm Full Time

Workplace: White City, London - expectation is 2 days in the office.

Closing Date: 15th May 2025

The role

As a Lead Data Engineer, both directly and via your team of data engineers, you will be responsible for developing, maintaining, and optimising our data pipeline infrastructure using our proprietary central data platform, which is based on Databricks. You will collaborate with cross-functional teams to design and implement scalable data solutions, ensuring efficient data ingestion, transformation, storage, and analysis.

This role offers the chance to lead impactful projects, work with cutting-edge technologies, and shape the future of data engineering at ITV. If you’re passionate about data, leadership, and innovation, we’d love to hear from you!

Key responsibilities

1. Lead and Inspire: Take charge of a talented team of data engineers, providing technical leadership, mentorship, and fostering a collaborative environment. Drive productivity, set clear objectives, and support professional growth while contributing to performance reviews and recruitment.
2. Design & Build Scalable Data Solutions: Own the end-to-end design, development, and maintenance of data pipelines and infrastructure using Databricks. Innovate with new approaches, ensuring efficient data ingestion, transformation, and storage at scale.
3. Collaborate Across Teams: Work closely with data scientists, analysts, and stakeholders to define data product requirements and deliver impactful visualisation solutions.
4. Performance & Quality Assurance: Monitor and optimise data pipelines for peak performance and reliability. Implement automated quality processes to ensure data accuracy and report outcomes through observability tools.
5. Governance & Security: Champion data governance, ensuring compliance with privacy and security regulations. Establish access controls, encryption, and retention policies to safeguard sensitive information.
6. Continuous Improvement: Stay ahead of industry trends, identify opportunities for automation and innovation. Engage with the ITV Symphony team to enhance features and contribute to the broader data engineering community.

Qualifications and Skills

1. Experience leading a small team of data engineers.
2. Extensive knowledge as a Data Engineer.
3. Proven success in designing and building data products on Databricks, Snowflake, GCP Big Data, Hadoop, Spark, etc.
4. Excellent problem-solving, analytical, and troubleshooting skills.
5. Strong communication and team collaboration abilities.
6. Programming skills in Python (PySpark preferred), Scala, or SQL.
7. Experience designing and implementing enterprise-level data pipelines, with knowledge of ETL processes.
8. Ability to write production-grade, automated testing code.
9. Experience deploying via CI/CD platforms like Github Actions or Jenkins.
10. Proficiency with distributed frameworks like Apache Spark.
11. Experience with cloud platforms (AWS, Azure, GCP) and services (S3, Redshift, BigQuery).
12. Knowledge of data modelling, database systems, and SQL optimisation.

Other key criteria

1. Knowledge of UK broadcast industry & broadcast/OTT advertising market.
2. Understanding of digital marketing and advertising industry.
3. Familiarity with data design for classification, regression, A/B testing, and statistical modelling.
4. Knowledge of Data Mesh, Data Architecture, BI Architecture, and Enterprise Architecture.
5. Understanding of data governance, privacy, and security principles.
6. Familiarity with data management tools: data engineering, governance, quality, metadata, master data management.
7. Experience building data visualisation solutions with Tableau, AWS QuickSight, Looker, etc.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• Broadcast Media Production and Distribution