Data Engineer

The Independent; Greater London; On-site; GBP 65,000 - 95,000; Full time

Job summary

The Independent is seeking a Data Engineer to join the Data & Marketing Department. You will design, build and optimise scalable data pipelines and architectures supporting analytics, reporting and cross-functional data needs.

Join a fast-paced team focused on data-driven insights, with exposure to cloud platforms (GCP/AWS), modern ETL/ELT tooling and robust governance frameworks for privacy and security.

Qualifications

• Strong knowledge of SQL and relational databases; experience with non-relational databases.
• Designed and maintained scalable data pipelines and architectures integrating web analytics, CMS, subscriptions, ad tech and social data.
• Automated and optimized data workflows using ETL/ELT tools to ensure timely, reliable data delivery.
• Built data models and reporting layers for dashboards, engagement analytics, ad revenue tracking and A/B testing.
• Proficient in cloud platforms (AWS, GCP); experience with data warehouses like BigQuery or Snowflake.
• Proficient in Python and/or Java for data services and API integration.
• Strong communication to translate data into actionable insights; proactive, collaborative and deadline-driven.
• Knowledge of GDPR/compliance and data privacy best practices.

Responsibilities

• Design and maintain robust, scalable data pipelines to support current and future needs.
• Assemble large datasets from structured and unstructured sources ensuring functional requirements.
• Automate processes to improve data delivery performance and system scalability.
• Develop ETL/ELT infrastructure using Python, SQL and GCP Big Data tools.
• Prepare data for BI tools enabling data-driven decisions across teams.
• Collaborate with Data, Commercial and Editorial units to address technical challenges.
• Improve data systems' functionality, flexibility and performance.
• Ensure data governance and compliance with regulations across the org.

Skills

SQL & Databases

Big Data Pipelines

ETL/ELT

Python/Java

Data Modeling

Data Governance & GDPR

Cross-functional Collaboration

Education

Graduate degree in Computer Science or STEM

Tools

Airflow

dbt

Apache Spark

BigQuery

Snowflake

Job description

About Independent Media

Independent Media comprises The Independent, Standard Digital, Bulletin, BuzzFeed UK, HuffPost UK, Tasty UK, Seasoned, IndyBest and indy100.

Harnessing market-leading innovation and excellence across its portfolio of pioneering brands, Independent Media has unrivalled scale, integrity and authority via its sites, apps, video, audio, experiential, newsletters and social media.

While each Independent Media brand speaks in an authentic, unique voice to a loyal and distinct audience, they stand together in their commitment to positivity, inclusivity, and quality journalism and content.

Independent Media’s network reaches 650 million users each month, with 1.1 billion content views across its brands and platforms, including web, apps, social media, podcasts, email, YouTube, syndication partners and print.

The role and the team

We are looking for a Data Engineer to join our team. They will be responsible for maintaining and supporting the existing data infrastructure used to underpin our data analytics and reporting. They will be accountable for building as well as owning new engineering solutions. These must complement our current, scalable data architecture. The Data Engineer will be expected to optimize the architecture of our data pipelines and ensure that data flows support various cross functional teams across the business.

The ideal candidate will have a self-directed, innovative mindset who is comfortable supporting the data needs of multiple teams. The right candidate will be proactive in identifying and implementing improvements for our systems contributing constructively to the current data eco-system.

As the business continues to invest in cloud solutions, particularly Google Cloud Platform, you will be excited by the prospect of owning new projects, propelling our data initiatives and capabilities. The Data Engineer will be exposed to best practice methods with the current framework.

The Data & Marketing Department

The Data & Marketing department is the intelligence powerhouse of the business, representing the customer. Our goal is to inspire, engage and grow a loyal readership by harnessing data-driven insights and innovative marketing to deliver personalised, impactful content experiences that builds lasting trust, diverse revenue streams, and a thriving future for quality journalism. The department consists of four teams: Data Science & Engineering, Data Intelligence & Monetisation, Research & Insight and Customer Marketing.

Data Science & Engineering

The purpose of this team is to develop, maintain and optimise our best-in-class data ecosystem, developing products and services that increase efficiencies, profitability and enhance our understanding of the customer. The team’s output underpins the success of the business and plays a crucial role in supporting its future growth.

Diversity, Equity and Inclusion

• We champion diversity in our teams and in our reporting. As a growing and global brand, we must have a workforce that’s more representative of our readers, viewers, clients and partners, and a workplace that creates a sense of belonging for everyone
• We are committed to hiring and developing a diverse workforce regardless of background, and we support our people to thrive in their careers here.

The Independent is an equal opportunities employer, if you require any reasonable adjustments to complete your application, please do not hesitate to advise us accordingly.

About you

• A data engineer with a good knowledge of SQL and hands‑on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments.
• Experience in designing and maintaining scalable data pipelines and architectures—ideally integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media.
• Ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data.
• Some experience building robust data models and reporting layers to support performance dashboards, user engagement analytics, ad revenue tracking, and A/B testing frameworks.
• Skilled in cloud-based data platforms and infrastructure (e.g., AWS, GCP), ensuring scalability and security for large volumes of streaming and batch data. Ideally had some exposure to data warehouses such as BigQuery or Snowflake.
• Adept in Python and/or Java for developing data services and integrating APIs to bring in diverse sources of media data.
• Strong interpersonal and communication skills, enabling effective collaboration with analytical and commercial teams to turn data into actionable insights.
• Proactive and self-driven, capable of managing multiple data projects in a high tempo setting while meeting tight deadlines.
• A continuous learner with a diligent approach to data engineering including data privacy (e.g., GDPR compliance) and evolving best practices.

Key responsibilities and accountabilities

• Design and Maintain Data Pipelines: Develop and maintain robust, scalable, and efficient data pipeline architecture to support current and future business needs.
• Engineering and Integration: Assemble large, complex datasets from a variety of structured and unstructured sources, ensuring they meet functional requirements.
• Process Automation and Optimisation: Identify, design, and implement improvements to automate manual processes, enhance data delivery performance, and re‑architect infrastructure for improved scalability and resilience.
• ETL Development and Infrastructure Building: Build and manage the infrastructure necessary for optimal ETL or ELT of data using Python, SQL, and Google Cloud Platform (GCP) big data technologies, such as BigQuery, Dataflow, Dataproc and Cloud Storage.
• Business Intelligence Enablement: Prepare and transform pipeline data to support downstream analytics and feed BI tools (DOMO), enabling data‑driven decision‑making across the organization.
• Cross-Functional Collaboration: Partner with internal stakeholders—ranging from Data, Commercial, and Editorial teams to executive leadership—to address data‑related technical challenges and support their infrastructure needs.
• Enhance Data System Functionality: Collaborate with the Data Team to continuously improve the functionality, flexibility, and performance of data systems and platforms.
• Data Governance and Compliance: Ensure all data is handled responsibly, securely, and in full compliance with the Data Protection Act, GDPR regulations, and the Company’s Code of Conduct.

Essential skills and experience

• SQL and Database Expertise: Strong working knowledge of SQL with hands‑on experience querying and managing relational databases, alongside familiarity with a variety of database technologies (e.g., PostgreSQL, MySQL, BigQuery).
• Big Data Engineering: Exposure to designing, building, and optimizing ‘big data’ pipelines, architectures, and datasets, enabling efficient data processing at scale.
• Analytical Problem Solving: Ideally has performed root cause analysis on internal and external data sources and business processes to resolve issues and uncover opportunities for operational or strategic improvements.
• Unstructured Data Handling: Capability for working with unstructured and semi‑structured datasets transforming raw information into actionable insights.
• Data Workflow Development: Skilled in developing and maintaining data transformation processes, managing data structures metadata & workflow dependencies and orchestration frameworks.
• Large‑scale Data Processing: A demonstrated history of manipulating, processing, and extracting value from large, diverse, and disconnected datasets in fast-moving environments.
• Project Management & Collaboration: Strong project management and organizational skills, with experience supporting and collaborating with cross‑functional teams in dynamic and evolving settings.
• Education & Professional Background: Holds a graduate degree in Computer Science, STEM related quantitative field, with up to 2+ years of hands‑on experience in a data engineering role.

Tools & Technologies:

• Databases: Proficient in relational SQL databases.
• Workflow Management Tools: Exposure to orchestration platforms such as Apache Airflow.
• Programming Languages: Skilled in one or more of the following languages, i.e.: Python, Java, Scala.
• Cloud Infrastructure: Understanding of cloud infrastructure such as GCP and tools within the respective platform.

Our values – you will deliver across all our values

Inclusive: We champion diversity in our teams and in our reporting. Working as a team, we put transparency and effective communication at the heart of everything we do.

Innovative: From the very beginning, The Independent has been breaking the mould. We take risks and are always looking to try new ideas in pursuit of excellence.

Independent: Nobody tells us what to think; we make up our own minds and aren’t afraid to do things differently. Like our readers, we value honesty and integrity above outside influences.