Data Engineer

NewDay Technology; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

NewDay Technology is seeking a Data Engineer to design, build and evolve core pipelines powering analytics and data science. You will own the data lake and data platform, ensure reliable ETL/ELT, and drive scalable, cloud-native data solutions within an Agile framework.

You will optimise performance, collaborate with teams, and contribute to automation and best practices across the data stack.

Qualifications

• H hands-on experience with DBT and Apache Airflow.
• Experience solving complex data problems at scale with Python and SQL.
• Knowledge of data modelling, ETL/ELT, data warehousing and scalable pipelines.
• Ability to lead and mentor Data Engineers, providing technical direction.
• Interest in AI and automation to improve engineering quality and productivity.
• Comfort working in an Agile environment with cloud-native data solutions.

Responsibilities

• Developing and improving ingestion and transformation pipelines using Spark, Scala, Python, AWS, DBT, and Snowflake
• Owning and improving the organisation's Data Lake environment and data platform
• Owning ETL processing, table refreshes, defect resolution and other BAU activities
• Continuously optimising performance through concurrency, multi-threading, automation and best-practice patterns
• Working within Agile delivery to ship cloud-native data solutions via CI/CD
• Integrating data from multiple sources and solving sophisticated data challenges with creativity
• Design and develop modular, reusable scalable and configurable data engineering solutions adhering to DRY

Skills

Python

SQL

Data modelling

CI/CD

Leadership

Tools

DBT

Apache Airflow

AWS

Snowflake

Job description

Are you ready to shape the backbone of a data‑driven organisation? NewDay are looking for a Data Engineer to help us design, build, and evolve the core pipelines and platforms that power analytics, reporting, and sophisticated data science across our business.

Why this role matters

You'll play a central role in ensuring data flows reliably and efficiently at scale. You will directly enable faster insights, smarter decision‑making, and a resilient data ecosystem that supports everything from operational reporting to ground breaking modelling.

How you'll contribute

• Developing and improving ingestion and transformation pipelines using technologies such as Spark, Scala, Python, AWS, DBT, and Snowflake
• Owning and improving the organisation's Data Lake environment and data platform. Ensuring it remains robust, scalable, and future‑ready
• Owning ETL processing, table refreshes, defect resolution, and other BAU activities
• Continuously optimising performance through concurrency, multi‑threading, automation, and best‑practice engineering patterns
• Working within Agile delivery frameworks to ship high‑quality, cloud‑native data solutions via CI/CD
• Integrating data from multiple sources and solving sophisticated data challenges with creativity.
• Design and develop modular, reusable scalable and configurable data engineering solutions that adhere to the D.R.Y principle, minimising manual intervention and promote automation.

We're looking for these essential skills

• Hands‑on experience with DBT and Apache Airflow, building scalable data transformations and DAGs to orchestrate complex, reliable data pipelines.
• Manage task dependencies, automated retries and error handling to ensure reliable pipeline execution with minimal manual intervention.
• Engineering experience using Python and SQL, with the ability to solve complex data problems at scale.
• The ability to design and guide modern data engineering solutions, with knowledge of data modelling, ETL/ELT, data warehousing and scalable data pipelines.
• The ability to lead and develop Data Engineers, combining hands‑on technical contribution with coaching, technical direction and ownership of delivery.
• An interest in AI and automation, with the technical curiosity to explore how emerging technologies could improve engineering quality, productivity and ways of working.

We know great candidates don't always meet every requirement. If you have strong data engineering foundations, hands‑on DBT experience and experience solving sophisticated problems at scale, we'd encourage you to apply even if you haven't worked with every technology listed above.

The impact you'll make

Your work will strengthen the foundation of our entire data landscape. By improving reliability, reducing manual intervention, and accelerating time to insight, you’ll help unlock new opportunities for analytics, innovation, and strategic growth.

Externally this job title might also be known as Data Platform Engineer.

At NewDay, we value all types of diversity. We're an equal opportunity employer and believe that our differences create a vibrant, authentic working culture. We want all our colleagues to feel able to bring their whole selves to work. We don't discriminate on the basis of protected characteristics or identities. We make sure that every job is crafted to be inclusive and that people with disabilities or caring responsibilities can take part in the application and interview process.

Tell us if you need accommodations: We'll put reasonable adjustments in place to support you.

We work with Textio to make our job design and hiring inclusive.

Permanent