Data Engineer

Compare the Market; Peterborough; On-site; GBP 40,000 - 60,000; Full time

Job summary

Compare the Market is seeking a Data Engineer to design and operate scalable data pipelines, contributing to high-quality engineering solutions. You'll leverage your strong experience in data pipelines and robust programming skills in Python and SQL. The role emphasizes collaboration and the ability to address data quality issues, ensuring sound technical decisions and operational excellence.

This position promotes an inclusive workplace, encouraging innovative thinking and significant contributions to performance and purpose.

Qualifications

• Strong experience delivering data pipelines or platform components in modern production environments.
• Solid understanding of data engineering principles and scalable system design.
• Experience with modern data platforms and processing patterns.

Responsibilities

• Design, build, and operate scalable and reliable data pipelines.
• Deliver high-quality data engineering solutions from design through support.
• Identify and resolve data quality issues across the platform.

Skills

Python

SQL

Data engineering principles

Data modelling

Cloud-based environments

CI/CD practices

Problem-solving

Collaboration

Job description

Job Description

Data Engineer

Function: Tech

Location: London / Peterborough

Curious about what’s next? So are we. Join Compare the Market and help to make financial decision making a breeze for millions.

At Compare the Market, we’re a purpose-driven business powered by tech and AI. We’re building high‑performing, results‑driven teams with the skills, mindset, and ambition to deliver outcomes at pace. Every role here plays a part in driving our mission forward, and we create an environment where you can bring your authentic self, grow a truly characterful career, and see the direct impact of your work on the lives of our customers.

We’ve carved a meerkat‑shaped niche and we’re looking for ambitious, curious thinkers who thrive in a fast‑moving, high‑impact environment. If you love accountability, embrace challenge, and want to make a real difference, you’ll fit right in.

What You’ll Be Doing

• Design, build, and operate scalable and reliable data pipelines, services, and platform components
• Deliver high‑quality data engineering solutions from design through deployment and ongoing production support
• Contribute to technical decision‑making, balancing quality, performance, reliability, and long‑term sustainability
• Support the ongoing optimisation, monitoring, and operability of data services in production environments
• Identify and resolve data quality issues, technical debt, and performance bottlenecks across the platform
• Contribute to engineering best practices across testing, CI/CD, observability, and secure development
• Collaborate with engineering, analytics, and data teams to deliver scalable data solutions that enable business insight and innovation
• Participate in incident response, root cause analysis, and continuous improvement initiatives to strengthen platform resilience

What We’re Looking For

You’ll bring strong experience delivering data pipelines or platform components within modern production environments. You’re comfortable owning services end‑to‑end and have a solid understanding of data engineering principles, data modelling, and scalable system design.

You’ll have experience working with modern data platforms and processing patterns, alongside strong programming skills in technologies such as Python and SQL. Familiarity with cloud‑based environments, CI/CD practices, and operational excellence is important, as is the ability to make sound technical decisions and communicate trade‑offs clearly.

We’re looking for someone with strong problem‑solving and collaboration skills who enjoys working in a fast‑paced engineering environment and contributing to the evolution of scalable, maintainable, and well‑governed data solutions.

Why Compare the Market?

We’re a business built for pace and performance. Here, you’ll be encouraged to think differently, act boldly, and deliver brilliantly in a culture that values results and rewards progress.

We believe diverse teams make better decisions, and we’re committed to creating an inclusive workplace where everyone feels empowered to grow, contribute, and thrive.

If you’re ready to stretch yourself, raise the bar, and grow with a team that’s serious about performance, innovation, and purpose, we’d love to hear from you.