Data Engineer

Compare the Market; Peterborough; Hybrid; GBP 45,000 - 60,000; Full time

Job summary

Join a leading company as a Data Engineer, where you'll work with a community of data professionals to deliver innovative data-driven products. You'll engage in agile practices, improve continuously, and utilize cutting-edge technologies like Kafka, Spark, and AWS. Enjoy a culture of creativity and inclusivity while making a real impact on customer experiences.

Benefits

competitive salary

hybrid working

generous holiday allowance

private healthcare

electric car scheme

paid development days

wellbeing days

CSR days

Qualifications

• Experience with Scrum and Kanban Agile delivery practices.
• Knowledge of Data Engineering practices and technologies, especially Kafka, Spark, and AWS.
• Strong SQL skills and familiarity with cloud databases.

Responsibilities

• Engage actively with team activities and agile ceremonies.
• Implement core engineering practices including TDD, BDD, CI/CD.
• Build, run, and own secure, scalable, responsive, and sustainable solutions.

Skills

Agile delivery practices

Effective team communication

Data Engineering practices

SQL skills

Tools

Kafka

Spark

AWS

Docker

Kubernetes

Jira

Confluence

GoCD

Jenkins

Github

Job description

Our purpose is to make great financial decision making a breeze for everyone, and that purpose drives us every day.

It's why we're on a mission to create an automated quoting engine, with the simplest of experiences, wrapped in a brand everyone loves!

We change lives by making it simple to switch and save money and that's why good things happen when you meerkat.

We'd love you to be part of our journey.

As a Data Engineer, you will work within an ambitious community of data professionals focused on delivering great data-driven products that make our customers' lives easier and better.

You will be an expert in all data engineering practices, employing the simplest and most effective techniques and tools to produce high-quality code at pace.

You will actively contribute to a community of data engineers working across the CTM business.

You'll make a real impact by delivering customer value early and often, and take an active role in improving your team's Agile development practices and effectiveness.

Everyone is welcome.

We have a culture of creativity. We approach our work passionately, improve constantly, and celebrate our wins at every turn. We are an inclusive workplace where our employees are comfortable bringing their authentic selves to work. Everyone is welcome. Be you.

This means we're excited to hear from people with a range of skills, experiences, and ideas. We don't expect you to tick all the boxes, but we'd love to hear what makes you great for this role.

Some of the great things you'll be doing:

1. Engage actively with team activities and agile ceremonies to drive continuous improvement. Identify potential problems or risks and take ownership of solutions. Strive to improve your knowledge and skills through training and personal development.
2. Understand and effectively implement core engineering practices including TDD, BDD, CI/CD, and pair programming. Ensure higher quality, security, and privacy practices within products.
3. Be ready to adopt and embed innovative approaches and contribute ideas for improvement. Participate in communities of practice to foster knowledge sharing and upskilling.
4. Understand the outcomes we aim for and proactively suggest the best route to deliver value early, while maintaining quality and reducing risk.
5. Demonstrate a 'DevOps mindset' by building, running, and owning secure, scalable, responsive, and sustainable solutions. Maintain documentation and runbooks to the same standards as code.

What we'd like to see from you:

• Experience with Scrum and Kanban Agile delivery practices
• Familiarity with Agile collaboration tools such as Jira and Confluence
• Comfort working with distributed teams
• Effective team communication skills
• Knowledge of Data Engineering practices and technologies, especially Kafka, Spark, and AWS in Java or Python
• Experience with BDD, TDD, and CI/CD practices
• Knowledge of GoCD, Jenkins, and Github is preferred
• Strong SQL skills and familiarity with cloud databases is advantageous
• Experience with Docker and Kubernetes is ideal

Our people bring our purpose to life.

We champion a culture of innovation and challenge. Our teams of over 300 tech experts use the latest tools and technologies including Docker, Kubernetes, AWS, Kafka, Java, Scala, Python, .NET Core, Node.js, and MongoDB.

There's something for everyone.

We offer opportunities for growth. You'll have the tools and autonomy to develop your career, supported by talented colleagues.

Our benefits include a competitive salary, hybrid working, generous holiday allowance, private healthcare, electric car scheme, paid development, wellbeing, and CSR days—supporting what matters to you.