Principal Engineer (Data & AI Capabilities)

Women in Data®; Greater London; On-site; GBP 120,000 - 180,000; Full time

Job summary

Compare the Market in London is seeking a senior leader to own the technical direction for Data & AI, shaping how AI and data solutions are designed and built across the business. You will lead the design and delivery of complex, large-scale AI and data initiatives adopted across the organisation.

You will establish best practices, monitor and support AI systems in production, and collaborate with senior stakeholders to turn business goals into practical technical solutions.

Qualifications

• Significant experience designing, delivering and supporting large-scale data and AI solutions in production.
• Experience setting technical direction, engineering standards, and influencing leadership-level decisions.
• Strong software engineering fundamentals for data-intensive systems.

Responsibilities

• Set the technical direction for Data & AI and shape how AI and data solutions are designed and built across the business.
• Lead the design and delivery of complex, large-scale AI and data solutions adopted across the organisation.
• Establish best practices, standards and reusable frameworks for teams to build more efficiently.
• Improve monitoring, evaluation and support of AI systems in production to maintain value.
• Partner with senior stakeholders across Data, Product and Engineering to translate business goals into technical solutions.
• Mentor engineers and ensure governance, standards and controls grow with the AI capability.

Skills

Technical leadership

Data & AI architecture

Large-scale systems

Production ML

Stakeholder management

Mentoring

Tools

Python

PySpark

SQL

Cloud platforms (AWS/Azure/GCP)

Job description

So are we. Join Compare the Market and help to make financial decision making a breeze for millions.

At Compare the Market, we're a purpose-driven business powered by tech and AI. We're building high-performing, results-driven teams with the skills, mindset, and ambition to deliver outcomes at pace. Every role here plays a part in driving our mission forward, and we create an environment where you can bring your authentic self, grow a truly characterful career, and see the direct impact of your work on the lives of our customers.

We've carved a meerkat-shaped niche and we're looking for ambitious, curious thinkers who thrive in a fast-moving, high-impact environment. If you love accountability, embrace challenge, and want to make a real difference, you'll fit right in.

What you'll be doing:

• Set the technical direction for Data & AI, acting as a trusted technical leader who shapes how AI and data solutions are designed and built across the business.
• Lead the design and delivery of complex, large-scale AI and data solutions that can be adopted and scaled across the organisation.
• Establish best practices, standards and reusable frameworks that help teams build more consistently and efficiently.
• Improve how we monitor, evaluate and support AI systems in production, so they remain reliable and continue to deliver value.
• Partner with senior stakeholders across Data, Product and Engineering to turn business goals into impactful technical solutions.
• Mentor engineers across the Data & AI community and help ensure the right governance, standards and controls are in place as our AI capability grows.

What we’re looking for:

• Significant experience designing, delivering and supporting large-scale data and AI solutions in production, within a complex organisation.
• Proven experience setting technical direction, establishing engineering standards and frameworks, and influencing decisions from engineering through to leadership level.
• Strong software engineering fundamentals, with experience designing, building and operating large-scale, data-intensive systems in production.
• Experience of, understanding of, or a strong interest in, applying these skills to AI/ML engineering.
• A strong understanding of how to balance technical excellence with business outcomes.
• The ability to communicate complex ideas clearly and build strong relationships with both technical and non-technical stakeholders.
• A passion for mentoring others and helping teams and individuals develop.
• An interest in shaping how organisations adopt and scale AI in a practical, responsible and impactful way.

Why Compare the Market?

We're a business built for pace and performance. Here, you'll be encouraged to think differently, act boldly, and deliver brilliantly in a culture that values results and rewards progress.

We believe diverse teams make better decisions, and we're committed to creating an inclusive workplace where everyone feels empowered to grow, contribute, and thrive.

Women in Data advertise roles on behalf of our partners, alliances, and members.

We are proud supporters of Women in Data.

Connect, engage and belong to the largest free female data community in the UK - visit: womenindata.ai to join our community.

Stay connected! Follow us on LinkedIn for updates on career opportunities and more.