Senior Data Platform Engineer - Cloud & Databricks Lead

Ageas; Greater London; Hybrid; GBP 95,000 - 105,000; Full time

Benefits offered by this job

Flexible Working

Health Insurance

Pension

Annual Bonus

Job summary

Ageas is seeking a Lead Data Engineer to lead design, development and continuous improvement of a modern cloud-based data platform in London. You will mentor engineers, design scalable pipelines, and collaborate with analytics and AI teams to deliver trusted data products.

Key focus areas include CI/CD, IaC, data governance and cost-efficient operations. The role requires hands-on expertise with Databricks, Spark, SQL and Python and a proactive coaching approach.

Qualifications

• Hands-on knowledge of Databricks, Spark, SQL and Python.
• Understanding of Airflow, Terraform and modern engineering practices.
• Experience building large-scale batch and real-time data pipelines.
• Strong problem-solving and decision-making skills.
• Ability to explain technical concepts clearly and simply.

Responsibilities

• Lead the development and improvement of the data platform and engineering standards.
• Mentor and support a team of data engineers to help them grow and succeed.
• Design, build and maintain scalable data pipelines and data products.
• Work with analytics, AI and business teams to solve data challenges.
• Improve platform reliability, performance, security and cost efficiency.
• Drive best practice in testing, automation, CI/CD and Infrastructure as Code.
• Support the delivery of trusted data for reporting, modelling and AI use cases.
• Help shape data strategy and assess new technologies and tools.
• Promote continuous improvement and knowledge sharing across teams.
• Ensure data governance and compliance requirements are built into solutions.

Skills

Databricks

Spark

SQL

Python

Airflow

Terraform

Data pipelines

Team mentoring

Communication

AI interest

Job description

Ageas is seeking a Lead Data Engineer to lead design, development and continuous improvement of a modern cloud-based data platform in London. You will mentor engineers, design scalable pipelines, and collaborate with analytics and AI teams to deliver trusted data products.

Key focus areas include CI/CD, IaC, data governance and cost-efficient operations. The role requires hands-on expertise with Databricks, Spark, SQL and Python and a proactive coaching approach.