Senior Data Engineer

Vallum Associates; Greater London; On-site; GBP 80,000 - 120,000; Full time

Job summary

Vallum Associates is seeking a Senior Data Engineer to design and deliver scalable enterprise data solutions within the insurance domain. You will lead data architecture, develop modern cloud-based data platforms, and ensure high-quality, governed data that supports analytics, AI, and business transformation.

Responsibilities include designing enterprise data solutions on AWS and Databricks, building data models, data warehouses, and lakehouse architectures, and delivering robust ETL/ELT

Qualifications

• Experience in the insurance industry is essential.
• Hands-on experience with modern cloud data platforms and data pipelines.
• Strong understanding of data governance and metadata management.

Responsibilities

• Design and deliver scalable enterprise data solutions.
• Lead data architecture and provide governance for data platforms.
• Develop data models, data warehouses, and lakehouse architectures.
• Build ETL/ELT pipelines and data integration solutions.
• Collaborate with business and IT teams to enable analytics, AI, and business transformation.
• Support analytics, reporting, and AI/ML initiatives.

Skills

Insurance industry experience

Agile delivery

Stakeholder management

Data governance

Data modelling

Data warehousing

Enterprise architecture

ETL/ELT

APIs

Kafka

Metadata management

Tools

AWS

Databricks

Oracle

PostgreSQL

MongoDB

Informatica

Kafka

Sparx EA

Erwin

Job description

We are looking for a Senior Data Engineer to design and deliver scalable enterprise data solutions within the insurance domain. You'll lead data architecture, develop modern cloud-based data platforms, and ensure high-quality, governed data that supports analytics, AI, and business transformation.

Key Responsibilities

• Design and implement enterprise data solutions on AWS and Databricks.
• Develop data models, data warehouses, and lakehouse architectures.
• Build scalable ETL/ELT pipelines and data integration solutions.
• Define enterprise data standards and governance frameworks.
• Collaborate with business and technical teams to deliver data-driven solutions.
• Support analytics, reporting, and AI/ML initiatives.

Required Skills & Experience

• Strong experience in the insurance industry.
• Expertise with AWS, Databricks, Oracle, PostgreSQL, and MongoDB.
• Experience with data modelling, data warehousing, and enterprise architecture.
• Hands-on ETL/ELT, Informatica, APIs, Kafka, and data pipelines.
• Knowledge of Sparx EA, Erwin, metadata management, and data governance.
• Strong stakeholder management and Agile delivery experience.