Data Engineering Lead

Chubb External; Madrid; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

2 days homeworking

Private medical insurance

Pension plan

Learning & Development

Job summary

Chubb European Group Spain is seeking a Senior Data Engineering Lead to drive design, build, and evolution of a modern data platform across Databricks, Snowflake, and Azure.

This hands-on leadership role requires steering engineering squads, defining standards, and delivering production-ready data solutions in partnership with stakeholders across the region.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• Hands-on experience building and operating production data platforms on Databricks and Snowflake.
• Proven experience leading engineering squads and owning technical direction.
• Strong background in data warehouse design, distributed systems, performance tuning, cost optimisation, and resilience.
• Experience with Databricks on Azure, PySpark, Delta Lake, Structured Streaming, Delta Live Tables, and Event Hubs/Kafka.

Responsibilities

• Lead the design, build, and optimisation of scalable, high-performance data pipelines and applications on Databricks, Snowflake, and Azure.
• Stay hands-on with critical code paths, solving complex technical challenges and setting the standard for quality, testing, and operational excellence.
• Define and promote engineering standards across squads, including coding practices, CI/CD, testing, observability, and performance.
• Guide delivery from discovery to go-live across multiple initiatives, ensuring speed without compromising quality, security, or maintainability.
• Mentor engineers, review designs and pull requests, and help grow the data engineering capability.
• Champion Agile ways of working to improve team effectiveness and delivery flow.
• Make pragmatic architecture decisions across cloud-native solutions, microservices, and event-driven patterns.
• Design and build core data assets on Databricks, including medallion-style data lakes, PySpark pipelines, streaming solutions, and downstream data products.
• Partner with architects and stakeholders to ensure solutions align with business goals, compliance requirements, and target architecture.

Skills

Databricks

Snowflake

Spark

SQL

Python

Leadership

Data warehousing

Distributed systems

CI/CD

Azure

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks on Azure

PySpark

Delta Lake

Structured Streaming

Delta Live Tables

Event Hubs/Kafka

Job description

Are you ready to shape the future of a world-class data platform in a global insurance environment?

Chubb European Group is looking for a Senior Data Engineering Lead to drive the design, build, and evolution of our data platform across Azure, Databricks, and Snowflake.

This is a hands-on leadership role with real architectural influence. You’ll set the technical direction for complex, data-heavy solutions, lead engineering squads through the full delivery lifecycle, and help define the frameworks, patterns, and integrations that power data across the business.

We’re looking for an experienced engineer who wants more than delivery — someone who wants to own the “how” of a modern data platform, write code where it matters, raise the bar on engineering quality, and mentor others while turning strategy into production-ready solutions.

The role reports to the EMEA Data Engineering and Architecture Lead and works closely with engineering squads, solution architects, product owners, and business stakeholders across the region.

Key responsibilities

• Lead the design, build, and optimisation of scalable, high-performance data pipelines and applications on Databricks, Snowflake, and Azure
• Stay hands-on with critical code paths, solving complex technical challenges and setting the standard for quality, testing, and operational excellence
• Define and promote engineering standards across squads, including coding practices, CI/CD, testing, observability, and performance
• Guide delivery from discovery to go-live across multiple initiatives, ensuring speed without compromising quality, security, or maintainability
• Mentor engineers, review designs and pull requests, and help grow the data engineering capability
• Champion Agile ways of working to improve team effectiveness and delivery flow
• Make pragmatic architecture decisions across cloud-native solutions, microservices, and event-driven patterns
• Design and build core data assets on Databricks, including medallion-style data lakes, PySpark pipelines, streaming solutions, and downstream data products
• Partner with architects and stakeholders to ensure solutions align with business goals, compliance requirements, and target architecture

Qualifications

Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).

• Strong hands-on experience building and operating production data platforms on Databricks and Snowflake
• Deep knowledge of Spark, SQL, Python, and cloud data engineering on Azure
• Proven experience leading engineering squads and owning technical direction, trade-offs, and outcomes
• Strong background in data warehouse design, distributed systems, performance tuning, cost optimisation, and resilience
• Experience with Databricks on Azure, PySpark, Delta Lake, Structured Streaming, Delta Live Tables, and Event Hubs/Kafka
• Confidence working across the full SDLC, with strong CI/CD, automated testing, and observability practices
• Ability to influence senior stakeholders and translate business needs into clear technical solutions
• Experience in insurance or financial services is a plus

What we offer in return

• 32days of vacation a year
• 2 days working from home option + additional flexible days
• Working from home allowance
• Entry time flexibility
• Private medical insurance
• Life and accident insurance
• Pension plan
• Stock purchase plan
• Employee assistance program
• Comprehensive Learning & Development offer

Integrity. Client Focus. Respect. Excellence. Teamwork
Our core values dictate how we live and work. We’re an ethical and honest company that’s wholly committed to its clients. A business that’s engaged in mutual trust and respect for its employees and partners. A place where colleagues perform at the highest levels. And a working environment that’s collaborative and supportive.

Diversity & Inclusion

At Chubb, we consider our people our chief competitive advantage and as such we treat colleagues, candidates, clients, and business partners with equality, fairness and respect, regardless of their age, disability, race, religion or belief, gender, sexual orientation, marital status or family circumstances.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Equal Opportunity Statement

It is our policy to provide equal employment opportunity in all of our employment practices without regard to race, color, religion, sex, national origin, ancestry, marital status, age, individuals with disabilities, sexual orientation or gender identity or expression or any other legally protected category.

Applicants for positions with Chubb Spain must be legally authorized to work in Spain.

Job Info

• Job Identification 29515
• Job Schedule Full time
• Regular or Temporary Regular
• Job Category Platform Architecture
• Business Unit Spain
• Legal Employer Chubb European Group SE Spanish Branch