Data Engineering Lead

Chubb Ltd.; Madrid; Presencial; EUR 50.000 - 70.000; Jornada completa

Descripción de la vacante

A global insurance provider in Madrid is seeking a Data Engineering Lead to design and architect high-performance data-heavy applications. The role involves mentoring teams, enforcing best practices in coding, and leading technical discussions. The ideal candidate will have extensive experience with data solutions in Spark, Python, and SQL. A Bachelor's degree in a relevant field is required. The position offers a collaborative environment, flexible work arrangements, and a range of benefits.

Servicios

32 days of vacation per year

2 days work from home option

Private medical insurance

Pension plan

Comprehensive Learning & Development offer

Formación

• Extensive experience developing complex data solutions in Spark, Python, SQL, Databricks, and Snowflake.
• Strong understanding of software architectures for data engineering.
• Proven experience leading development teams and projects.
• Excellent verbal and written communication skills.
• Familiarity with agile methodologies.

Responsabilidades

• Design and architect scalable data applications.
• Define best practices and coding standards.
• Lead technical discussions and decision-making.
• Mentor and guide junior and senior Data Engineers.
• Identify performance bottlenecks and implement optimizations.

Conocimientos

Spark

Python

SQL

Databricks

Snowflake

Agile methodologies

Automated testing practices

Educación

Bachelor’s degree in Computer Science or related field

Herramientas

Azure VM

Selenium

Appium

Robot Framework

Puppet

Ansible

Terraform

Descripción del empleo

Key Responsibilities

Design and architect complex, scalable, and high‑performance data‑heavy applications on Databricks and Snowflake, applying deep expertise in database architecture, data warehouse design, and cloud computing (Azure VM, Cloud Services).

Define and enforce best practices and coding standards for engineering squads, championing Agile principles and values (Scrum, Kanban) to foster team effectiveness and continuous improvement.

Lead technical discussions and decision‑making, guiding teams through the full development lifecycle—from discovery to go‑live—while ensuring projects are delivered on time and meet rigorous quality standards.

Act as the principal technical advisor for Data Engineering, collaborating with architects, developers, and product managers to deliver cohesive, impactful data products.

Oversee end‑to‑end development, including requirement analysis, deployment, and performance (DB / SQL), ensuring robust, error‑free applications.

Mentor and guide junior and senior Data Engineers, sharing knowledge through workshops, training sessions, and comprehensive documentation of architecture, design patterns, and development processes.

Promote a collaborative and innovative team environment, facilitating effective communication between technical and non‑technical stakeholders.

Conduct code reviews and advocate for automated testing practices, leveraging automation frameworks (Selenium, Appium, Robot Framework) and tools (Puppet, Ansible, Terraform) to ensure reliability and maintainability.

Identify performance bottlenecks and implement optimizations, supporting database maintenance, backups, and disaster recovery.

Stay current with industry trends, exploring and prototyping new technologies and methodologies for continuous improvement.

Lead initiatives in data cleansing, curation, harmonization, and feature engineering, ensuring data quality and integration align with organizational goals.

Design and implement secure, compliant data strategies, applying knowledge of data privacy, security, and regulations (GDPR, HIPAA, CCPA) to protect sensitive information.

Develop and manage data pipelines / ETL processes, master data management, and open data standards for system interoperability.

Apply advanced analytical skills to interpret complex data sets, build meaningful models, and drive data‑driven decision‑making.

Qualifications

Bachelor’s degree or higher in Computer Science, Information Technology, or related engineering field.

Extensive experience developing complex data solutions in Spark, Python, SQL, Databricks, and Snowflake.

Strong understanding of software architectures for data engineering, including metadata‑driven pipeline development, streaming patterns (Lambda / Kappa), and enterprise‑grade observability.

Proven experience leading development teams and projects, with a track record of mentoring and skill development.

Excellent verbal and written communication skills, capable of conveying complex technical concepts to diverse audiences.

Familiarity with agile methodologies and project management tools.

Ability to foresee challenges and opportunities within the development lifecycle and plan accordingly.

Strong attention to detail, flexibility to adapt to changing priorities, and a commitment to high‑quality, precise work output.

What we offer in return

32 days of vacation a year

2 days working from home option + additional flexible days

Working

Entry time flexibility

Private medical insurance

Life and accident insurance

Pension plan

Stock purchase plan

Employee assistance program

Comprehensive Learning & Development offer

Integrity. Client Focus. Respect. Excellence. Teamwork

Our core values dictate how we live and work. We’re an ethical and honest company that’s wholly committed to its clients. A business that’s engaged in mutual trust and respect for its employees and partners. A place where colleagues perform at the highest levels. And a working environment that’s collaborative and supportive.

Diversity & Inclusion

At Chubb, we consider our people our chief competitive advantage and as such we treat colleagues, candidates, clients, and business partners with equality, fairness and respect, regardless of their age, disability, race, religion or belief, gender, sexual orientation, marital status or family circumstances.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Equal Opportunity Statement

It is our policy to provide equal employment opportunity in all of our employment practices without regard to race, color, religion, sex, national origin, ancestry, marital status, age, individuals with disabilities, sexual orientation or gender identity or expression or any other legally protected category.

Applicants for positions with Chubb Spain must be legally authorized to work in Spain.