Senior Data Engineer at Evolved Ideas Spain

Evolved Ideas Spain; España; Híbrido; EUR 70.000 - 90.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible hybrid work

Private medical insurance

Training budget

Extra holidays

Professional development

Descripción de la vacante

Evolved Ideas is seeking a Senior Data Engineer to own end-to-end data pipelines and customer identity matching in a complex analytics environment. You will build scalable workflows using BigQuery, Python, Airflow, and GCP services, ensuring reliability and measurable data quality.

You will collaborate with stakeholders across functions, design robust data models, and contribute to production-grade pipelines with careful validation and monitoring.

Formación

• 5+ years of experience in production data engineering.
• Strong experience with BigQuery and advanced SQL in large-scale analytical environments.
• Strong Python skills for production-grade data engineering.
• Solid Airflow experience and a strong understanding of reliable orchestration patterns.
• Hands-on experience with incremental pipelines and idempotent data processing.
• Experience with probabilistic record linkage or entity resolution in production.
• Strong understanding of data quality, matching logic, and precision/recall trade-offs.
• A careful, structured, and ownership-driven way of working.
• Strong communication skills and the ability to explain technical decisions clearly.
• English Level required: B2 - Independent users of the language, i.e. those who have the necessary fluency to communicate without effort with native speakers.

Responsabilidades

• Own the end-to-end pipeline that creates the unified customer_uuid across Books & Media and Fashion.
• Maintain and evolve our customer identity master data with a focus on accuracy and production quality.
• Improve probabilistic identity resolution model and make matching decisions measurable and explainable.
• Build scalable pipelines across BigQuery, GCS, and Cloud Run Jobs.
• Introduce diagnostics, monitoring, and validation for model changes.
• Identify and resolve edge cases in customer matching logic before production issues.
• Collaborate with business and technical stakeholders to turn matching challenges into robust data solutions.

Conocimientos

5+ years experience in data eng

English communication

Herramientas

BigQuery

SQL

Python

Airflow

Splink

Google Cloud Storage

Cloud Run Jobs

Pub/Sub

Descripción del empleo

Senior Data Engineer Data Engineer

ABOUT US

We are a multi-award-winning team of over 100 engineers, designers, and analysts based in Leicester, with development hubs in Ukraine and Spain. We specialise in bespoke software development, extended teams/staff augmentation, and support as a service.

OUR CLIENT

Our partner is Europe’s leading platform for buying and selling books, CDs, movies, games, and fashion. The company fosters success by bringing together a team of professionals with diverse backgrounds who collaborate to bring bold ideas to life and find innovative solutions.

We are looking for a Data Engineer to join the Evolved Ideas team.

Your mission

• Own the end-to-end pipeline that creates the unified customer_uuid across Books & Media and Fashion
• Maintain and evolve our customer identity master data with a strong focus on accuracy, reliability, and production quality
• Improve our probabilistic identity resolution model and make matching decisions measurable, transparent, and explainable
• Build scalable and cost-efficient data pipelines across BigQuery, GCS, and Cloud Run Jobs
• Introduce diagnostics, monitoring, and structured validation for every relevant model change
• Identify and resolve edge cases in customer matching logic before they become production issues
• Work closely with business and technical stakeholders to turn complex matching challenges into robust data solutions

Your Tech Stack

• BigQuery
• SQL
• Python
• Airflow
• Splink
• Google Cloud Storage
• Cloud Run Jobs
• Pub/Sub

Your profile

• 5+ years of experience in production data engineering
• Strong experience with BigQuery and advanced SQL in large-scale analytical environments
• Strong Python skills for production-grade data engineering
• Solid Airflow experience and a strong understanding of reliable orchestration patterns
• Hands-on experience with incremental pipelines and idempotent data processing
• Experience with probabilistic record linkage or entity resolution in production
• Strong understanding of data quality, matching logic, and precision/recall trade-offs
• A careful, structured, and ownership-driven way of working
• Strong communication skills and the ability to explain technical decisions clearly
• English Level required: B2 - Independent users of the language, i.e. those who have the necessary fluency to communicate without effort with native speakers.

Nice-To-Have

• Experience with Splink and probabilistic record linkage tools
• Experience with Cloud Run Jobs, GCS, and event-driven patterns in GCP
• Experience with Pub/Sub as a source in data pipelines
• Familiarity with data format trade-offs such as Parquet, Avro
• Experience with dbt
• Exposure to downstream BI use cases
• Experience in e-commerce or marketplace environments

YOU CAN LOOK FORWARD TO

• Contributing to a high scale, complex product and seeing the real-time impact of your work
• Flexible and hybrid working
• Private Medical Healthcare insurance
• Training budget
• Extra holidays
• Challenging tasks and professional development, knowledge & best practice sharing

We are based in the Canary Islands, Spain.

To apply for this vacancy you must have the right to work in Spain (NIE and SS.SS.). The role can only be performed remotely within Spain. We are unable to hire candidates who require relocation or visa support.