Senior Data Engineer

Evolved Ideas Spain (formerly Secret Source); España; Remote; EUR 55,000 - 75,000; Full time

Benefits offered by this job

Flexible and hybrid working

Private medical insurance

Training budget

Extra holidays

Job summary

Evolved Ideas Spain (formerly Secret Source) is seeking a Senior Data Engineer to own one of our most business-critical data assets: the system that links customer identities across Books & Fashion and powers marketing, CRM, and analytics.

Based in Spain with remote-friendly policies, you will join the BI & Data Engineering team and build reliable, scalable data pipelines using BigQuery, Python, Airflow, and Splink while ensuring data quality and explainability.

Qualifications

• 5+ years of experience in production data engineering.
• Strong experience with BigQuery and advanced SQL in large-scale analytical environments.
• Strong Python skills for production-grade data engineering.
• Solid Airflow experience and a strong understanding of reliable orchestration patterns.
• Hands-on experience with incremental pipelines and idempotent data processing.
• Experience with probabilistic record linkage or entity resolution in production.
• Strong understanding of data quality, matching logic, and precision/recall trade-offs.
• Careful, structured, and ownership-driven way of working.
• Strong communication skills and the ability to explain technical decisions clearly.
• English level: B2 for independent communication with native speakers.

Responsibilities

• Own the end-to-end pipeline that creates the unified customer_identity across Books/Media and Fashion.
• Maintain and evolve the customer identity master data with a focus on accuracy and production quality.
• Improve probabilistic identity resolution model and make matching decisions transparent and explainable.
• Build scalable data pipelines across BigQuery, GCS, and Cloud Run Jobs.
• Introduce diagnostics, monitoring, and validation for model changes.
• Identify and resolve edge cases in customer matching logic before production issues.
• Collaborate with business and technical stakeholders to turn complex matching challenges into robust data solutions.

Skills

5+ years production data engineering

Communication skills

English level B2

Tools

BigQuery

SQL

Python

Airflow

Splink

Google Cloud Storage

Cloud Run Jobs

Pub/Sub

Job description

Weare amulti-award-winning team ofover 100engineers, designers, and analysts based inLeicester, with development hubs inUkraine and Spain. Wespecialise inbespoke software development, extended teams/staff augmentation, and support asaservice.

OUR CLIENT

Our partner isEurope’s leading platform for buying and selling books, CDs, movies, games, and fashion. The company fosters success bybringing together ateam ofprofessionals with diverse backgrounds who collaborate tobring bold ideas tolife and find innovative solutions.

Weare looking for a Data Engineer tojoin the Evolved Ideas team.

As Senior Data Engineer, you will own one ofour most business-critical data assets: the system that links customer identities across our businesses and powers better decisions inmarketing, CRM, reporting, and analytics. You will join our Business Intelligence &Data Engineering team and work closely with Data Engineers and Business Analysts tobuild reliable, scalable, and trustworthy customer identity data.

Your mission

• Own the end-to-end pipeline that creates the unified customer_uuid across Books &Media and Fashion
• Maintain and evolve our customer identity master data with astrong focus onaccuracy, reliability, and production quality
• Improve our probabilistic identity resolution model and make matching decisions measurable, transparent, and explainable
• Build scalable and cost-efficient data pipelines across BigQuery, GCS, and Cloud Run Jobs
• Introduce diagnostics, monitoring, and structured validation for every relevant model change
• Identify and resolve edge cases incustomer matching logic before they become production issues
• Work closely with business and technical stakeholders toturn complex matching challenges into robust data solutions

Our Tech Stack

• BigQuery
• SQL
• Python
• Airflow
• Splink
• Google Cloud Storage
• Cloud Run Jobs
• Pub/Sub

Must-Have

• 5+years ofexperience inproduction data engineering
• Strong experience with BigQuery and advanced SQL inlarge-scale analytical environments
• Strong Python skills for production-grade data engineering
• Solid Airflow experience and astrong understanding ofreliable orchestration patterns
• Hands-on experience with incremental pipelines and idempotent data processing
• Experience with probabilistic record linkage orentity resolution inproduction
• Strong understanding ofdata quality, matching logic, and precision/recall trade-offs
• Acareful, structured, and ownership-driven way ofworking
• Strong communication skills and the ability toexplain technical decisions clearly
• English Level required: B2 - Independent users of the language, i.e. those who have the necessary fluency to communicate without effort with native speakers.

We are based in the Canary Islands, Spain. To apply for this vacancy you must have the right to work in Spain (NIE andSS.SS.) The role can only be performed remotely within Spain. We are unable to hire candidates who require relocation or visa support.

Nice-To-Have

• Experience with Splink and probabilistic record linkage tools
• Experience with Cloud Run Jobs, GCS, and event-driven patterns inGCP
• Experience with Pub/Sub asasource indata pipelines
• Familiarity with data format trade-offs such asParquet, Avro
• Experience with dbt
• Exposure todownstreamBI use cases
• Experience ine-commerce ormarketplace environments

YOU CAN LOOK FORWARD TO

• Contributing toahigh scale, complex product and seeing the real-time impact ofyour work
• Flexible and hybridworking
• Private MedicalHealthcare insurance
• Training budget
• Extra holidays
• Challenging tasks and professional development, knowledge &best practice sharing