Databricks Data Engineer

Square One Resources; Madrid; Hybrid; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Hybrid work in Madrid

Job summary

Square One Resources in Madrid is seeking a Databricks Data Engineer to join a data-focused team. This hands-on role demands strong Databricks, PySpark and Python skills to design, build and optimise scalable data pipelines.

You will implement end-to-end pipelines, use Medallion Architecture, perform transformations with PySpark and SQL, ingest data from APIs, databases and files, and optimise performance. The role is hybrid in Madrid with days at the office for collaboration.

Qualifications

• Hands-on Databricks experience.
• Strong PySpark development.
• Proficient in SQL and data transformations.
• Experience ingesting data from APIs, databases, files.

Responsibilities

• Design and develop end-to-end data pipelines from source systems through Gold-layer datasets.
• Build scalable data processing solutions using Databricks and PySpark.
• Implement data ingestion from multiple sources including APIs, databases and files.
• Work with Medallion Architecture - Bronze, Silver and Gold layers.
• Perform data transformation using PySpark and SQL.
• Process and manage large-scale datasets.
• Optimize pipeline performance and Databricks workloads.
• Ensure data quality, reliability and maintainability.

Skills

Databricks

PySpark

Python

SQL

Data pipelines

Tools

Databricks

PySpark

SQL

Job description

I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.

This is a hands‑on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.

Key Responsibilities

• Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
• Build scalable data processing solutions using Databricks and PySpark
• Implement data ingestion from multiple sources, including APIs, databases and files
• Work with Medallion Architecture - Bronze, Silver and Gold layers
• Perform data transformation using PySpark and SQL
• Process and manage large-scale datasets
• Optimise pipeline performance and Databricks workloads
• Ensure data quality, reliability and maintainability

Required Skills

• Strong hands‑on experience with Databricks
• Advanced PySpark development
• Strong SQL and data transformation experience
• Experience with data ingestion from APIs, databases, files and other sources
• Experience implementing Medallion Architecture
• Strong understanding of pipeline performance and optimisation
• Strong spoken and written English and Spanish language skills
• Hybrid working environment in Madrid
• Availability to attend the Madrid office on specific days and for important collaborative meetings