Databricks Data Engineer — Hybrid Madrid (PySpark/Python)

Square One Resources Limited; Madrid; Hybrid; EUR 51,000 - 55,000; Full time

Job summary

Square One Resources Limited is seeking a Databricks Data Engineer to join a Madrid data-focused team in a hands-on role. The position requires strong Databricks, PySpark and Python skills and the ability to design, build and optimise scalable data pipelines.

This hybrid role is based in Madrid with an initial 6-month contract and day rate of €275-€300. The ideal candidate will handle ingestion from APIs, databases and files and work with Medallion Architecture across Bronze, Silver and Gold

Qualifications

• Hands-on Databricks engineer with PySpark and Python.
• Experience building end-to-end data pipelines from source systems to Gold layer.
• Experience with Medallion Architecture (Bronze/Silver/Gold).
• Strong data ingestion from APIs, databases and files.
• Excellent communication in English and Spanish.

Responsibilities

• Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
• Build scalable data processing solutions using Databricks and PySpark
• Develop robust Python-based data engineering solutions
• Implement data ingestion from multiple sources, including APIs, databases and files
• Work with Medallion Architecture - Bronze, Silver and Gold layers
• Perform data transformation using PySpark and SQL
• Process and manage large-scale datasets
• Optimise pipeline performance and Databricks workloads
• Ensure data quality, reliability and maintainability

Skills

Databricks

PySpark

Python

SQL

Data pipelines

Data ingestion

Medallion Architecture

Big data processing

Performance optimization

English

Spanish

Job description

Square One Resources Limited is seeking a Databricks Data Engineer to join a Madrid data-focused team in a hands-on role. The position requires strong Databricks, PySpark and Python skills and the ability to design, build and optimise scalable data pipelines.

This hybrid role is based in Madrid with an initial 6-month contract and day rate of €275-€300. The ideal candidate will handle ingestion from APIs, databases and files and work with Medallion Architecture across Bronze, Silver and Gold