DataBricks Engineer

JobServe Ltd; Madrid; Híbrido; EUR 51.000 - 55.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid work environment in Madrid

Descripción de la vacante

Square One is seeking a Databricks Data Engineer in Madrid, offering a hybrid work setup. The role focuses on building and optimising data pipelines using Databricks, PySpark and Python, delivering robust data solutions and handling data from multiple sources.

You will work with the Medallion Architecture (Bronze/Silver/Gold) and require strong SQL, data transformation and English/Spanish communication skills. Initial 6-month engagement with a day-rate model applies.

Formación

• Hands-on Databricks, PySpark and Python experience required.
• Proven ability to build end-to-end data pipelines.
• Experience with data ingestion from APIs, databases and files.
• Knowledge of Medallion Architecture (Bronze/Silver/Gold).
• Strong SQL and data transformation skills.
• Excellent English and Spanish communication.

Responsabilidades

• Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
• Build scalable data processing solutions using Databricks and PySpark
• Develop robust Python-based data engineering solutions
• Implement data ingestion from multiple sources, including APIs, databases and files
• Work with Medallion Architecture - Bronze, Silver and Gold layers
• Perform data transformation using PySpark and SQL
• Process and manage large-scale datasets
• Optimise pipeline performance and Databricks workloads
• Ensure data quality, reliability and maintainability

Conocimientos

Databricks

PySpark

Python

SQL

End-to-end pipelines

Data ingestion

Medallion Architecture

Large-scale data processing

Pipeline optimisation

English and Spanish

Descripción del empleo

Databricks Data Engineer

Location: Madrid, Spain - Hybrid
Contract: Initial 6 months
Day Rate: €275-€300 per day

I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.

This is a hands-on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.

Key Responsibilities

• Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
• Build scalable data processing solutions using Databricks and PySpark
• Develop robust Python-based data engineering solutions
• Implement data ingestion from multiple sources, including APIs, databases and files
• Work with Medallion Architecture - Bronze, Silver and Gold layers
• Perform data transformation using PySpark and SQL
• Process and manage large-scale datasets
• Optimise pipeline performance and Databricks workloads
• Ensure data quality, reliability and maintainability

Required Skills

• Strong hands-on experience with Databricks
• Advanced PySpark development
• Strong Python programming skills
• Strong SQL and data transformation experience
• Proven experience building end-to-end data pipelines
• Experience with data ingestion from APIs, databases, files and other sources
• Experience implementing Medallion Architecture
• Experience handling large-scale data processing
• Strong understanding of pipeline performance and optimisation
• Strong spoken and written English and Spanish language skills

Working Environment

• Hybrid working environment in Madrid
• Availability to attend the Madrid office on specific days and for important collaborative meetings

The Ideal Profile

The client is specifically looking for a hands-on Data Engineer who is comfortable writing PySpark and Python code and can independently implement pipelines from source systems through to the Gold layer.

Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.