Senior Databricks Engineer, Madrid (on-site) – International client

TheWhiteam; Tres Cantos; On-site; EUR 40,000 - 50,000; Full time

Job summary

TheWhiteam is seeking a Senior Databricks Engineer located in Tres Cantos, Spain. The ideal candidate will have expertise in Azure Databricks and Apache Spark, with 6-10 years of experience in designing and maintaining data pipelines.

This role involves collaborative work with stakeholders to understand requirements, ensuring high-quality data solutions. The position requires a good command of English (C1) and offers a salary between €40,000 and €50,000 per annum.

Qualifications

• 6-10 years of experience in data engineering.
• Proficient in programming with Python or Scala for data processing.
• Strong understanding of cloud-based architectures.

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks.
• Implement processes to ensure data accuracy.
• Work with data owners to understand requirements.

Skills

Azure Databricks

Apache Spark

Python

Scala

SQL

Datafactory

ETL processes

Tools

Databricks-specific tools

Azure cloud platform

Unity Catalog

Job description

Job role: Senior Databricks Engineer.
Required technical skill set: Azure Databricks + Apache Spark.
Minimum experience: 6-10 years.
Language: English (C1) MANDATORY.
Location: Madrid (first 3-6 months on-site).

We are looking for a talented Senior Databricks Engineer with strong expertise in Azure Databricks and Apache Spark to design, build, and maintain scalable data pipelines. In this role, you will work with diverse data sources to deliver reliable, high‑quality data solutions, ensuring data accuracy, integrity, and performance. You will collaborate closely with stakeholders, including data owners and analysts, to understand business requirements and implement efficient data processing solutions, while proactively monitoring and optimizing data pipelines within a cloud‑based environment.

Technical competences

Must have

• Experience with Databricks‑specific tools and features.
• Experience with Datafactory.
• Proficiency in programming languages such as Python or Scala for data processing on Databricks.
• Experience with Azure cloud platform.
• Strong understanding of SQL.
• Experience with ETL and processes, Unity Catalog.

Good‑to‑have

• Certifications in Databricks or related cloud technologies.

Responsibilities

• Design, build, and maintain scalable and efficient data pipelines using Databricks. Integrate data from various sources (for example, Azure storage account, SFTP, Fabric) using Apache Spark within Databricks.
• Implement processes and checks to ensure the accuracy and completeness of data.
• Work closely with data owners, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Monitor data pipelines for issues and resolve them promptly to maintain data flow integrity.

Language

English (C1) MANDATORY.

Location

Madrid (first 3-6 months on-site).

Salary

40.000-50.000€ SBA.