Senior Data Engineer - Databricks & Spark (Remote in Spain)

Ultra Tendency; Madrid; Presencial; EUR 70.000 - 110.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote/hybrid flexibility

Career growth

Impactful projects

Work-life balance

Annual performance reviews

Udemy access

Global team events

Descripción de la vacante

Ultra Tendency is seeking a Senior Data Engineer to design and maintain scalable data pipelines on the Databricks Lakehouse Platform, with a strong focus on Spark, Delta Lake, and Unity Catalog. The role supports our growth across Europe and beyond, requiring advanced Python/Scala skills and cloud experience.

You will collaborate with data scientists, architects, and stakeholders to deliver production-grade data solutions while mentoring junior engineers and driving data governance best

Formación

• Experience designing scalable data pipelines on Databricks Lakehouse.
• Proficiency with Spark (PySpark/Scala) and Delta Lake.
• Strong Python or Scala programming and CI/CD exposure.
• Experience with cloud platforms (Azure/AWS/GCP) and Databricks.
• Excellent collaboration with data scientists and stakeholders.

Responsabilidades

• Design, implement, and maintain scalable data pipelines using Databricks Lakehouse Platform.
• Lead batch and streaming data workflows powering analytics, ML, BI use cases.
• Collaborate with data scientists, architects, and business stakeholders to translate data requirements into production solutions.
• Optimize performance and cost-efficiency of Databricks clusters and jobs, using Photon, Auto Loader, and Job Workflows.
• Establish best practices for data quality, governance, and security within Databricks environment.
• Mentor junior engineers and evolve the team's Databricks expertise.

Conocimientos

Python

Scala

Distributed computing

Data modeling

Communication skills

Multilingual Spanish/French/English

Herramientas

Databricks

Azure

AWS

GCP

Spark

Delta Lake

MLflow

GitHub Actions

Azure DevOps

Airflow

Terraform

Photon

Auto Loader

Job Workflows

Descripción del empleo

Ultra Tendency is seeking a Senior Data Engineer to design and maintain scalable data pipelines on the Databricks Lakehouse Platform, with a strong focus on Spark, Delta Lake, and Unity Catalog. The role supports our growth across Europe and beyond, requiring advanced Python/Scala skills and cloud experience.

You will collaborate with data scientists, architects, and stakeholders to deliver production-grade data solutions while mentoring junior engineers and driving data governance best