Senior Data Engineer - Databricks (m/f/*)

Ultra Tendency; España; Remote; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Remote or hybrid options

Job summary

Ultra Tendency is seeking a Senior Data Engineer to design, implement and optimize data pipelines on the Databricks Lakehouse Platform in Spain. You’ll work with Spark, Delta Lake and MLflow to deliver production-grade solutions across analytics and ML use cases.

You’ll collaborate with data scientists, architects and business stakeholders, mentor juniors, and help shape best practices for data quality, governance and security in a fast-growing, learning-driven environment.

Qualifications

• Deep hands-on experience with Databricks on Azure, AWS or GCP.
• Experience with Spark (PySpark/Scala), Delta Lake and MLflow.
• Strong programming skills in Python or Scala and CI/CD pipelines.

Responsibilities

• Design, implement, and maintain scalable data pipelines using Databricks Lakehouse Platform with Spark, Delta Lake and Unity Catalog.
• Lead development of batch and streaming data workflows powering analytics, ML and BI use cases.
• Collaborate with data scientists, architects and stakeholders to translate complex data requirements into robust solutions.
• Optimize performance and cost-efficiency of Databricks clusters and jobs using Photon, Auto Loader and Job Workflows.
• Establish and enforce best practices for data quality, governance and security in Databricks environments.
• Mentor junior engineers and contribute to the team’s Databricks expertise.

Skills

Databricks

Apache Spark

Python

Scala

Delta Lake

MLflow

GitHub Actions

Azure DevOps

Airflow

Terraform

Data modeling

Distributed computing

Performance tuning

Databricks Workflows

Spanish & English communication

Tools

Databricks on Azure/AWS/GCP

Job description

Our Engineering community is growing, and we’re now looking for a Senior Data Engineer - Databricks (m/f/*) to join our team in Spain, supporting our global growth.

As Senior Data Engineer (m/f/*), you design and optimize data processing algorithms on a talented, cross‑functional team. You are familiar with the Apache open-source suite of technologies and want to contribute to the advancement of data engineering.

WHAT WE OFFER

• Flexible work options, including fully remote or hybrid arrangements (candidates must be located in Spain)
• A chance to accelerate your career and work with outstanding colleagues in a supportive learning community split across 3 continents
• Contribute your ideas to our unique projects and make an impact by turning them into reality
• Balance your work and personal life through our workflow organization and decide yourself if you workat home, in the office, or on a hybrid setup
• Annual performance review, and regular feedback cycles, generating distinct value by connecting colleagues through networks rather than hierarchies
• Individual development plan, professional development opportunities
• Educational resources such as paid certifications, unlimited access to Udemy Business, etc.
• Local, virtual, and global team events, in which UT colleagues become acquainted with one another

WHAT YOU’LL DO

• Design, implement, and maintain scalable data pipelines using Databricks Lakehouse Platform, with a strong focus on Apache Spark, Delta Lake, and Unity Catalog.
• Lead the development of batch and streaming data workflows that power analytics, machine learning, and business intelligence use cases.
• Collaborate with data scientists, architects, and business stakeholders to translate complex data requirements into robust, production-grade solutions.
• Optimize performance and cost‑efficiency of Databricks clusters and jobs, leveraging tools like Photon, Auto Loader, and Job Workflows.
• Establish and enforce best practices for data quality, governance, and security within the Databricks environment.
• Mentor junior engineers and contribute to the evolution of the team’s Databricks expertise.

WHAT YOU’LL BRING

• Deep hands‑on experience with Databricks on Azure, AWS, or GCP, including Spark (PySpark/Scala), Delta Lake, and MLflow.
• Strong programming skills in Python or Scala, and experience with CI/CD pipelines (e.g., GitHub Actions, Azure DevOps).
• Solid understanding of distributed computing, data modeling, and performance tuning in cloud‑native environments.
• Familiarity with orchestration tools (e.g., Databricks Workflows, Airflow) and infrastructure‑as‑code (e.g., Terraform).
• A proactive mindset, strong communication skills, and a passion for building scalable, reliable data systems.
• Professional Spanish & English communication skills (C1-level, written and spoken).

ABOUT US

Ultra Tendency is a leading international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. We design, build, and operate large‑scale, data‑driven applications for major enterprises including the European Central Bank, HUK‑Coburg, Deutsche Telekom, and Europe’s largest car manufacturer. Founded in Germany in 2010, Ultra Tendency has grown to 8 offices across 10 countries on 3 continents, serving a trusted and expanding client base.

We don’t just use technology—we create it. Our team contributes to over 20 open‑source projects, including Ansible, Terraform, NiFi, and Kafka, making a visible impact on both technology and business. Enterprises choose Ultra Tendency because we solve the problems others cannot.

We thrive on challenges. Here, you’ll work on unique projects you won’t find elsewhere and become part of a knowledge‑driven, supportive community—not a rigid hierarchy. Continuous learning, feedback, and collaboration drive both personal and professional growth, while maintaining a healthy work‑life balance.

Ultra Tendency evaluates applications based on skills and business fit. We welcome candidates from all backgrounds, regardless of race, ethnicity, national or social origin, disability, sex, sexual orientation, or age.

Data privacy statement: Data Protection for Applicants – Ultra Tendency