Senior Databricks Data Engineer (M/F/*)

Ultra Tendency; Madrid; Híbrido; EUR 90.000 - 120.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid/Remote work options

Certifications paid for

Udemy Business access

Global team events

Descripción de la vacante

Ultra Tendency is seeking a Senior Databricks Data Engineer to design and optimize scalable data pipelines on cloud platforms, collaborating with data scientists and architects to power analytics and ML use cases.

You will mentor junior engineers, establish data quality and governance practices, and drive cost-efficient Databricks environments across Azure, AWS, or GCP. The role supports a hybrid work arrangement across global teams.

Formación

• Experience with Databricks on cloud platforms (Azure/AWS/GCP).
• Strong programming skills in Python or Scala.
• Familiar with CI/CD pipelines and DevOps practices.
• Knowledge of distributed computing and data modeling.

Responsabilidades

• Design, implement, and maintain scalable data pipelines on Databricks Lakehouse Platform.
• Lead batch and streaming workflows powering analytics and ML use cases.
• Collaborate with data scientists, architects, and stakeholders to translate data requirements into production solutions.
• Optimize Databricks clusters for performance and cost.

Conocimientos

Databricks

Spark

Delta Lake

MLflow

Python/Scala

CI/CD

Herramientas

Databricks Workflows

Airflow

Terraform

Descripción del empleo

Our Engineering community is growing, and we're now looking for a Senior Databricks Data Engineer to join our team supporting our global growth.

Senior Databricks Data Engineer

You design and optimize data processing algorithms on a talented, cross-functional team. You are familiar with the Apache open-source suite of technologies and want to contribute to the advancement of data engineering.

What We Offer

• A chance to accelerate your career and work with outstanding colleagues in a supportive learning community split across 3 continents
• Contribute your ideas to our unique projects and make an impact by turning them into reality
• Balance your work and personal life through our workflow organization and decide yourself if you work at home, in the office, or on a hybrid setup
• Annual performance review, and regular feedback cycles, generating distinct value by connecting colleagues through networks rather than hierarchies
• Individual development plan, professional development opportunities
• Educational resources such as paid certifications, unlimited access to Udemy Business, etc.
• Local, virtual, and global team events, in which UT colleagues become acquainted with one another

What You'll Do

• Design, implement, and maintain scalable data pipelines using Databricks Lakehouse Platform,
• with a strong focus on Apache Spark, Delta Lake,
• and Unity Catalog
• Lead the development of batch and streaming data workflows that power analytics, machine learning, and business intelligence use cases.
• Collaborate with data scientists, architects, and business stakeholders to translate complex data requirements into robust, production-grade solutions.
• Optimize performance and cost-efficiency of Databricks clusters and jobs, leveraging tools like Photon, Auto Loader,
• and Job Workflows
• Establish and enforce best practices for data quality, governance, and security within the Databricks environment.
• Mentor junior engineers and contribute to the evolution of the team's Databricks expertise.

What You'll Bring

• Deep hands‑on experience with Databricks on Azure, AWS, or GCP, including Spark (PySpark/Scala), Delta Lake, and MLflow.
• Strong programming skills in Python or Scala, and experience with CI/CD pipelines (e.g., GitHub Actions, Azure DevOps).
• Solid understanding of distributed computing, data modeling, and performance tuning in cloud-native environments.
• Familiarity with orchestration tools (e.g., Databricks Workflows, Airflow) and infrastructure-as-code (e.g., Terraform).
• A proactive mindset, strong communication skills, and a passion for building scalable, reliable data systems.
• Professional communications skills in English

About Us

Ultra Tendency is an international premier Data Engineering consultancy for Big Data, Cloud, Streaming, IIoT and Microservices

• We design, build, and operate large‑scale data‑driven applications for major enterprises such as the European Central Bank, HUK‑Coburg, Deutsche Telekom, and Europe's largest car manufacturer. Founded in Germany in ****, UT has developed a reliable client base and now runs 8 branches in 7 countries across 3 continents.

We do more than just leverage tech, we build it. At Ultra Tendency we contribute source code to +20 open‑source projects including Ansible, Terraform, NiFi, and Kafka

• Our impact on tech and business is there for anyone to see. Enterprises seek out Ultra Tendency because we solve the problems others cannot.

We love the challenge: together, we tackle diverse and unique projects you will find nowhere else. In our knowledge community, you will be a part of a supportive network, not a hierarchy. Constant learning and feedback are our drivers for stable development. With us you can develop your individual career through work‑life balance.

We evaluate your application based on your skills and corresponding business requirements. Ultra Tendency welcomes applications from qualified candidates regardless of race, ethnicity, national or social origin, disability, sex, sexual orientation, or age.

Data Privacy Statement

Data Protection for Applicants - Ultra Tendency