Senior / Lead Data Engineer (Databricks)

Bonapolia; Madrid; A distancia; EUR 70.000 - 90.000; Jornada completa

Descripción de la vacante

A leading health and fitness software provider is seeking an experienced Data Architect to support migration to Databricks and design scalable solutions. The ideal candidate has over 8 years of experience, strong skills in data architecture, cloud platforms, and proficiency in Python, PySpark, and SQL. This role offers a chance to work with cutting-edge technologies in a dynamic team environment.

Formación

• 8+ years of professional experience in data architecture and cloud-based data platforms.
• Proven expertise in designing and leading large-scale implementations on Databricks.
• Deep knowledge of data warehousing, lakehouse architecture, and consumption layer design.

Responsabilidades

• Support the migration from Synapse to Databricks across multiple data streams.
• Design and implement scalable data solutions.
• Collaborate with product and business teams to deliver data-driven solutions.

Conocimientos

Data architecture

Cloud-based data platforms

Python

PySpark

SQL

Data warehousing

Power BI

ETL/ELT processes

SCRUM methodologies

Descripción del empleo

About the Client

The health and fitness software and payment processing provider in the United States, Puerto Rico, Canada, and Mexico. Founded in 1981, they currently work with 7,000+ health clubs. Customer offerings include payment processing and gym management solutions that allow managers to track memberships and schedules and automate payment processing functions.

What You’ll Do

• Support the migration from Synapse to Databricks across multiple data streams.
• Design and implement scalable solutions for :
• Initial data load
• Data mart and consumption layer
• Reporting and Power BI integration
• Collaborate with product and business teams to understand requirements and deliver data-driven solutions.
• Optimize data pipelines for performance, scalability, and reliability.
• Ensure best practices in data modeling, ETL / ELT processes, and storage optimization.
• Write unit and integration tests to ensure data quality and consistency.
• Diagnose and resolve issues in data pipelines, performance bottlenecks, and integration points.
• Keep up with evolving technologies in the data engineering and cloud ecosystem, recommending improvements to keep the stack up to date.

What You Bring

• 8+ years of professional experience in data architecture and cloud-based data platforms.
• Proven expertise in designing and leading large-scale implementations on Databricks.
• Deep knowledge of data warehousing, lakehouse architecture, and consumption layer design.
• Strong background in enterprise data modeling, governance, security, and compliance.
• Ability to define reference architectures and best practices for scalable ETL / ELT pipelines.
• Proficiency in Python, PySpark, and SQL with the ability to guide engineering teams on performance optimization.
• Experience integrating analytics and reporting solutions, including Power BI, into enterprise data platforms.
• Demonstrated ability to review, mentor, and elevate the technical capabilities of engineering teams.
• Experience working in agile teams using SCRUM methodologies.
• Strategic mindset with a focus on scalability, cost optimization, and long-term platform evolution.

English : upper-intermediate

Location : EU, Brazil

Ready to Join? We look forward to receiving your application and welcoming you to our team!