Data Engineer - Databricks & Treasury Data Lake

Set Europa

Madrid

Remote

EUR 75,000 - 119,000

Part time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Set Europa is seeking an experienced Data Engineer specializing in Databricks and Treasury Data Lake environments to join a fully remote project.

You will design, develop, maintain and optimize end-to-end data pipelines within a modern Lakehouse architecture, applying DBT, advanced SQL and enterprise data integration. The role also emphasizes data governance and automated CI/CD practices.

Qualifications

  • Proven professional experience as a Data Engineer in enterprise data environments.
  • Strong hands-on Databricks and modern Lakehouse architecture.
  • Experience with DBT (Data Build Tool) for transformations.
  • Advanced SQL skills with complex transformations and performance tuning.
  • Experience CI/CD processes with GitHub and Azure DevOps.
  • Understanding of data governance and enterprise data integration.

Responsibilities

  • Design, build, and maintain end-to-end data ingestion pipelines.
  • Develop transformations across bronze, silver, and gold in a Lakehouse.
  • Implement automated data quality controls, monitoring, and alerting.
  • Design data models and transformations using DBT and SQL.
  • Leverage Lakehouse Federation and Lakeflow Connect for data integration.
  • Develop and maintain CI/CD pipelines using GitHub and Azure DevOps.
  • Identify and resolve performance bottlenecks to improve scalability.
  • Collaborate with stakeholders to translate requirements into data solutions.
  • Support data governance, documentation, and release management.

Skills

Databricks
DBT (Data Build Tool)
SQL
Data Pipelines
Data Lakehouse
CI/CD
GitHub
Azure DevOps
Data Governance
Lakehouse Federation

Tools

Lakeflow Connect

Job description

Location: Remote (Freelance)

Project Duration: 6-12 months

THE COMPANY

Our client is a recruitment consultancy specialising in IT, Finance, HR, and Digital Technology. Our client is seeking an experienced Data Engineer specializing in Databricks and Treasury Data Lake environments to join a fully remote project.

The successful candidate will be responsible for designing, developing, maintaining, and optimizing end-to-end data pipelines within a modern Lakehouse architecture, ensuring reliable, scalable, and high-performance data solutions. This role requires strong hands-on experience with Databricks, DBT, advanced SQL, and enterprise data integration, alongside a solid understanding of data governance, automation, and CI/CD practices.

RESPONSIBILITIES
  • Design, build, and maintain end-to-end data ingestion pipelines integrating multiple source systems.
  • Develop and optimize data transformations across bronze, silver, and gold layers within a Databricks Lakehouse architecture.
  • Implement automated data quality controls, monitoring frameworks, and alerting mechanisms to ensure data integrity and reliability.
  • Design and maintain data models and transformation logic using DBT and advanced SQL.
  • Leverage Databricks Lakehouse Federation and Lakeflow Connect to support efficient data integration and accessibility.
  • Develop and maintain CI/CD pipelines using GitHub and Azure DevOps, ensuring controlled deployments, testing, and version management.
  • Identify and resolve performance bottlenecks, improving scalability, maintainability, and efficiency.
  • Collaborate with business and technical stakeholders to translate requirements into robust data engineering solutions.
  • Support data governance standards, documentation, troubleshooting, and release management activities.
  • Contribute to analytics and reporting capabilities by delivering reliable, high-quality data products.
REQUIREMENTS
  • Proven professional experience as a Data Engineer in enterprise data environments.
  • Strong hands-on expertise with Databricks and modern Data Lake/Lakehouse architecture.
  • Practical experience developing data transformations using DBT (Data Build Tool).
  • Advanced SQL skills, including query optimization and complex data transformations.
  • Experience designing and managing data pipelines across bronze, silver, and gold layers.
  • Knowledge of Databricks Lakehouse Federation and Lakeflow Connect.
  • Experience implementing data quality frameworks, monitoring, and automated alerting.
  • Familiarity with GitHub, Azure DevOps, and CI/CD processes.
  • Understanding of data governance, data modeling, and enterprise integration practices.
  • Knowledge of artificial intelligence-related concepts and their application within modern data ecosystems.
  • Strong analytical, troubleshooting, documentation, and communication skills.
  • Ability to work independently and collaborate effectively with distributed teams.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer- Databricks & Treasury Data Lake
Data Engineer- Databricks & Treasury Data Lake

Set Europa • Málaga

Remote
EUR 55,000 - 85,000
Databricks Data Architect
Databricks Data Architect

Set Europa • Spain

Remote
EUR 90,000 - 120,000
Databricks Data Architect
Databricks Data Architect

Set Europa • Burgos

Remote
EUR 90,000 - 130,000
Health insurance
Remote work flexibility
Data Engineer (Databricks & Treasury Data Lake), Remote (EU) – International Client
Data Engineer (Databricks & Treasury Data Lake), Remote (EU) – International Client

TheWhiteam • Spain

Remote
EUR 48,000 - 63,000
Remote Data Engineer - Treasury Data Lake & Databricks
Remote Data Engineer - Treasury Data Lake & Databricks

Set Europa • Madrid

Remote
EUR 75,000 - 119,000
Databricks Data Engineer - Lakehouse & DBT Specialist
Databricks Data Engineer - Lakehouse & DBT Specialist

Set Europa • Málaga

Remote
EUR 55,000 - 85,000
Senior Data Architect
Senior Data Architect

Sowelo Consulting sp. z o.o. • Spain

Remote
EUR 90,000 - 130,000
Remote in Spain
Flexible hours
B2B contract
Senior Data Engineer
Senior Data Engineer

Intellias • Spain

Remote
EUR 90,000 - 140,000
Senior Databricks Administrator/Architect
Senior Databricks Administrator/Architect

EUROPEAN DYNAMICS • Spain

Remote
EUR 90,000 - 120,000
Databricks Data Lake Engineer - Treasury Focus (Remote EU)
Databricks Data Lake Engineer - Treasury Focus (Remote EU)

Thewhiteam • Spain

Remote
EUR 48,000 - 63,000