Databricks Data Engineer: Pipelines & Lakehouse Builder

Hp Scds; León; On-site; EUR 45,000 - 65,000; Full time

Job summary

Hp Scds is looking for a Data Engineer to develop data pipelines and support the migration of data from HP business systems into a Federated Data Lake on Databricks. You will build ingestion and transformation pipelines using Python and SQL, integrating data from enterprise sources and validating results.

The role is hands-on, collaborative, and great for someone who wants to grow Databricks expertise while helping modernize HP's data landscape and empower analytics and reporting across the

Qualifications

• Hands-on experience with Databricks and Python.
• Strong SQL skills and ETL/ELT pipeline knowledge.
• Understanding of Data Lake and Lakehouse concepts.
• Familiarity with Git and collaborative development practices.
• Ability to deliver well-defined tasks independently and collaborate on complex challenges.

Responsibilities

• Build and maintain data ingestion and transformation pipelines in Databricks.
• Develop data processing solutions using Python and SQL.
• Integrate data from enterprise systems, APIs, databases and files.
• Validate migrated datasets and troubleshoot data quality and pipeline issues.
• Collaborate with data engineers, application developers and business stakeholders.

Skills

Databricks experience

Python

SQL

ETL/ELT pipelines

Git

Tools

Delta Lake

CI/CD

Job description

Hp Scds is looking for a Data Engineer to develop data pipelines and support the migration of data from HP business systems into a Federated Data Lake on Databricks. You will build ingestion and transformation pipelines using Python and SQL, integrating data from enterprise sources and validating results.

The role is hands-on, collaborative, and great for someone who wants to grow Databricks expertise while helping modernize HP's data landscape and empower analytics and reporting across the