Senior Databricks Data Engineer - PySpark/SQL, Remote

HumanIT Digital Consulting; Lisboa; Remote; EUR 26,000 - 34,000; Full time

Benefits offered by this job

15th month salary

Health insurance for family

Birthday off

Mobility program for digital nomads

Work-life balance

Job summary

HumanIT Digital Consulting is seeking a Senior Data Engineer to design and maintain Databricks-based data pipelines. You will work on a Lakehouse platform, implementing Bronze/Silver/Gold layers and integrating data from enterprise systems and APIs.

The role emphasizes PySpark, SQL development, data governance, and collaboration with Data Architects and BI teams. Remote work from Portugal or Spain is available in an international setting.

Qualifications

• 4+ years of professional Data Engineering experience.
• 2+ years of hands-on Databricks development experience.
• Strong practical Databricks and PySpark skills for building and maintaining data processing pipelines.
• Strong SQL development and optimisation skills.
• Experience with Azure Data Platform services.
• Proven experience designing and implementing ETL/ELT pipelines.
• Understanding of Lakehouse architecture and Medallion Architecture (Bronze, Silver, Gold).
• Experience integrating data from multiple enterprise systems, APIs and external sources.
• Knowledge of data quality, pipeline reliability, performance optimisation and data security principles.
• Experience using Git and CI/CD practices in data engineering workflows.
• Ability to collaborate with Data Architects, BI/Analytics teams and business stakeholders.
• Professional working proficiency in English.
• Availability to work remotely from Portugal or Spain.

Responsibilities

• Design, develop and maintain scalable data ingestion and transformation pipelines on a Databricks-based Lakehouse platform.
• Implement Bronze, Silver and Gold data layers and integrate data from enterprise systems and external sources.
• Develop processing workflows using PySpark and SQL and optimise pipelines for scalability and cost efficiency.
• Translate architecture standards into practical engineering solutions and reusable frameworks.
• Support data governance, lineage, cataloguing and access management, enabling BI/Analytics teams to consume trusted data.
• Participate in Agile ceremonies and contribute to delivery with Git-based version control and CI/CD practices.

Skills

Data Engineering

Databricks

PySpark

SQL

Azure Data Platform

ETL/ELT pipelines

Lakehouse

Medallion Architecture

Git

CI/CD

English

Remote collaboration

Tools

Delta Live Tables

Unity Catalog

Microsoft Fabric

Git

Job description

HumanIT Digital Consulting is seeking a Senior Data Engineer to design and maintain Databricks-based data pipelines. You will work on a Lakehouse platform, implementing Bronze/Silver/Gold layers and integrating data from enterprise systems and APIs.

The role emphasizes PySpark, SQL development, data governance, and collaboration with Data Architects and BI teams. Remote work from Portugal or Spain is available in an international setting.