Senior Databricks Data Engineer — Hybrid (Lisbon)

SysMatch; Lisboa; Presencial; EUR 35 000 - 45 000; Tempo integral

Resumo da oferta

SysMatch is hiring a Senior Databricks Data Engineer for Lisbon in a hybrid role. You will design, build and maintain scalable data pipelines with Databricks, and optimize ETL/ELT processes for large enterprise workloads.

Design data models, apply Medallion Architecture, and implement Delta Lake and Unity Catalog. You will collaborate with Data Architects, Product Owners and stakeholders in an Agile setting, using Python, PySpark and SQL daily.

Qualificações

• 5+ years of professional Data Engineering experience.
• 3+ years of hands-on Databricks experience.
• Strong Python and PySpark development skills.
• Advanced SQL, including query and performance optimization.
• Strong hands-on experience with Delta Lake.
• Experience implementing Medallion Architecture.
• Hands-on experience with Databricks Unity Catalog.
• Strong experience designing and building scalable ETL/ELT pipelines.
• Solid understanding of data modelling and data warehousing concepts.
• Experience working with large-scale enterprise datasets.
• Experience with Git and CI/CD/DevOps practices.
• Experience working with cloud-based data platforms, preferably AWS.
• Experience working within Agile delivery teams.

Responsabilidades

• Design, build, and maintain scalable data pipelines using Databricks.
• Develop and optimize ETL/ELT processes for large-scale enterprise data workloads.
• Design and implement data models and data products following modern architectural principles.
• Apply Medallion Architecture patterns across data solutions.
• Work with structured, semi-structured, and streaming data sources.
• Develop data processing solutions using Python, PySpark, and SQL.
• Design and optimize solutions using Delta Lake.
• Implement data governance and access management using Databricks Unity Catalog.
• Support Data Quality, metadata management, lineage, and governance initiatives.
• Collaborate closely with Data Architects, Product Owners, Data Governance teams, and business stakeholders.
• Contribute to automated testing, CI/CD, and deployment processes.

Conhecimentos

Databricks

Python

PySpark

SQL

Delta Lake

Medallion Architecture

Data Modeling

CI/CD

Git

AWS

Agile

Ferramentas

Databricks Unity Catalog

Databricks Workflows

Descrição da oferta de emprego

SysMatch is hiring a Senior Databricks Data Engineer for Lisbon in a hybrid role. You will design, build and maintain scalable data pipelines with Databricks, and optimize ETL/ELT processes for large enterprise workloads.

Design data models, apply Medallion Architecture, and implement Delta Lake and Unity Catalog. You will collaborate with Data Architects, Product Owners and stakeholders in an Agile setting, using Python, PySpark and SQL daily.