Senior Databricks Data Engineer - Hybrid (Lisbon)

Sysmatch; Lisboa; Híbrido; EUR 35 000 - 45 000; Tempo integral

Resumo da oferta

Sysmatch in Lisbon is seeking a Senior Databricks Data Engineer to design, build, and maintain scalable data pipelines and data products in a hybrid work setup. You will collaborate with Data Architects, Product Owners, and governance teams to deliver enterprise-grade solutions.

You will use Databricks, Python, PySpark, and SQL to implement Delta Lake architectures, Medallion patterns, and Unity Catalog with strong emphasis on data quality, governance, and cost efficiency.

Qualificações

• 5+ years of professional Data Engineering experience.
• 3+ years of hands-on Databricks experience.
• Strong Python and PySpark development skills.
• Advanced SQL, including query and performance optimization.
• Strong hands-on experience with Delta Lake.
• Experience implementing Medallion Architecture.
• Hands-on experience with Databricks Unity Catalog.
• Strong experience designing and building scalable ETL/ELT pipelines.
• Solid understanding of data modelling and data warehousing concepts.
• Experience working with Git and CI/CD/DevOps practices.
• Experience working with cloud-based data platforms, preferably AWS.
• Experience working within Agile delivery teams.
• Ability to independently design and implement Data Engineering solutions.

Responsabilidades

• Design, build, and maintain scalable data pipelines using Databricks.
• Develop and optimize ETL/ELT processes for large-scale enterprise data workloads.
• Design and implement data models and data products following modern architectural principles.
• Apply Medallion Architecture patterns across data solutions.
• Work with structured, semi-structured, and streaming data sources.
• Develop data processing solutions using Python, PySpark, and SQL.
• Design and optimize solutions using Delta Lake.
• Implement data governance and access management using Databricks Unity Catalog.
• Support Data Quality, metadata management, lineage, and governance initiatives.
• Optimize data processing for performance, scalability, reliability, and cost efficiency.
• Contribute to automated testing, CI/CD, and deployment processes.
• Collaborate closely with Data Architects, Product Owners, Data Governance teams, and business stakeholders.
• Contribute to the design and evolution of enterprise data products.

Conhecimentos

Databricks

Python

PySpark

SQL

Delta Lake

Medallion Architecture

Unity Catalog

ETL/ELT pipelines

Data modelling

Data warehousing

Git & CI/CD

AWS

Agile

Descrição da oferta de emprego

Sysmatch in Lisbon is seeking a Senior Databricks Data Engineer to design, build, and maintain scalable data pipelines and data products in a hybrid work setup. You will collaborate with Data Architects, Product Owners, and governance teams to deliver enterprise-grade solutions.

You will use Databricks, Python, PySpark, and SQL to implement Delta Lake architectures, Medallion patterns, and Unity Catalog with strong emphasis on data quality, governance, and cost efficiency.