Databricks Data Engineer — Remote & AI-Driven Pipelines

LUZA Group; Lisboa; Híbrido; EUR 42 000 - 68 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Remote work wherever possible

Equipment delivery

Benefits plan

Resumo da oferta

Syffer is seeking a Data Engineer to develop data pipelines and implement governance and modeling in a hybrid work model. You'll work with PySpark, Python, SQL Server, and T-SQL to build robust data solutions and ensure quality across pipelines.

You will collaborate with teams on data ingestion, transformation, and automation, applying Unity Catalog governance, and leveraging AI-assisted coding tools as part of the workflow.

Qualificações

• 2+ years of experience in Data Engineering.
• Hands-on experience with Azure Databricks in production environments.
• Proficiency in Python for data engineering, including data ingestion, automation, file processing, and API/database integration.
• Experience with SQL Server and T-SQL, including query development, stored procedures, and basic data modeling.

Responsabilidades

• Develop data ingestion, transformation, and automation pipelines using PySpark and Python.
• Apply data governance policies in Unity Catalog, including dataset ownership, data lineage, and tagging.
• Design and implement data models and transformations in SQL Server and T-SQL, including stored procedures.
• Follow established development standards, including branching strategies, coding conventions, code reviews, and CI/CD practices.
• Implement data quality validations and testing across data pipelines.
• Regularly use AI-powered coding assistants as part of the development workflow.

Conhecimentos

Data engineering

Python

Data ingestion

SQL

Ferramentas

Azure Databricks

SQL Server

T-SQL

Unity Catalog

Azure Data Factory

Descrição da oferta de emprego

Syffer is seeking a Data Engineer to develop data pipelines and implement governance and modeling in a hybrid work model. You'll work with PySpark, Python, SQL Server, and T-SQL to build robust data solutions and ensure quality across pipelines.

You will collaborate with teams on data ingestion, transformation, and automation, applying Unity Catalog governance, and leveraging AI-assisted coding tools as part of the workflow.