Data Engineer (DataBricks)

LUZA Group; Lisboa; Presencial; EUR 42 000 - 68 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Remote work wherever possible

Equipment delivery

Benefits plan

Resumo da oferta

Syffer is seeking a Data Engineer to develop data pipelines and implement governance and modeling in a hybrid work model. You'll work with PySpark, Python, SQL Server, and T-SQL to build robust data solutions and ensure quality across pipelines.

You will collaborate with teams on data ingestion, transformation, and automation, applying Unity Catalog governance, and leveraging AI-assisted coding tools as part of the workflow.

Qualificações

• 2+ years of experience in Data Engineering.
• Hands-on experience with Azure Databricks in production environments.
• Proficiency in Python for data engineering, including data ingestion, automation, file processing, and API/database integration.
• Experience with SQL Server and T-SQL, including query development, stored procedures, and basic data modeling.

Responsabilidades

• Develop data ingestion, transformation, and automation pipelines using PySpark and Python.
• Apply data governance policies in Unity Catalog, including dataset ownership, data lineage, and tagging.
• Design and implement data models and transformations in SQL Server and T-SQL, including stored procedures.
• Follow established development standards, including branching strategies, coding conventions, code reviews, and CI/CD practices.
• Implement data quality validations and testing across data pipelines.
• Regularly use AI-powered coding assistants as part of the development workflow.

Conhecimentos

Data engineering

Python

Data ingestion

SQL

Ferramentas

Azure Databricks

SQL Server

T-SQL

Unity Catalog

Azure Data Factory

Descrição da oferta de emprego

Syffer is an all-inclusive consulting company focused on talent, tech and innovation. We exist to elevate companies and humans all around the world, making change, from the inside to the outside.

We believe that technology + human kindness positively impacts every community around the world. Our approach is simple, we see a world without borders, and believe in equal opportunities. We are guided by our core principles of spreading positivity, good energy and promote equality and care for others.

Our hiring process is unique! People are selected by their value, education, talent and personality. We dont present ethnicity, religion, national origin, age, gender, sexual orientation or identity.

Its time to burst the bubble, and we will do it together!

What You'll do:

• Develop data ingestion, transformation, and automation pipelines using PySpark and Python;
• Apply data governance policies in Unity Catalog, including dataset ownership, data lineage, and tagging;
• Design and implement data models and transformations in SQL Server and T-SQL, including stored procedures;
• Follow established development standards, including branching strategies, coding conventions, code reviews, and CI/CD practices;
• Implement data quality validations and testing across data pipelines;
• Regularly use AI-powered coding assistants as part of the development workflow;
• Hybrid Work Model;

Who You Are:

• 2+ years of experience in Data Engineering;
• Hands-on experience with Azure Databricks in production environments;
• Proficiency in Python for data engineering, including data ingestion, automation, file processing, and integration with APIs and databases;
• Experience with SQL Server and T-SQL, including query development, stored procedures, and basic data modeling;

Nice to have (strong preference):

• Experience with Unity Catalog;
• Experience with Azure Data Factory or other Azure-based orchestration tools;
• Experience in the Utilities sector;

What you'll get:

• Wage according to candidate's professional experience;
• Remote Work whenever possible;
• Delivery of work equipment adjusted to the performance of functions;
• Benefits plan;
• And others.

Work together with expert teams on projects of large magnitude and intensity, long term together with our clients, all leaders in their industries.

Are you ready to step into a diverse and inclusive world with us?

Together we will promote uniquess!