Databricks Data Engineer: Scale Cloud Data Pipelines

UTI-Group; Leiria; Presencial; EUR 45 000 - 60 000; Tempo integral

Resumo da oferta

A leading IT services company in Portugal is looking for a Data Engineer specialized in Databricks. In this role, you will join a collaborative environment focused on developing and evolving a large-scale Data Platform. Candidates should have strong experience in data engineering, cloud environments, and modern data pipelines. You will be responsible for designing scalable data pipelines, maintaining ETL/ELT processes, and collaborating with Data Architects and Project Managers. This role offers an opportunity to impact socially responsible projects.

Qualificações

• Strong experience as a Data Engineer within cloud environments.
• Good understanding of Data Lake / Data Warehouse concepts and data modeling.
• Experience developing data pipelines with PySpark / Spark SQL.
• Familiarity with infrastructure as code (Terraform) and orchestration tools.

Responsabilidades

• Understand business and technical challenges related to data projects.
• Design and develop scalable data pipelines based on the defined architecture.
• Implement and maintain ETL / ELT processes.
• Participate in code reviews, testing and deployment processes.
• Ensure the reliability, performance and monitoring of data pipelines.
• Collaborate closely with Data Architects, DataOps teams and Project Managers.

Conhecimentos

Data Engineering

Cloud environments

Data pipelines

PySpark

Spark SQL

Terraform

Airflow

Git

Ferramentas

Databricks

Azure Data Lake Storage

Descrição da oferta de emprego

A leading IT services company in Portugal is looking for a Data Engineer specialized in Databricks. In this role, you will join a collaborative environment focused on developing and evolving a large-scale Data Platform. Candidates should have strong experience in data engineering, cloud environments, and modern data pipelines. You will be responsible for designing scalable data pipelines, maintaining ETL/ELT processes, and collaborating with Data Architects and Project Managers. This role offers an opportunity to impact socially responsible projects.