GCP Data Engineer

emagine - Portugal; Portugal; Presencial; EUR 40 000 - 60 000; Tempo integral

Resumo da oferta

emagine - Portugal is looking for a skilled Data Engineer to join the team for a project with a retail client. The role focuses on designing and implementing data pipelines, utilizing GCP, SQL, and Python, and collaborating with both technical and non-technical stakeholders. The ideal candidate will have expertise in cloud services, DBT, and Terraform, ensuring data integrity while optimizing ETL processes. Join us in creating innovative data solutions.

Qualificações

• Strong expertise in Google Cloud Platform (GCP), SQL, and Python.
• Comprehensive understanding of ETL processes, especially in cloud environments.
• Basic understanding of Azure.

Responsabilidades

• Design and implement robust data pipelines.
• Utilize cloud services for efficient data processing and storage.
• Collaborate with cross-functional teams to gather requirements.
• Optimize SQL queries for performance and scalability.
• Develop and maintain ETL processes with industry-standard tools.
• Ensure data integrity and security standards are met.
• Document technical specifications and workflows.

Conhecimentos

GCP (Google Cloud Platform)

SQL

Python

DBT

Terraform

Business Intelligence tools

Ferramentas

Informatica

Descrição da oferta de emprego

We are seeking a skilled Data Engineer to join our team for an exciting project with our retail client. The ideal candidate will possess strong expertise in Google Cloud Platform (GCP), SQL, and Python. A comprehensive understanding of ETL processes, especially within cloud environments, is essential. This position offers the opportunity to work closely with both technical and non-technical stakeholders, fostering collaboration and innovative solutions in data engineering.

Main Responsibilities

As a Data Engineer, you will be responsible for:

• Designing and implementing robust data pipelines.
• Utilizing cloud services for efficient data processing and storage.
• Collaborating with cross-functional teams to gather requirements.
• Optimizing SQL queries for performance and scalability.
• Developing and maintaining ETL processes with industry-standard tools.
• Ensuring data integrity and security standards are met.
• Documenting technical specifications and workflows.

Key Requirements

The ideal candidate must have:

• Proficiency in GCP services (BigQuery, Cloud Run, Cloud Functions, etc.).
• Expertise in Python programming.
• Experience with DBT and Terraform.
• Familiarity with at least one business intelligence (BI) tool.

Additional skills

• Basic understanding of Azure.
• Experience with Informatica or other ETL tools.