Data Engineer (GCP & BigQuery) – Hybrid in Porto

Decskill; Porto; Híbrido; EUR 45 000 - 75 000; Tempo integral

Resumo da oferta

Decskill, an IT consulting company with over 10 years of experience, is growing and seeking a Data Engineer (GCP) for a hybrid role in Porto, Portugal (2x per week at the office). You will design and implement data migrations from SQL Server to GCP, develop BigQuery pipelines, and build robust ETL/ELT processes using Python and Airflow, collaborating with cross-functional teams.

This role offers long-term projects with international context and a people-first culture focused on transparency and

Qualificações

• 6-9 years of experience as a Data Engineer.
• Strong experience with Google Cloud Platform (GCP).
• Extensive BigQuery experience including schema design and performance optimization.
• Experience with Cloud Composer and Apache Airflow for DAG orchestration.
• Advanced SQL skills.
• Python for automation and data transformation.
• Experience migrating data from on-premises to GCP, preferably SQL Server to BigQuery.
• Experience designing ETL/ELT data pipelines.
• Proficient English (B2 or higher).

Responsabilidades

• Design and execute data and ETL migration strategies from SQL Server to GCP.
• Develop and optimize pipelines and scripts for data transfer into BigQuery.
• Build and maintain robust ETL/ELT pipelines on GCP.
• Create and optimize BigQuery SQL queries.
• Design data schemas for cloud architectures.
• Use Python to automate migration, transformation, and integration tasks.
• Implement data quality and integrity checks during migration.
• Collaborate with SQL Server admins, analysts, data scientists, and business users.
• Monitor, debug, and resolve incidents in data pipelines.
• Participate in code reviews, testing strategies, and best practices.
• Identify opportunities to improve and optimize the GCP data platform.

Conhecimentos

GCP

BigQuery

Airflow

SQL

Python

ETL/ELT

Data migration

Data modeling

English (B2)

Ferramentas

Cloud Composer

Apache Airflow

GCP API integration

Descrição da oferta de emprego

Decskill, an IT consulting company with over 10 years of experience, is growing and seeking a Data Engineer (GCP) for a hybrid role in Porto, Portugal (2x per week at the office). You will design and implement data migrations from SQL Server to GCP, develop BigQuery pipelines, and build robust ETL/ELT processes using Python and Airflow, collaborating with cross-functional teams.

This role offers long-term projects with international context and a people-first culture focused on transparency and