Senior Data Engineer - GCP & BigQuery, Hybrid (Lisbon)

Decskill; Lisboa; Híbrido; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

Decskill is seeking a Data Engineer (GCP) for a hybrid role in Lisbon, Portugal. You will design and execute migration strategies from SQL Server to GCP, and build robust ETL/ELT pipelines on BigQuery.

Strong GCP, BigQuery, SQL, and Python skills are required, with 6–9 years of experience. The role offers a hybrid setup with 2x in-office per week in Lisbon, and opportunities to collaborate across teams.

Qualificações

• 6–9 years of experience as a Data Engineer.
• Strong experience with Google Cloud Platform (GCP).
• Significant experience with BigQuery, including schema design, complex SQL, performance optimization, partitioning, clustering, and cost management.
• Solid experience with Cloud Composer and Apache Airflow for DAG orchestration, scheduling, monitoring, and debugging.
• Advanced knowledge of SQL.
• Strong experience with Python for automation, data transformation, migration scripts, and GCP API integration.
• Experience with data migration from on-premises environments to GCP, ideally SQL Server to BigQuery.
• Experience designing and developing ETL/ELT data pipelines.
• Strong analytical and problem-solving skills.
• English B2 or higher.

Responsabilidades

• Design and execute data and ETL migration strategies from SQL Server to GCP.
• Develop and optimize scripts and pipelines for data transfer and transformation into BigQuery.
• Design, develop, and maintain robust ETL/ELT pipelines on GCP.
• Develop and optimize complex BigQuery SQL queries.
• Design optimized data schemas adapted to cloud architectures.
• Use Python to automate migration, transformation, and integration tasks.
• Implement data quality and integrity processes during and after migration.
• Collaborate with SQL Server admins, analysts, data scientists, and business users.
• Monitor, debug, and resolve incidents related to data pipelines.
• Participate in code reviews, testing strategies, and development best practices.
• Identify opportunities to improve and optimize the GCP data platform.

Conhecimentos

GCP

BigQuery

SQL

Python

ETL/ELT

Data pipelines

Ferramentas

Google Cloud Platform

BigQuery

Cloud Composer

Apache Airflow

Descrição da oferta de emprego

Decskill is seeking a Data Engineer (GCP) for a hybrid role in Lisbon, Portugal. You will design and execute migration strategies from SQL Server to GCP, and build robust ETL/ELT pipelines on BigQuery.

Strong GCP, BigQuery, SQL, and Python skills are required, with 6–9 years of experience. The role offers a hybrid setup with 2x in-office per week in Lisbon, and opportunities to collaborate across teams.