Hybrid Data Engineer (GCP) – BigQuery & ETL Specialist

Decskill; Lisboa; Hybrid; EUR 70,000 - 90,000; Full time

Job summary

Decskill, an IT consulting company with over 10 years of experience, is seeking a Data Engineer (GCP) for a hybrid role in Lisbon, Portugal. You will design and implement data migration strategies from SQL Server to GCP, build robust ETL/ELT pipelines on BigQuery, and optimize SQL queries and data schemas to fit cloud architectures.

Strong Python skills and experience with Cloud Composer (Airflow) are required, along with a proven track record in on-premises to GCP migrations.

Qualifications

• 6–9 years of experience as a Data Engineer.
• Strong professional experience with Google Cloud Platform (GCP).
• Significant experience with BigQuery, including schema design, complex SQL queries, performance optimization, partitioning, clustering, and cost management.
• Solid experience with Cloud Composer and Apache Airflow for DAG orchestration, scheduling, monitoring, and debugging.
• Advanced knowledge of SQL.
• Strong experience with Python for automation, data transformation, migration scripts, and GCP API integration.
• Experience with data migration from on-premises environments to GCP, ideally from SQL Server to BigQuery.
• Experience designing and developing ETL/ELT data pipelines.
• Strong analytical and problem-solving skills.
• English B2 or higher.

Responsibilities

• Design and execute data and ETL migration strategies from SQL Server to GCP.
• Develop and optimize scripts and pipelines for data transfer and transformation into BigQuery.
• Design, develop, and maintain robust ETL/ELT pipelines on GCP.
• Develop and optimize complex BigQuery SQL queries.
• Design optimized data schemas adapted to cloud architectures.
• Use Python to automate migration, transformation, and integration tasks.
• Implement data quality and integrity processes during and after migration.
• Collaborate with SQL Server administrators, analysts, data scientists, and business users.
• Monitor, debug, and resolve incidents related to data pipelines.
• Participate in code reviews, testing strategies, and development best practices.
• Identify opportunities to improve and optimize the GCP data platform.

Tools

Google Cloud Platform (GCP)

BigQuery

Cloud Composer

Apache Airflow

SQL

Python

Job description

Decskill, an IT consulting company with over 10 years of experience, is seeking a Data Engineer (GCP) for a hybrid role in Lisbon, Portugal. You will design and implement data migration strategies from SQL Server to GCP, build robust ETL/ELT pipelines on BigQuery, and optimize SQL queries and data schemas to fit cloud architectures.

Strong Python skills and experience with Cloud Composer (Airflow) are required, along with a proven track record in on-premises to GCP migrations.