Data Engineer GCP

Decskill; Lisboa; Híbrido; EUR 70.000 - 90.000; Jornada completa

Descripción de la vacante

Decskill, an IT consulting company with over 10 years of experience, is seeking a Data Engineer (GCP) for a hybrid role in Lisbon, Portugal. You will design and implement data migration strategies from SQL Server to GCP, build robust ETL/ELT pipelines on BigQuery, and optimize SQL queries and data schemas to fit cloud architectures.

Strong Python skills and experience with Cloud Composer (Airflow) are required, along with a proven track record in on-premises to GCP migrations.

Formación

• 6–9 years of experience as a Data Engineer.
• Strong professional experience with Google Cloud Platform (GCP).
• Significant experience with BigQuery, including schema design, complex SQL queries, performance optimization, partitioning, clustering, and cost management.
• Solid experience with Cloud Composer and Apache Airflow for DAG orchestration, scheduling, monitoring, and debugging.
• Advanced knowledge of SQL.
• Strong experience with Python for automation, data transformation, migration scripts, and GCP API integration.
• Experience with data migration from on-premises environments to GCP, ideally from SQL Server to BigQuery.
• Experience designing and developing ETL/ELT data pipelines.
• Strong analytical and problem-solving skills.
• English B2 or higher.

Responsabilidades

• Design and execute data and ETL migration strategies from SQL Server to GCP.
• Develop and optimize scripts and pipelines for data transfer and transformation into BigQuery.
• Design, develop, and maintain robust ETL/ELT pipelines on GCP.
• Develop and optimize complex BigQuery SQL queries.
• Design optimized data schemas adapted to cloud architectures.
• Use Python to automate migration, transformation, and integration tasks.
• Implement data quality and integrity processes during and after migration.
• Collaborate with SQL Server administrators, analysts, data scientists, and business users.
• Monitor, debug, and resolve incidents related to data pipelines.
• Participate in code reviews, testing strategies, and development best practices.
• Identify opportunities to improve and optimize the GCP data platform.

Herramientas

Google Cloud Platform (GCP)

BigQuery

Cloud Composer

Apache Airflow

SQL

Python

Descripción del empleo

We are growing. And we are looking for talented people.

At Decskill, we believe that technological excellence is driven by human talent.

We are an IT consulting company with more than 10 years of consolidated experience in the market, focused on building long-term relationships with both our clients and our people. Today, we are a community of over 800 professionals, working from Lisbon, Porto, and Madrid, contributing to impactful technology initiatives.

As part of the Astek Group, we combine a strong local culture with a global presence, being active in around 23 countries across 4 continents. This allows us to offer an international context, diverse challenges, and long-term career opportunities, while staying close to our teams.

We would like to meet a Data Engineer (GCP) for a project with a hybrid working model in Lisbon, Portugal (2x/week at the office).

Responsibilities:

• Design and execute data and ETL migration strategies from SQL Server to GCP.
• Develop and optimize scripts and pipelines for data transfer and transformation into BigQuery.
• Design, develop, and maintain robust ETL/ELT pipelines on GCP.
• Develop and optimize complex BigQuery SQL queries.
• Design optimized data schemas adapted to cloud architectures.
• Use Python to automate migration, transformation, and integration tasks.
• Implement data quality and integrity processes during and after migration.
• Collaborate with SQL Server administrators, analysts, data scientists, and business users.
• Monitor, debug, and resolve incidents related to data pipelines.
• Participate in code reviews, testing strategies, and development best practices.
• Identify opportunities to improve and optimize the GCP data platform.

Requirements:

• 6–9 years of experience as a Data Engineer.
• Strong professional experience with Google Cloud Platform (GCP).
• Significant experience with BigQuery, including schema design, complex SQL queries, performance optimization, partitioning, clustering, and cost management.
• Solid experience with Cloud Composer and Apache Airflow for DAG orchestration, scheduling, monitoring, and debugging.
• Advanced knowledge of SQL.
• Strong experience with Python for automation, data transformation, migration scripts, and GCP API integration.
• Experience with data migration from on-premises environments to GCP, ideally from SQL Server to BigQuery.
• Experience designing and developing ETL/ELT data pipelines.
• Strong analytical and problem-solving skills.
• English B2 or higher.

Are you looking for an environment that values curiosity and commitment? Here, your contribution has real impact and individual growth is taken seriously.

Find with us the right opportunity to grow!

What you can expect from us

• Long-term projects with national and international context.
• Opportunities to grow technically and professionally
• A people-first culture, focused on transparency and trust.
• Teams that value ownership, collaboration and stability.

Your next challenge might start here.

At Decskill, we are committed to equal opportunities and non-discrimination. We promote a culture of diversity and inclusion, where recruitment and career progression are based solely on talent, regardless of age, gender, ethnicity, race, nationality, or any other form of discrimination incompatible with human dignity.