Senior Data Engineer – Google Cloud Platform (Gcp) Data Migration & Pipelines

Itds Portugal; Porto; Híbrido; EUR 70 000 - 95 000; Tempo integral

Resumo da oferta

Ignite Innovation is seeking a Senior Data Engineer to lead migration and pipeline design on Google Cloud Platform. You will work with BigQuery, Cloud Composer, and SQL Server while shaping scalable data architectures.

The role requires 6+ years in data engineering, strong SQL, Python, and hands-on cloud migration experience, with a hybrid work setup in Porto and surrounding areas. English fluency is essential.

Qualificações

• 6+ years of experience in data engineering or related fields.
• Deep expertise with Google Cloud Platform, especially BigQuery and Cloud Composer.
• Strong SQL skills with experience migrating from SQL Server.
• Proficiency in Python for scripting and automation in GCP.
• Hands-on experience migrating on-premise data to cloud platforms.
• Excellent English communication (B2 level or higher).

Responsabilidades

• Participate in the design and execution of data and ETL/ELT migration strategies to GCP.
• Design and maintain robust, high‑performing ETL/ELT pipelines on GCP.
• Orchestrate and schedule pipelines using Cloud Composer.
• Develop and optimize SQL queries for BigQuery and cost management.
• Use Python for automation and data quality assurance during migration.
• Collaborate with SQL Server admins and analysts to meet business needs.
• Contribute to code reviews, testing, and best practices.
• Monitor, debug, and resolve data pipeline incidents during migration and production.
• Stay updated on GCP innovations and propose optimizations.

Conhecimentos

GCP Data Migration

SQL

Python

ETL/ELT pipelines

Data migration

Ferramentas

BigQuery

Cloud Composer

SQL Server

Descrição da oferta de emprego

Ignite Innovation in Cloud Data Engineering — Transform Data with Cutting-Edge GCP Solutions!

Porto-based opportunity with hybrid work model (up to 3 days remote per week).

As a Senior Data Engineer – Google Cloud Platform (GCP) Data Migration & Pipelines, you will be working for our client, a leading player in the data and technology industry. You will contribute to the design, development, and optimization of large-scale data migration and processing solutions on GCP, helping organizations transition seamlessly from on-premises systems to a scalable cloud infrastructure. This is a unique chance to shape the future of data architecture and advance your career within a dynamic, innovative environment.

Your main responsibilities:

• Actively participate in the design and execution of data and ETL process migration strategies from SQL Server to GCP, developing scripts and pipelines for efficient data transfer into BigQuery.
• Design, develop, and maintain robust and high-performing ETL/ELT data pipelines on GCP, replacing or rebuilding existing flows.
• Orchestrate and schedule pipelines using Google Cloud Composer, ensuring reliable migration and operational stability.
• Develop and optimize complex SQL queries for BigQuery, focusing on schema design, performance tuning, and cost management, while adapting from SQL Server.
• Use Python for scripting automation tasks, ensuring data quality and integrity during migration and ongoing operations.
• Collaborate closely with SQL Server administrators, analysts, and end-users to ensure smooth transition and meet business needs.
• Participate in code reviews, best practices, and testing to uphold high development standards.
• Monitor, debug, and resolve incidents related to data pipelines, especially during the migration phase and in production.
• Stay updated on GCP innovations and propose improvements to optimize the data platform.

You’re ideal for this role if you have:

• Minimum of 6 years of experience in data engineering or related fields.
• Deep expertise with Google Cloud Platform, especially BigQuery, Cloud Composer, and related services.
• Strong mastery of SQL, with experience migrating from SQL Server and optimizing queries for cloud environments.
• Proficiency in Python for scripting and automation within GCP.
• Hands-on experience with data migration from on-premise systems to cloud platforms.
• Analytical mindset with problem-solving skills, capable of designing scalable, efficient data solutions.
• Excellent communication skills in English (fluency at B2 level or higher).

It is a strong plus if you have:

(optional)

• Knowledge of SQL Server architecture, T-SQL, or basic administration.
• Familiarity with other GCP data services, such as Dataflow or Storage.
• Experience with GCP’s Database Migration Service and related migration tools.
• Background in Data Warehousing concepts and data modeling (e.g., Data Vault).
• Experience with data visualization tools like Power BI.
• Knowledge of version control systems.

Language Required for the role:

Fluent English (B2 level or higher).

Eligibility for the role:

Only candidates with an existing legal right to work in Europe will be considered for this role.

https://itdsportugal.com/en/it-jobs/9746/?utm_source=itjobs