Data Engineer

ITDS; Porto; Híbrido; EUR 42 000 - 64 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Hybrid work model

Resumo da oferta

ITDS seeks a Data Engineer – Google Cloud Platform (GCP) Migration Specialist in Porto, offering a hybrid work arrangement (up to 3 days remote per week). You will design, implement, and optimize large-scale data migrations and pipelines in GCP to empower data-driven decision making.

Responsibilities include migrating SQL Server to GCP, building BigQuery schemas, developing ETL/ELT pipelines, and automating tasks with Python.

Qualificações

• 3+ years of data engineering experience, preferably with cloud migration projects.

Responsabilidades

• Actively participate in the design and execution of data and ETL process migration strategies from SQL Server to GCP, ensuring seamless transition and efficiency.

Ferramentas

Power BI

GCP BigQuery

Cloud Composer

SQL

Python

Data migration methodologies

English (B2)

Descrição da oferta de emprego

Unleash the Future of Data Transformation — Lead Cloud Migration with Innovation and Precision!

Porto-based opportunity with hybrid work model (up to 3 days remote/week).

As a Data Engineer – Google Cloud Platform (GCP) Migration Specialist, you will be working for our client, a major player in the IT sector, dedicated to elevating data infrastructure through cloud technology. You will play a critical role in designing, implementing, and optimizing large-scale data migrations and pipelines within GCP, empowering data-driven decision-making and operational excellence. This role offers an exciting chance to be at the forefront of cloud transformation and advance your career in a dynamic environment.

Your main responsibilities:

• Actively participate in the design and execution of data and ETL process migration strategies from SQL Server to GCP, ensuring seamless transition and efficiency.
• Develop and optimize scripts and pipelines for effective data transfer and transformation into BigQuery.
• Design, develop, and maintain robust high-performance ETL/ELT pipelines on GCP, replacing or improving existing workflows.
• Orchestrate and schedule data workflows using Google Cloud Composer, guaranteeing reliable migration and operational continuity.
• Develop complex SQL queries for BigQuery, focusing on performance optimization, partitioning, and clustering tailored to migration needs.
• Contribute to designing adapted data schemas for BigQuery, aligned with cloud architecture best practices.
• Use Python to automate migration tasks, data transformations, and integration with GCP services, ensuring data quality and integrity.
• Collaborate closely with SQL Server administrators, analysts, and end-users to understand existing environments and facilitate a smooth transition.
• Stay informed on the latest GCP developments, propose improvements, and optimize the data platform for efficiency and scalability.
• Maintain monitoring, debugging, and incident resolution capabilities related to data pipelines during and after migration.

You're ideal for this role if you have:

• At least 3 years of experience in data engineering, preferably with cloud migration projects.
• Mastery of Google Cloud Platform, especially BigQuery (schema design, complex queries, performance, and cost management).
• Experience with Cloud Composer, creating, scheduling, and troubleshooting data workflows.
• Strong SQL skills, with a focus on adapting queries from SQL Server to BigQuery.
• In-depth Python knowledge for scripting, automation, and API interaction.
• A solid understanding of database migration methodologies, especially from on-premise SQL Server to GCP.
• Analytical mindset with problem-solving skills to resolve complex data pipeline challenges.
• Good command of English (fluency B2 level required).

It is a strong plus if you have:

• Knowledge of SQL Server architecture and T-SQL fundamentals.
• Experience with other GCP services relevant to data migration (e.g., Storage, Dataflow, Migration Service).
• Familiarity with data visualization tools such as Power BI.
• Knowledge of Data Warehousing concepts and data modeling techniques like Data Vault.
• Experience with version control systems.

Language Required for the role:

Eligibility to work in Europe:

• Only candidates with an existing legal right to work in the European Union will be considered for this role.