Senior Data Engineer - GCP

act digital

Portugal

On-site

EUR 60,000 - 90,000

Full time

44 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

act digital is seeking a senior Data Engineer to lead migration of SQL Server data to Google Cloud Platform. You will design scalable ETL/ELT pipelines, optimize BigQuery SQL, and orchestrate workloads with Cloud Composer. Strong Python skills and data modeling experience are essential for success.

Join a team focused on cloud-based data solutions, collaborating with analysts and data scientists to deliver robust data platforms in a Portugal-based environment.

Qualifications

  • 6+ years of experience in a similar data engineering role.
  • Proven experience with GCP and BigQuery including schema design and complex SQL.
  • Strong Python skills for automation, migration and data integration.

Responsibilities

  • Design and execute data and ETL migration from SQL Server to GCP.
  • Develop and optimize scripts and pipelines to move data into BigQuery.
  • Build and maintain robust ETL/ELT pipelines on GCP.
  • Orchestrate pipelines with Cloud Composer for reliable scheduling and monitoring.
  • Develop and optimize complex BigQuery SQL queries and data schemas.

Skills

GCP
BigQuery
SQL
Python
ETL/ELT pipelines
Data migration

Tools

Cloud Composer

Job description

  • Between 6 ans 9 years of experience in a similar role;
  • Solid experience in cloud environments using GCP (Google Cloud Platform), particularly in Data Engineering.
  • Significant experience with BigQuery, including schema design, complex SQL query development, performance optimization, partitioning, clustering and cost management.
  • Experience with Cloud Composer, including DAG creation, orchestration, scheduling, monitoring and debugging.
  • Advanced SQL skills, with the ability to adapt and optimize queries for BigQuery.
  • Strong Python skills for developing automation, migration, data transformation and integration scripts.
  • Experience developing, maintaining and optimizing ETL/ELT pipelines.
  • Experience or solid knowledge of database migration from on-premises environments (SQL Server) to cloud environments (GCP).
Nice to Have:
  • Knowledge of SQL Server, particularly architecture, T-SQL and basic administration.
  • Experience with other GCP services, such as Cloud Storage and Dataflow.
  • Knowledge of GCP migration tools and strategies, such as Database Migration Service.
  • Experience with Power BI.
  • Knowledge of Data Warehousing, Data Modelling and Data Vault.
  • Experience with code versioning tools.
Responsibilities
  • Participate in the design and execution of the data and ETL migration strategy from SQL Server to GCP.
  • Develop and optimize scripts and pipelines for transferring and transforming data into BigQuery.
  • Design, develop and maintain robust and scalable ETL/ELT pipelines on GCP.
  • Orchestrate and schedule pipelines using Cloud Composer, ensuring process reliability.
  • Develop and optimize complex SQL queries in BigQuery.
  • Contribute to the design and implementation of optimized data schemas for cloud architectures.
  • Use Python to automate migration, transformation and data integration tasks.
  • Implement data quality, consistency and integrity control mechanisms.
  • Collaborate with technical teams, analysts and other stakeholders throughout the migration process.
  • Work with business users and Data Scientists to understand their needs and ensure the new platform meets their requirements.
  • Participate in code reviews, testing and the definition of development best practices.
  • Ensure monitoring, debugging and incident resolution related to data pipelines.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Engineer
GCP Data Engineer

emagine - Portugal • Portugal

On-site
EUR 40,000 - 60,000
Senior Data Engineer – Cloud Platform (GCP) & ETL
Senior Data Engineer – Cloud Platform (GCP) & ETL

team.it • Lisboa

On-site
EUR 70,000 - 110,000
Broad and flexible benefits package
Health insurance, life and personal事故e
Certified training, online training平台,
+1
GCP & BigQuery Data Engineer Lead
GCP & BigQuery Data Engineer Lead

act digital • Portugal

On-site
EUR 60,000 - 90,000
Data Engineer / Analytics Engineer (Mid-Senior)
Data Engineer / Analytics Engineer (Mid-Senior)

emagine Polska • Lisboa

On-site
EUR 65,000 - 85,000
Distributed Cloud | GCP Data Engineer
Distributed Cloud | GCP Data Engineer

Devoteam • Lisboa

On-site
EUR 40,000 - 60,000
Hybrid Data Engineer (GCP) – BigQuery & ETL Specialist
Hybrid Data Engineer (GCP) – BigQuery & ETL Specialist

Decskill • Lisboa

Hybrid
EUR 70,000 - 90,000
Senior Data Engineer | AWS & GCP
Senior Data Engineer | AWS & GCP

Reach IT • Portugal

On-site
EUR 60,000 - 90,000
Senior Data Engineer
Senior Data Engineer

Smart Consulting • Lisboa

On-site
EUR 50,000 - 70,000
GCP Data Engineer: Scalable Pipelines & BigQuery
GCP Data Engineer: Scalable Pipelines & BigQuery

Devoteam • Lisboa

On-site
EUR 40,000 - 60,000
Senior Data Engineer: GCP, BigQuery & Data Migrations
Senior Data Engineer: GCP, BigQuery & Data Migrations

Smart Consulting • Lisboa

On-site
EUR 50,000 - 70,000
Top locations