Remote GCP Data Engineer: Python, BigQuery & Snowflake

SGI; Grimsby; On-site; GBP 70,797 - 88,496; Full time

Job summary

SGI is seeking a GCP Data Engineer with deep Python/JVM and SQL expertise to architect and optimize data pipelines in a cloud environment. The role emphasizes building scalable ETL workflows, data warehouses, and streaming architectures across BigQuery and Snowflake.

You will implement production pipelines, work with Airflow/Cloud Composer, and collaborate with cross-functional teams to deliver reliable data products for fast-paced customer projects.

Qualifications

• 5+ years of experience as a data engineer or in a comparable engineering capacity.
• Strong skills with Python or a JVM language (Java, Scala).
• Advanced working SQL knowledge and experience with relational databases.
• Experience with cloud data warehouses, specifically BigQuery or Snowflake.
• Experience with data platforms built on public cloud in production."
• GCP native data toolset experience preferred.
• ELT/ETL pipelines processing large data volumes.
• Experience developing production Spark or Hadoop applications.
• Experience with scheduling/orchestration tools like Apache Airflow/Cloud Composer.
• Familiarity with DataOps practices and IaC (Terraform).
• Ability to learn new tools quickly and recommend effective ones.
• Experience with batch, micro-batch, and real-time streaming architectures.
• Good internal and customer-facing communication skills.
• CDC experience is a plus.

Responsibilities

• Design and implement ETL/ELT pipelines using GCP data services.
• Contribute to data warehousing and distributed data processing initiatives.
• Develop and maintain production Spark/Hadoop applications.
• Collaborate with teams to deploy data solutions and ensure quality.
• Participate in data platform governance and tooling evaluations.

Skills

Python

JVM (Java/Scala)

SQL proficiency

GCP experience

ETL/ELT

DataOps

Airflow/Cloud Composer

Cloud data warehouses

Spark/Hadoop

IaC (Terraform)

CDC familiarity

New tool adoption

Tools

dbt

Airbyte

Airflow

Job description

SGI is seeking a GCP Data Engineer with deep Python/JVM and SQL expertise to architect and optimize data pipelines in a cloud environment. The role emphasizes building scalable ETL workflows, data warehouses, and streaming architectures across BigQuery and Snowflake.

You will implement production pipelines, work with Airflow/Cloud Composer, and collaborate with cross-functional teams to deliver reliable data products for fast-paced customer projects.