GCP Data Engineer (Python/BigQuery/Snowflake)

SGI; Grimsby; On-site; GBP 70,797 - 88,496; Full time

Job summary

SGI is seeking a GCP Data Engineer with deep Python/JVM and SQL expertise to architect and optimize data pipelines in a cloud environment. The role emphasizes building scalable ETL workflows, data warehouses, and streaming architectures across BigQuery and Snowflake.

You will implement production pipelines, work with Airflow/Cloud Composer, and collaborate with cross-functional teams to deliver reliable data products for fast-paced customer projects.

Qualifications

• 5+ years of experience as a data engineer or in a comparable engineering capacity.
• Strong skills with Python or a JVM language (Java, Scala).
• Advanced working SQL knowledge and experience with relational databases.
• Experience with cloud data warehouses, specifically BigQuery or Snowflake.
• Experience with data platforms built on public cloud in production."
• GCP native data toolset experience preferred.
• ELT/ETL pipelines processing large data volumes.
• Experience developing production Spark or Hadoop applications.
• Experience with scheduling/orchestration tools like Apache Airflow/Cloud Composer.
• Familiarity with DataOps practices and IaC (Terraform).
• Ability to learn new tools quickly and recommend effective ones.
• Experience with batch, micro-batch, and real-time streaming architectures.
• Good internal and customer-facing communication skills.
• CDC experience is a plus.

Responsibilities

• Design and implement ETL/ELT pipelines using GCP data services.
• Contribute to data warehousing and distributed data processing initiatives.
• Develop and maintain production Spark/Hadoop applications.
• Collaborate with teams to deploy data solutions and ensure quality.
• Participate in data platform governance and tooling evaluations.

Skills

Python

JVM (Java/Scala)

SQL proficiency

GCP experience

ETL/ELT

DataOps

Airflow/Cloud Composer

Cloud data warehouses

Spark/Hadoop

IaC (Terraform)

CDC familiarity

New tool adoption

Tools

dbt

Airbyte

Airflow

Job description

GCP Data Engineer (Python/BigQuery/Snowflake)
Remote - 6 months+ extensions - Anywhere in EU
MUST BE AN EXPERT IN GCP
Pay to candidate no higher than €75 per hour. / €600 a day

What you will do...

As a member of our Data Engineering team, you will be working with fast-paced innovative companies, leveraging Cloud as the key driver of their transformation. They will look at you as their trusted advisor, someone they can rely on and who will be there to help them along their journey on Google Cloud. You will be expected to cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, and Streaming Data systems.

NOTE: This opportunity is available on a contractor basis.

Who we need...

• 5+ years of experience serving as a data engineer or in a comparable engineering capacity
• Strong skills with Python or a JVM language (Java, Scala)
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience working with cloud data warehouses, specifically BigQuery or +Snowflake
• Experience working with data platforms built on public cloud in a production setting.
• Experience working with GCP native data toolset is preferred.
• Having built ELT or ETL pipelines processing large amounts of data.
• Experience with dbt or Airbyte is preferred.
• Experience developing production Spark or Hadoop applications
• Gained experience with a workload scheduling and orchestration tool such as Apache Airflow/Cloud Composer
• Familiarity with modern DataOps (e.g. quality eng, testing, pipeline deployments etc) practices and IaC (e.g. Terraform)
• Familiarity with the constellation of tools in the data engineering ecosystem. You should be comfortable picking up and learning a new tool, as well as recommending tools that have served you well.
• Experience with batch, micro-batch, and real-time streaming architectures
• Good internal and customer-facing communication skills
• Experience with relational database management systems and change data capture (CDC) is a plus

We believe in equal opportunity for all and actively encourage applications from diverse backgrounds, experiences, and perspectives.