Data Platform Engineer — Build Trusted Data Products on GCP

G-Star Management; Amsterdam; On-site; EUR 70,000 - 110,000; Full time

Job summary

G-STAR is seeking a Data Platform Engineer in Amsterdam to build and maintain data models used by Finance, Retail, Ecommerce and Wholesale. You will develop models on Google Cloud, document them, and manage data quality and costs.

In this small team you own your work, translate business questions into reliable data products, and collaborate with stakeholders. You’ll work with Dataform on BigQuery, handle ingestion with Airbyte, and support Terraform and Kubernetes infrastructure.

Qualifications

• Three or more years building data pipelines in production.
• Strong SQL - you should be able to look at a query and explain why it's expensive
• A cloud data warehouse in production: BigQuery preferred, Snowflake or Databricks fine
• A transformation framework such as Dataform or dbt, and Git as a daily habit
• Enough Python to automate the things that shouldn't need a person
• You document as you go, and you're comfortable owning something outright in a small team

Responsibilities

• Build and maintain data models in Dataform on BigQuery, from a business question through to a table someone reports on
• Own the models in your area: their documentation, their data quality and their running cost
• Write the tests and assertions that catch problems before the business notices them
• Keep the platform's cost under control - we measure before and after every change
• Work with colleagues in Finance, Retail, Ecommerce and Wholesale to turn reporting needs into clear specifications, and build so they can serve themselves next time
• Support the platform around the models: ingestion via Airbyte, infrastructure in Terraform, orchestration on Kubernetes

Skills

SQL

Data pipelines

Python

Data quality

Documentation

Tools

BigQuery

Airbyte

Terraform

Kubernetes

Dataform

dbt

Job description

G-STAR is seeking a Data Platform Engineer in Amsterdam to build and maintain data models used by Finance, Retail, Ecommerce and Wholesale. You will develop models on Google Cloud, document them, and manage data quality and costs.

In this small team you own your work, translate business questions into reliable data products, and collaborate with stakeholders. You’ll work with Dataform on BigQuery, handle ingestion with Airbyte, and support Terraform and Kubernetes infrastructure.