Senior Data Engineer - Data Foundations (all genders)

About You - Collins GmbH & Co. KG; Hamburg; Vor Ort; EUR 90.000 - 120.000; Vollzeit

Zusammenfassung

About You - Collins GmbH & Co. KG in Hamburg is seeking a data platform engineer to own and drive the transition to a new Data Platform using Dagster, dbt, AWS ECS, and GCP GBQ.

You will build tooling, monitoring, data-checks, connectors, cost controlling, testing, CI/CD, cataloging, and related capabilities to empower data teams. You will maintain and optimize the core ELT pipelines, moving terabytes of data from MySQL in AWS to GBQ nightly, while ensuring daytime syncs do not impact source

Jobbeschreibung

• Data Platform Ownership:Build, maintain, and drive the transition to our new Data Platform (Dagster, dbt, AWS ECS, and GCP GBQ). You will build a product that acts as a foundation for other data teams, improving their efficiency through custom-made tooling, monitoring, data-checks, connectors, cost controlling, testing, CI/CD, cataloging, etc.
• Core-ELT Pipelines:Maintain and optimize the biggest and most fundamental pipelines in the company. You will be responsible for moving terabytes of data from MySQL in AWS to GBQ nightly, including daytime syncs that strictly avoid impacting source system performance.
• Core-Reports Delivery:Take responsibility for the most critical reports in the company, which serve as the foundation for executive board decisions and act as a base …