GCP Data Engineer

Heptarc; Deutschland; Hybrid; EUR 70.000 - 100.000; Vollzeit

Zusammenfassung

Heptarc is seeking a senior data engineer for a hybrid role in Germany. You will design and build scalable data pipelines on Google Cloud Platform, utilizing BigQuery, Dataflow, Pub/Sub, Cloud Storage and Cloud Composer.

You will implement ETL processes to ingest data from diverse sources into BigQuery, contribute to data modeling and warehousing, and mentor junior engineers in a fast-paced environment.

Qualifikationen

• Extensive experience with Google Cloud Platform (GCP) and its data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.
• Proven track record of designing and building scalable data pipelines and architectures.
• Experience with ETL tools and processes.
• Design, develop, and maintain robust and scalable data pipelines using GCP services such as Dataflow, Pub/Sub, Cloud Functions, and Cloud Composer.
• Implement ETL (Extract, Transform, Load) processes to ingest data from various sources into GCP data warehouses like BigQuery.

Aufgaben

• Design and build scalable data pipelines on GCP.
• Develop and maintain robust ETL processes and data architectures.
• Ingest data from multiple sources into BigQuery via ETL.
• Mentor junior engineers and collaborate with teams.

Kenntnisse

SQL

Python

Java

Data modeling

Data warehousing

Big data processing

GCP

ETL pipelines

Leadership

Looker/Data Studio

Ausbildung

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Composer

Cloud Functions

Jobbeschreibung

Experience - 5+ years

Location - Hybrid

Job Description

• Extensive experience with Google Cloud Platform (GCP) and its data services, including
• BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.
• Proven track record of designing and building scalable data pipelines and architectures.
• Experience with ETL tools and processes.
• Design, develop, and maintain robust and scalable data pipelines using GCP services such as Dataflow, Pub/Sub, Cloud Functions, and Cloud Composer.
• Implement ETL (Extract, Transform, Load) processes to ingest data from various sources into GCP data warehouses like BigQuery.

Technical Skills

• Proficiency in SQL and experience with database design and optimization.
• Strong programming skills in Python, Java, or other relevant languages.
• Experience with data modeling, data warehousing, and big data processing frameworks.
• Familiarity with data visualization tools (e.g., Looker, Data Studio) is a plus.
• Knowledge of machine learning workflows and tools is an advantage.

Soft Skills

• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work in a fast-paced environment and manage multiple tasks concurrently.
• Leadership skills and experience mentoring junior engineers.