Data Engineer – GCP, BigQuery & Dataflow Expert

Netconomy; Pörtschach am Wörther See; Hybrid; EUR 50,000 - 61,000; Full time

Benefits offered by this job

Flexible working models

Onboarding & mentoring

Company summit

Social events

Snacks & wellbeing

Mobility support

Job summary

NETCONOMY in Austria is seeking a Data Engineer to build modern, scalable data solutions on Google Cloud Platform. You’ll join our Data & AI team to design architectures that unlock the full potential of client data and deliver insights that drive decisions.

Responsibilities include building ETL/ELT pipelines to ingest data into BigQuery and Cloud Storage, implementing Dataflow, Dataform, Airflow, and Dataplex for governance, and collaborating with data scientists and analysts in an agile setup.

Qualifications

• 3+ years of hands-on experience as a Data Engineer with proven expertise in Google Cloud Platform (GCP).
• Strong experience with BigQuery (SQL, partitioning, clustering, optimization) and Dataflow (Apache Beam).
• Strong programming skills in Python with experience in data manipulation libraries (PySpark, pandas).
• Expert-level SQL proficiency for complex transformations, optimization, and analysis.
• Proficiency with Dataform for modular SQL-based data transformations and data pipeline management.
• Solid understanding of data warehousing principles, ETL/ELT processes, dimensional modeling, and data governance.
• Experience integrating data from various APIs and streaming systems (Pub/Sub).
• Cloud Composer experience for workflow orchestration.
• Excellent communication and collaboration skills in English (min. B2 level).
• Ability to work independently and as part of an agile team.

Responsibilities

• Building efficient and scalable ETL/ELT processes to ingest, transform, and load data from various sources into BigQuery and Cloud Storage.
• Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows.
• Developing SQL transformation workflows with Dataform, including version control, testing, and automated scheduling with built-in quality assertions.
• Creating efficient, cost-optimized BigQuery queries with partitioning, clustering, and denormalization strategies.
• Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing.
• Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking.
• Monitoring and optimizing data pipelines for performance, scalability, and cost using Cloud Monitoring and Cloud Logging.
• Collaborating with data scientists and analysts to understand data requirements and deliver actionable insights.
• Staying up to date with GCP advancements in data services, BigQuery features, and data engineering best practices.

Skills

GCP (Google Cloud Platform)

BigQuery

Python

SQL

Dataflow / Apache Beam

Data governance concepts

Airflow / Cloud Composer

Tools

Dataform

Dataplex

Pub/Sub

Cloud Storage

Looker/BI tools

Job description

NETCONOMY in Austria is seeking a Data Engineer to build modern, scalable data solutions on Google Cloud Platform. You’ll join our Data & AI team to design architectures that unlock the full potential of client data and deliver insights that drive decisions.

Responsibilities include building ETL/ELT pipelines to ingest data into BigQuery and Cloud Storage, implementing Dataflow, Dataform, Airflow, and Dataplex for governance, and collaborating with data scientists and analysts in an agile setup.