Data engineer for digital solutions

Netconomy GmbH; Berlin; Híbrido; EUR 70.000 - 100.000; Jornada completa

Descripción de la vacante

NETCONOMY GmbH ищет инженера данных для разработки современных, масштабируемых решений на Google Cloud Platform. Вы будете проектировать и внедрять ETL/ELT-пайплайны, работать с BigQuery, Dataflow и Pub/Sub, а также способствовать превращению данных в действенные инсайты для клиентов.

Требуется 3+ года опыта, сильные навыки SQL и Python, знание Dataform, Cloud Composer и Dataplex. Хорошие коммуникативные навыки на уровне English (B2). Гибридный формат работы с onboarding и возможностями обучения.

Formación

• 3+ года опыта инженером данных с опытом GCP
• Сильные навыки SQL и Python
• Опыт работы с BigQuery, Dataflow
• Опыт использования Dataform, Data governance и ETL/ELT
• Знание англ. языка не ниже B2

Responsabilidades

• Строить эффективные ETL/ELT пайплайны для загрузки данных в BigQuery и Cloud Storage
• Реализовывать ingestion и обработку в реальном времени через Dataflow и Pub/Sub
• Разрабатывать SQL-трансформации с Dataform; настройка версионности, тестирования, расписания
• Оптимизировать запросы BigQuery with partitions/кластеры
• Оркестрация рабочих процессов через Cloud Composer и Cloud Functions
• Настраивать управление данными и метаданные в Dataplex; каталогизация и lineage
• Мониторинг и оптимизация пайплайнов по производительности и затратам
• Сотрудничать с учёными данными и аналитиками
• Держать руку на струне по развитию GCP-облаков и новых сервисов

Conocimientos

GCP экспертиза

BigQuery

Dataflow

Python

SQL

Airflow

ETL/ELT

Data warehousing

Data governance

English коммуникация

Herramientas

Dataform

Cloud Composer

Dataplex

Terraform

Looker/Looker Studio

Power BI

Vertex AI

Descripción del empleo

Описание

Over the past 25 years, NETCONOMY has grown from a startup into a team of 500 people across 10 European locations. We believe in the power of agile and cross-functional collaboration, bringing together people from diverse backgrounds to build outstanding digital solutions. As a Data Engineer, you’ll play a key role in building modern, scalable, and high-performance data solutions on Google Cloud Platform (GCP). You’ll be part of our growing Data & AI team, designing and implementing data architectures that help clients unlock the full potential of their data.

Задачи

• Building efficient and scalable ETL/ELT processes to ingest, transform, and load data from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage
• Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows
• Developing SQL transformation workflows with Dataform, including version control, testing, and automated scheduling with built-in quality assertions
• Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and denormalization strategies
• Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing
• Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking
• Monitoring and optimizing data pipelines for performance, scalability, and cost using Cloud Monitoring and Cloud Logging
• Collaborating with data scientists and analysts to understand data requirements and deliver actionable insights
• Staying up to date with GCP advancements in data services, BigQuery features, and data engineering best practices

Требования

• 3+ years of hands-on experience as a Data Engineer with proven expertise in Google Cloud Platform (GCP)
• Strong experience with BigQuery (SQL, partitioning, clustering, optimization) and Dataflow (Apache Beam)
• Strong programming skills in Python with experience in data manipulation libraries (PySpark, pandas)
• Expert-level SQL proficiency for complex transformations, optimization, and analysis
• Proficiency with Dataform for modular SQL-based data transformations and data pipeline management
• Solid understanding of data warehousing principles, ETL/ELT processes, dimensional modeling, and data governance
• Experience integrating data from various APIs and streaming systems (Pub/Sub)
• Cloud Composer experience for workflow orchestration
• Excellent communication and collaboration skills in English (min. B2 level)
• Ability to work independently and as part of an agile team
• Будет плюсом: Google Professional Data Engineer certification; Knowledge of BigLake for unified access and management of structured and unstructured data; Experience with Dataplex for managing metadata, lineage, and data governance; Familiarity with Infrastructure-as-Code (Terraform) for automating GCP resource provisioning and CI/CD pipelines; Experience with data visualization tools such as Looker, Looker Studio, or Power BI; Interest in or experience with machine learning workflows using Vertex AI or similar platforms

Условия

Thanks to our flexible working models, you start your work day when and where it fits you best. Plus, our hybrid work option lets you choose whether you prefer working more from the office or from home. Start your journey in NETCONOMY with a structured onboarding and mentoring phase and continue with individual training opportunities. Exchange professional and personal experiences at our annual in-house conference! One of the highlights of our company Summit is the vibrant networking environment it cultivates. Join our colleagues and build new connections at our social events such as pizza evenings, sports activities, Christmas parties or milestone celebrations. Fuel your productivity and taste buds with our monthly meal allowance and discounts at partner restaurants. As we take our responsibility for the environment seriously, we support your climate-friendly transportation costs.