Data engineer in ML platforms

Flink; Berlin; On-site; EUR 62,000 - 75,000; Full time

Benefits offered by this job

26 дней отпуска

Ежегодный бюджет на обучение

Годовой бюджет на мобильную связь

Система корпоративных скидок

Байк-лизинг

Пенсионные программы

Prosus Academy

Urban Sports Club скидки

Скидка на Flink заказы

Современный офис в Берлине

Job summary

Flink ищет Data Engineer для развития Data Platform и ML Platform. Роль предполагает работу в современной инженерной среде на базе Google Cloud Platform в центральной команде Data Platform.

Кандидат будет развивать конвейеры данных, обеспечивать качество и наблюдаемость данных, а также внедрять инфраструктуру как код. Английский язык обязателен; приветствуется опыт с dbt, Kubernetes и стримингом.

Qualifications

• 3+ лет опыта в Data Engineering или схожей роли.
• Сильные навыки Python и SQL, работа с пайплайнами данных и REST API.
• Опыт Apache Airflow и решений Google Cloud Platform: BigQuery, Pub/Sub, Cloud Storage.
• Опыт CI/CD и Infrastructure as Code (Terraform или Config Connector).
• Использование AI-лат разработки инструментов в повседневной работе.

Responsibilities

• Строить и развивать пайплайны и сервисы для обработки данных (пакетная и стриминг-обработка).
• Работать с BigQuery, Pub/Sub и Python для загрузки и трансформации данных.
• Обеспечивать качество данных, мониторинг и оповещения в рамках платформы.
• Сотрудничать с Data Scientists, аналитиками и продакт-менеджерами.

Skills

Python

SQL

REST APIs

Apache Airflow

BigQuery

Pub/Sub

Cloud Storage

Terraform

Config Connector

CI/CD

dbt

Kubernetes

Streaming

AI coding tools

English communication

Tools

dbt

Kubernetes

Terraform

Config Connector

Job description

Описание

In your role as Data Engineer (m/f/d), you will play a key role in building and enhancing the Data Platform & ML Platform of Flink. You will find yourself in a modern Data Engineering environment, working in the central Data Platform team, using state-of-the-art technologies hosted on Google Cloud Platform.

Задачи

Work closely with other Data Engineers, Data Scientists, Analysts, Product Managers and Operations professionals to build and run the data products and pipelines that contribute to the efficiency of the business Build and evolve the services and pipelines that ingest, transform and process data from internal and external systems (batch and streaming) into BigQuery, using Python, Airflow, dbt and Pub/Sub Contribute to a robust data quality and observability framework over our data products, and help keep critical data complete and reliable through monitoring, alerting and an on-duty rotation Evolve our Data Platform infrastructure as code (Terraform on GCP), including access control, cost-efficient BigQuery design and GDPR compliance Use and build AI tooling (AI coding agents, skills, MCP servers) that speeds up our own work and enables other teams to use the Data Platform self-serve

Требования

• 3+ years of experience in a Data Engineering or data-centric Software Engineering role (more for senior level)
• Strong Python and SQL skills, especially in the context of building data pipelines and interacting with REST APIs, (non-)relational databases etc.
• Hands-on experience with Apache Airflow for orchestrating data workloads
• Hands-on experience with (Google) Cloud Platform data solutions and services, such as BigQuery, Pub/Sub and Cloud Storage
• Experience with CI/CD and Infrastructure as Code (Terraform or Config Connector)
• You use AI coding tools (e.g. Claude Code, Codex) in your daily work and are excited to push how AI changes data engineering
• Passionate problem solver, able to think independently and proactively to find solutions
• Very good communication skills in English (spoken & written)
• Будет плюсом: dbt, Kubernetes and streaming are a plus

Условия

• The base pay for this position is 62,000.00 - 75, 000.00 EUR gross for full time (40 hours per week).
• A €1000 annual L&D budget as well as individual coaching options to ensure you have plenty of opportunities to learn, grow and achieve your goals
• 26 days of vacation, +1 day every year up to a maximum of 30 days
• A mobility budget of 35 EUR per month for Deutschland Ticket subsidy
• A discount on your Urban Sports Club membership
• Bike leasing through JobRad
• Attractive company pension options
• Unlimited access to an e-learning and development platform, Prosus Academy, including online German courses
• Online discounts with Corporate Benefits and Future Bens
• A cool discount off your personal Flink orders; be the first to test out new products!
• A modern and dog-friendly office in the heart of Berlin - lots of delicious lunch spots available within short walking distance