Data platform engineer

ING Hubs Poland; Warszawa; On-site; PLN 107,000 - 246,000; Full time

Job summary

ING Hubs Poland ищет опытного инженера данных для разработки и поддержки платформы VISTA Fallback Platform, обеспечивающей устойчивость аналитических рабочих нагрузок. Ваша работа охватит обработку данных, оркестрацию и хранение, используя Spark, Trino и Iceberg, включая репликацию и восстановление данных.

Требуется 4+ лет опыта в инженерии данных либо сопутствующих областях, знание GCP и практики CI/CD, инфраструктуры как кода.

Qualifications

• 4+ года опыта в Data Engineering, Platform Engineering, Infrastructure Engineering или SRE.
• Практические знания Spark, DBT, Python, SQL, BigQuery и Trino.
• Опыт работы с Google Cloud Platform и облачными технологиями.
• Опыт CI/CD и практики инфраструктуры как кода.
• Опыт создания современных дата- платформ и распределённых обработок.

Responsibilities

• Проектирование, сборка и поддержка платформы ING Data Analytics Fallback Platform.
• Обеспечение отказоустойчивости и доступности критических рабочих нагрузок.
• Разработка и эксплуатация решений на Spark, Airflow, Iceberg, Trino и объектного хранилища.
• Создание и поддержка процессов обработки данных, оркестрации, хранения и метаданных.
• Реализация репликации, синхронизации и восстановления для важных наборов данных.
• Оптимизация аналитических и пакетных конвейеров на современных облачных технологиях.
• Повышение наблюдаемости платформы через мониторинг и логирование.
• Обеспечение надёжности, безопасности и готовности к эксплуатации.
• Участие в архитектурных решениях, стандартам и дорожной карте.

Skills

Data Engineering

Platform Engineering

Site Reliability

CI/CD

Automation

Kubernetes

Tools

Apache Spark

DBT

Python

SQL

BigQuery

Trino

Kubernetes

Docker

Linux

Keycloak

Ceph

Ingress / Networking

Job description

Описание:

You will join a team building the VISTA (Data Analytics) Fallback Platform, a strategic initiative focused on ensuring operational resilience and business continuity for ING’s data and analytics ecosystem. The platform provides fallback capabilities for critical analytical and reporting workloads by leveraging modern lakehouse and data platform technologies. The solution is designed to enable rapid recovery and continued operation of key business processes during crisis scenarios.

Задачи:

• designing, building, and maintaining ING’s Data Analytics Fallback Platform
• creating resilient data platform capabilities that support critical business workloads during disaster recovery and fallback scenarios
• developing and operating solutions based on Apache Spark, Apache Airflow, Apache Iceberg, Trino, and object storage technologies
• building and maintaining data processing, orchestration, storage, and metadata-management capabilities
• implementing replication, synchronization, reconciliation, and recovery mechanisms for critical datasets
• building and optimizing analytical and batch-processing pipelines using modern cloud and data technologies
• improving platform observability through monitoring, logging, alerting, and operational readiness practices
• ensuring platform reliability, security, recoverability, and operational resilience
• implementing backup, restore, disaster recovery, and business continuity capabilities
• collaborating with platform, infrastructure, security, and data engineering teams across ING
• contributing to architecture decisions, engineering standards, automation initiatives, and technical roadmaps
• participating in support, operational readiness, and on-call activities where required

Требования:

• have 4+ years of experience in Data Engineering, Platform Engineering, Infrastructure Engineering, or Site Reliability Engineering
• have hands-on experience in at least one of the following domains and practical knowledge of related technologies: Data Processing & Analytics: Apache Spark, DBT, Python, SQL, BigQuery, Trino
• Data Lake & Storage: Apache Iceberg, Hive Metastore, MinIO/S3-compatible Object Storage, Google Cloud Storage
• Platform & Infrastructure: Kubernetes, Docker, Linux, Keycloak, Ceph, Ingress / Networking
• Reliability & Operations: Monitoring, Logging, Alerting, Data Replication, Backup & Restore, Disaster Recovery
• have experience building, operating, or supporting modern data platforms and distributed data processing environments
• have practical experience with Google Cloud Platform (GCP) and cloud-native technologies
• have experience with automation, CI/CD, and infrastructure-as-code practices
• Будет плюсом: Airflow-based orchestration platforms
• Keycloak, Ceph, or enterprise-scale platform services
• designing and operating large-scale data platforms
• disaster recovery, business continuity, or fallback solutions
• modern lakehouse architectures based on Apache Iceberg
• data replication and synchronization at scale
• migrating workloads between cloud and on-premise environments

Условия:

senior specialist position: 9600 - 22 000 PLN expert position: 13 000 - 28 000 PLN The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.