Data platform engineer

Zoolatech; Wrocław; Presencial; PLN 250.000 - 420.000; Jornada completa

Descripción de la vacante

Zoolatech in Wrocław seeks a Data Engineer to join the Orchestration Team, developing self-service data platforms that enable engineers, data scientists, and analysts to run ETL/ELT workflows across Kafka, S3, GCS, BigQuery, and Postgres. You will design scalable pipelines, implement IaC with Terraform, and collaborate with onshore/offshore teams to ensure robust governance and data lineage.

Experience with Airflow, Kubernetes, Looker/LookML, and cloud data services (GCP preferred) is essential.

Formación

• Proficient in SQL and data modeling for large-scale data platforms.
• Strong Python programming for ETL/ELT automation and CLI/services.
• Experience building data pipelines with Airflow or similar orchestrators.
• Hands-on with cloud data platforms, preferably GCP (BigQuery, Dataproc Serverless, GCS).
• Infrastructure as Code experience with Terraform for data infra provisioning.

Responsabilidades

• Develop and maintain self-service data platforms for engineers, data scientists, and analysts to run ETL/ELT workflows.
• Provide production support and on-call coverage; collaborate with onshore/offshore teams to resolve incidents.
• Build and manage cloud data infrastructure declaratively (Terraform).
• Integrate diverse data sources/destinations (Kafka, S3/GCS, BigQuery, Postgres) for batch/real-time pipelines.
• Implement metadata, data lineage, and governance capabilities across platforms.
• Ensure scalable, resilient architectures handling high data volumes and velocity.
• Stay current with big data, ETL, and AI-assisted tooling to enhance the framework.

Conocimientos

SQL

Python

Airflow

Kubernetes

Terraform

BigQuery

GCS

Dataproc Serverless

Looker/LookML

CI/CD & GitHub Actions

Kafka

Data governance

Data pipelines

AI-assisted tooling

Herramientas

Looker

Terraform

Airflow

Kubernetes

BigQuery

Descripción del empleo

Our partner is one of the largest retail e-commerce companies in North America, serving millions of customers each year and ensuring a secure and seamless shopping experience across digital and in‑store channels.

We are looking for skilled and motivated engineer Data engineer to join the innovative team.

The Orchestration team manages platforms within Insights Delivery Technology organization and offers self‑service solutions designed to empower engineers, data scientists, and analysts to seamlessly perform ETL/ELT operations on data from diverse sources such as Kafka, S3, GCS, BigQuery, and Postgres, and write processed data back to these sources via batch or real‑time processes. Increasingly, the team also owns the metadata, governance, and data‑lineage layer that makes this data discoverable and trustworthy across the company.

As an Orchestration Team Engineer, you will play a critical role in developing and maintaining this robust platform, ensuring that users can efficiently extract actionable insights without being burdened by the complexities of big data technologies. Your work will enable the client to scale its operations while keeping technical demands on non‑engineering staff to a minimum.

• Platform Development: Evolve, design, and maintain our orchestration platforms which aim to abstract the complexities of big data technologies and simplify ETL/ELT operations for users
• Platform Support: Perform ongoing production support and on‑call support duties. Work with both onsite and offshore resources daily to resolve incidents and issues.
• Infrastructure as Code: Provision and manage cloud data infrastructure declaratively with Terraform, delivering self‑service platform capabilities through automated, version‑controlled pipelines.
• Integration: Develop seamless connectivity to diverse data sources and destinations, ensuring high performance and reliability.
• Data Governance & Metadata: Build and operate metadata, cataloging, and data‑lineage capabilities that make data across Nordstrom discoverable, trustworthy, and well‑governed — including integrations across transformation, streaming, BI, and ML platforms.
• Scalability: Design solutions that are scalable and resilient, capable of handling large data volumes, high velocity, and diverse data formats.
• Innovation: Stay up-to-date with emerging big data, ETL, and AI‑assisted tooling, incorporating them into the framework as needed to enhance functionality and user experience.
• Documentation: Create and maintain comprehensive documentation, ensuring users can easily understand and utilize the framework
• Experience building, developing, and maintaining data platforms, particularly self‑service platforms that enable engineering teams, data scientists, and analysts to configure and manage data processing workflows with minimal manual intervention.
• Proficiency in SQL (e.g., BigQuery).
• Solid understanding of ETL/ELT processes, data pipeline architecture, and modern transformation frameworks such as dbt.
• Strong programming skills in Python, with the ability to build and maintain CLIs, services, and automation.
• Experience with cloud data platforms, primarily GCP (BigQuery, Dataproc Serverless, GCS); AWS experience a plus.
• Experience with Infrastructure as Code — particularly Terraform — for provisioning and managing cloud data infrastructure.
• Experience building and orchestrating data pipelines with Airflow and Kubernetes.
• Experience with streaming / event data using Kafka (e.g., Confluent Cloud).
• Working understanding of data governance concepts — metadata management, data cataloging, and data lineage.
• Familiarity with CI/CD and Git‑based workflows (GitHub Actions) for platform and pipeline delivery.
• Proficiency with AI‑assisted developer tooling — LLMs, the Model Context Protocol (MCP), and "copilot"-style productivity tools — and a track record of using them to work more effectively.
• Excellent problem‑solving and communication skills, with the ability to work effectively in a collaborative environment.

Nice to Have

• Hands‑on experience with a metadata / data‑catalog / lineage platform such as DataHub (or Collibra, Amundsen, or similar).
• Experience with BI / semantic‑layer tools such as Looker / LookML.
• Experience with data quality, observability, SLOs / error budgets, and on‑call operations for data platforms.
• Familiarity with distributed processing frameworks such as Spark; Java / Scala a plus.

Explore similar open positions that match your experience.