Senior Data Engineer: Scale Pipelines & ML Platforms

JobCubby; Poland; Remote; PLN 180,000 - 240,000; Full time

Job summary

Xebia is hiring a data engineer to maintain billions-scale ingestion pipelines and support teams building complex data platforms. You will implement ETL pipelines, contribute to ML-platform initiatives, and uphold engineering practices across production workloads.

We expect 3+ years in data engineering, strong skills in Spark/Scala/Python, and experience with Airflow, CI/CD, and cloud providers. The role emphasizes reliability, observability, and proactive problem solving.

Qualifications

• 3+ years of experience in data engineering.
• Hands-on experience building, scaling, and operating production-grade data platforms or data infrastructure.
• Experience with orchestration tools (e.g., Airflow).
• Experience with large data sets and building complex ETL pipelines.
• Experience with cloud providers such as GCP, AWS, or Azure.
• Strong programming skills in Spark with Scala and Python.
• Experience with CI/CD tools like Jenkins and Git.
• Strong understanding of Software Engineering practices and principles.
• Excellent problem-solving and communication skills.
• Self-motivated and proactive in owning problems and solving them.

Responsibilities

• Maintaining an ingestion pipeline processing billions of events daily against a defined SLA
• Supporting teams that build and optimize complex data pipelines
• Identifying platform problems with other engineering teams
• Developing tools and frameworks for the data platform
• Supporting data scientists and analysts with production workloads
• Contributing to ML-platform and streaming initiatives
• Establishing software-engineering and data-development practices

Skills

Data engineering

Production data pipelines

Airflow

Large data sets

ETL pipelines

Cloud platforms (GCP/AWS/Azure)

Spark

Scala

Python

CI/CD tools

Jenkins

Git

Software engineering practices

Problem solving

Communication

Initiative / ownership

Tools

Airflow

Jenkins

Git

CI/CD

Job description

Xebia is hiring a data engineer to maintain billions-scale ingestion pipelines and support teams building complex data platforms. You will implement ETL pipelines, contribute to ML-platform initiatives, and uphold engineering practices across production workloads.

We expect 3+ years in data engineering, strong skills in Spark/Scala/Python, and experience with Airflow, CI/CD, and cloud providers. The role emphasizes reliability, observability, and proactive problem solving.