Senior Data Engineer - Scalable Data Platforms & ML

Poland and Eastern Europe; Town of Poland (NY); On-site; USD 81,000 - 110,000; Full time

Job summary

Xebia is a global AI-first, digital transformation, and engineering partner. A remote EU role focuses on building and maintaining scalable data platforms and pipelines, collaborating with data scientists, analysts, and engineering teams.

As a Data Engineer, you will implement reliable ingestion pipelines, optimize complex ETL processes, and contribute to ML platform initiatives across cloud environments (GCP/AWS/Azure). Strong Spark/Scala and Python skills are essential.

Qualifications

• 3+ years of experience in data engineering.
• Hands-on experience building, scaling, and operating production-grade data platforms or data infrastructure, including reliability, observability, performance, and self-service capabilities.
• Experience with an orchestration tool such as Airflow.
• Experience working with large data sets and building complex ETL pipelines.
• Experience with cloud providers such as GCP, AWS, or Azure.
• Strong programming skills in Spark (Scala) and Python.
• Experience with CI/CD tools like Jenkins and Git.

Responsibilities

• Maintaining an ingestion pipeline processing billions of events daily against a defined SLA.
• Supporting teams that build and optimize complex data pipelines.
• Identifying platform problems with other engineering teams.
• Developing tools and frameworks for the data platform.
• Supporting data scientists and analysts with production workloads.
• Contributing to ML-platform and streaming initiatives.
• Establishing software-engineering and data-development practices.

Skills

Data engineering

Spark

Python

Airflow

CI/CD

Git

Problem solving

Communication

Tools

Airflow

Jenkins

Git

BigQuery

Redshift

Job description

Xebia is a global AI-first, digital transformation, and engineering partner. A remote EU role focuses on building and maintaining scalable data platforms and pipelines, collaborating with data scientists, analysts, and engineering teams.

As a Data Engineer, you will implement reliable ingestion pipelines, optimize complex ETL processes, and contribute to ML platform initiatives across cloud environments (GCP/AWS/Azure). Strong Spark/Scala and Python skills are essential.