Senior Data Engineer

Poland and Eastern Europe; Town of Poland (NY); On-site; USD 81,000 - 110,000; Full time

Job summary

Xebia is a global AI-first, digital transformation, and engineering partner. A remote EU role focuses on building and maintaining scalable data platforms and pipelines, collaborating with data scientists, analysts, and engineering teams.

As a Data Engineer, you will implement reliable ingestion pipelines, optimize complex ETL processes, and contribute to ML platform initiatives across cloud environments (GCP/AWS/Azure). Strong Spark/Scala and Python skills are essential.

Qualifications

• 3+ years of experience in data engineering.
• Hands-on experience building, scaling, and operating production-grade data platforms or data infrastructure, including reliability, observability, performance, and self-service capabilities.
• Experience with an orchestration tool such as Airflow.
• Experience working with large data sets and building complex ETL pipelines.
• Experience with cloud providers such as GCP, AWS, or Azure.
• Strong programming skills in Spark (Scala) and Python.
• Experience with CI/CD tools like Jenkins and Git.

Responsibilities

• Maintaining an ingestion pipeline processing billions of events daily against a defined SLA.
• Supporting teams that build and optimize complex data pipelines.
• Identifying platform problems with other engineering teams.
• Developing tools and frameworks for the data platform.
• Supporting data scientists and analysts with production workloads.
• Contributing to ML-platform and streaming initiatives.
• Establishing software-engineering and data-development practices.

Skills

Data engineering

Spark

Python

Airflow

CI/CD

Git

Problem solving

Communication

Tools

Airflow

Jenkins

Git

BigQuery

Redshift

Job description

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions.

We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products, combining deep technical expertise with a strong focus on engineering excellence and a people-first culture.

In the CEE region, we’re a team of nearly 1,000 experts delivering modern applications, data platforms, and AI solutions for clients such as McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, InPost, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing.

You will be:

• Maintaining an ingestion pipeline processing billions of events daily against a defined SLA
• Supporting teams that build and optimize complex data pipelines
• Identifying platform problems with other engineering teams
• Developing tools and frameworks for the data platform
• Supporting data scientists and analysts with production workloads
• Contributing to ML-platform and streaming initiatives
• Establishing software-engineering and data-development practices

Your profile:

3+ years of experience in data engineering

• Hands-on experience building, scaling, and operating production-grade data platforms or data infrastructure, including reliability, observability, performance, and self-service capabilities.

Experience working with an orchestration tool (ex, Airflow)

Experience working with a large data set

Experience building complex ETL pipelines

Experience working with cloud providers such as GCP, AWS, or Azure

Strong programming skills in Spark with Scala and Python

Experience working with CI/CD tools like Jenkins and Git

Strong understanding of Software Engineering practices and principles

Excellent problem-solving and communication skills

Self-motivated and have a proven ability to take the initiative to own the problems that come up and solve them

Work from the European Union region and a work permit are required.

Nice to have:

• Kafka or another messaging system
• Streaming platforms
• BigQuery or Redshift data-warehouse administration

Recruitment Process:

CV review - HR call - Interview - Client Interview - Decision