Senior Data Engineer

Poland and Central-Eastern Europe; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Xebia is a global AI-first, digital transformation, and engineering partner. We are seeking a data engineer to maintain ingestion pipelines handling billions of events daily, support data teams, and help optimize data platforms across cloud environments.

Ideal candidates have 3+ years in data engineering, strong Spark/Scala/Python skills, experience with Airflow, CI/CD, and cloud providers (GCP/AWS/Azure). EU work permit is required for work from the EU region.

Qualifications

• 3+ years of experience in data engineering.
• Hands-on experience building, scaling, and operating production-grade data platforms or data infrastructure, including reliability, observability, performance, and self-service capabilities.
• “Experience working with an orchestration tool (ex, Airflow)”
• “Experience working with a large data set”
• “Experience building complex ETL pipelines”
• “Experience working with cloud providers such as GCP, AWS, or Azure”
• “Strong programming skills in Spark with Scala and Python”
• “Experience working with CI/CD tools like Jenkins and Git”
• “Strong understanding of Software Engineering practices and principles”
• “Excellent problem-solving and communication skills”
• “Self-motivated and have a proven ability to take the initiative to own the problems that come up and solve them”

Responsibilities

• Maintaining an ingestion pipeline processing billions of events daily against a defined SLA
• Supporting teams that build and optimize complex data pipelines
• Identifying platform problems with other engineering teams
• Developing tools and frameworks for the data platform
• Supporting data scientists and analysts with production workloads
• Contributing to ML-platform and streaming initiatives
• Establishing software-engineering and data-development practices

Skills

Data engineering

Production data platforms

Problem-solving

Communication

Tools

Spark

Scala

Python

Airflow

Jenkins

Git

Kubernetes

BigQuery

Redshift

Job description

Xebia is a global AI-first, digital transformation, and engineering partner.With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions.

We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products, combining deep technical expertise with a strong focus on engineering excellence and a people-first culture.

In the CEE region, we’re a team of nearly 1,000 experts delivering modern applications, data platforms, and AI solutions for clients such as McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, InPost, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing.

You will be:

• Maintaining an ingestion pipeline processing billions of events daily against a defined SLA
• Supporting teams that build and optimize complex data pipelines
• Identifying platform problems with other engineering teams
• Developing tools and frameworks for the data platform
• Supporting data scientists and analysts with production workloads
• Contributing to ML-platform and streaming initiatives
• Establishing software-engineering and data-development practices

Your profile:

• 3+ years of experience in data engineering

• Hands-on experience building, scaling, and operating production-grade data platforms or data infrastructure, including reliability, observability, performance, and self-service capabilities.

• Experience working with an orchestration tool (ex, Airflow)

• Experience working with a large data set

• Experience building complex ETL pipelines

• Experience working with cloud providers such as GCP, AWS, or Azure

• Strong programming skills in Spark with Scala and Python

• Experience working with CI/CD tools like Jenkins and Git

• Strong understanding of Software Engineering practices and principles

• Excellent problem-solving and communication skills

• Self-motivated and have a proven ability to take the initiative to own the problems that come up and solve them

Work from the European Union region and a work permit are required.

Nice to have:

• Kafka or another messaging system

• Kubernetes

• Streaming platforms

• BigQuery or Redshift data-warehouse administration

Recruitment Process:

CV review – HR call – Interview – Client Interview – Decision