Senior Data Engineer — Scalable Data Platforms & ML

Poland and Central-Eastern Europe; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Xebia is a global AI-first, digital transformation, and engineering partner. We are seeking a data engineer to maintain ingestion pipelines handling billions of events daily, support data teams, and help optimize data platforms across cloud environments.

Ideal candidates have 3+ years in data engineering, strong Spark/Scala/Python skills, experience with Airflow, CI/CD, and cloud providers (GCP/AWS/Azure). EU work permit is required for work from the EU region.

Qualifications

• 3+ years of experience in data engineering.
• Hands-on experience building, scaling, and operating production-grade data platforms or data infrastructure, including reliability, observability, performance, and self-service capabilities.
• “Experience working with an orchestration tool (ex, Airflow)”
• “Experience working with a large data set”
• “Experience building complex ETL pipelines”
• “Experience working with cloud providers such as GCP, AWS, or Azure”
• “Strong programming skills in Spark with Scala and Python”
• “Experience working with CI/CD tools like Jenkins and Git”
• “Strong understanding of Software Engineering practices and principles”
• “Excellent problem-solving and communication skills”
• “Self-motivated and have a proven ability to take the initiative to own the problems that come up and solve them”

Responsibilities

• Maintaining an ingestion pipeline processing billions of events daily against a defined SLA
• Supporting teams that build and optimize complex data pipelines
• Identifying platform problems with other engineering teams
• Developing tools and frameworks for the data platform
• Supporting data scientists and analysts with production workloads
• Contributing to ML-platform and streaming initiatives
• Establishing software-engineering and data-development practices

Skills

Data engineering

Production data platforms

Problem-solving

Communication

Tools

Spark

Scala

Python

Airflow

Jenkins

Git

Kubernetes

BigQuery

Redshift

Job description

Xebia is a global AI-first, digital transformation, and engineering partner. We are seeking a data engineer to maintain ingestion pipelines handling billions of events daily, support data teams, and help optimize data platforms across cloud environments.

Ideal candidates have 3+ years in data engineering, strong Spark/Scala/Python skills, experience with Airflow, CI/CD, and cloud providers (GCP/AWS/Azure). EU work permit is required for work from the EU region.