Senior Data Engineer (AWS) - Data Pipelines & Cloud

Xebia Group; Poland; Remote; USD 95,000 - 130,000; Full time

Job summary

Xebia Group is seeking a Data Engineer to design and maintain scalable batch and real-time data pipelines in a cloud-first environment. You will build ELT workflows using Python, SQL, and dbt, and manage AWS data infrastructure like S3, Glue, Lambda, and Redshift.

You will work with streaming technologies (Kafka, Spark) and orchestration tools (Airflow), ensuring reliability and performance of production data pipelines across teams. Fluency in English is required.

Qualifications

• 3+ years of professional experience in data engineering or a related technical role.
• Hands-on experience with AWS and cloud-based data platforms.
• Strong SQL and data modelling skills.
• Experience with production-scale data warehouses such as Amazon Redshift, Snowflake, or BigQuery.
• Proven experience with Python, dbt, and Apache Airflow.
• Familiarity with Kafka, Spark, and Apache NiFi.
• Experience with Docker and Kubernetes.
• Strong analytical, problem-solving, communication, and collaboration skills.
• Comfortable working with large and complex datasets in production environments.
• Excellent English skills and ability to communicate with international teams.
• Proactive mindset and focus on continuous improvement.

Responsibilities

• Designing, developing, and maintaining scalable batch and real-time data pipelines.
• Building ELT workflows and data transformations using Python, SQL, and dbt.
• Developing and maintaining cloud-based data infrastructure on AWS, including S3, Glue, Lambda, and Redshift.
• Implementing data orchestration and scheduling using Apache Airflow or Amazon MWAA.
• Working with streaming and big data technologies such as Kafka, Spark, and Apache NiFi.
• Ensuring reliability, performance, scalability, and quality of production data pipelines.
• Collaborating with data architects, product teams, analysts, IT teams, and business stakeholders to deliver scalable data solutions.
• Contributing to data security, governance, monitoring, automation, and continuous improvement.
• Participating in a scheduled on-call rotation to support the reliability of the data platform.

Skills

SQL

Data modelling

Python

Apache Airflow

Kafka

Spark

NiFi

Docker

Kubernetes

English communication

Tools

Amazon Redshift

Snowflake

BigQuery

dbt

Airflow

AWS

S3

Job description

Xebia Group is seeking a Data Engineer to design and maintain scalable batch and real-time data pipelines in a cloud-first environment. You will build ELT workflows using Python, SQL, and dbt, and manage AWS data infrastructure like S3, Glue, Lambda, and Redshift.

You will work with streaming technologies (Kafka, Spark) and orchestration tools (Airflow), ensuring reliability and performance of production data pipelines across teams. Fluency in English is required.