Senior Data Engineer: Kafka & AWS Data Pipelines

Aviva; Warszawa; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Performance Bonus

Private medical care

Cafeteria benefits

MultiSport card

Employee Shares Plan

Extra day off for birthday

Wellbeing Leave

Hybrid working Poland

Job summary

Aviva Services Excellence Centre in Warsaw is seeking a (Senior) Data Engineer to design, build and operate scalable data ingestion and transformation pipelines that power the enterprise ODS in a cloud-native AWS environment. You will work with Kafka/MSK, AWS Glue and Python-based services to deliver reliable, high-quality data pipelines.

Join a team collaborating with leads, architects and domain SMEs to onboard new data domains, ensure data quality and enable trusted business data across the

Qualifications

• Strong experience in Data Engineering (Senior over 5 years, regular over 3 years).
• Experience with Kafka or event-driven architectures.
• Hands-on experience with AWS services including: AWS Glue, S3, ECS, MSK , Aurora/PostgreSQL
• Experience building ETL/ELT pipelines.
• Good understanding of data modelling concepts.
• Experience working with JSON, Avro and schema-based integrations.
• Familiarity with CI/CD and DevOps practices.
• Knowledge of data quality and data validation techniques.
• Experience with Apache Kafka/MSK.
• Experience with CDC technologies such as Debezium.
• Knowledge of metadata-driven data platforms.
• Experience working within Financial Services or Insurance organisations.

Responsibilities

• Building and maintaining scalable data pipelines using Kafka/MSK, AWS Glue, Python and PySpark.
• Designing and implementing ingestion, transformation, validation and publishing processes.
• Delivering end-to-end Operational Data Store (ODS) data flows integrating APIs, event streams and batch sources.
• Developing reusable frameworks, metadata-driven solutions and onboarding patterns across business domains.
• Ensuring data quality, integrity, traceability and adherence to enterprise data models and standards.
• Writing clean, testable and maintainable code while participating in code reviews and technical discussions.
• Supporting CI/CD pipelines, monitoring, logging and operational excellence initiatives.
• Identifying opportunities to improve platform performance, scalability and reliability.
• Collaborating with Product Owners, Architects, Domain SMEs and engineering teams to deliver business outcomes.
• Contributing to technical documentation, design artefacts and domain onboarding activities.

Tools

Kafka

S3

ECS

Aurora/PostgreSQL

Python

PySpark

ETL/ELT

Data modeling

CI/CD

DevOps

Job description

Aviva Services Excellence Centre in Warsaw is seeking a (Senior) Data Engineer to design, build and operate scalable data ingestion and transformation pipelines that power the enterprise ODS in a cloud-native AWS environment. You will work with Kafka/MSK, AWS Glue and Python-based services to deliver reliable, high-quality data pipelines.

Join a team collaborating with leads, architects and domain SMEs to onboard new data domains, ensure data quality and enable trusted business data across the