(Senior) Data Engineer with Kafka

Aviva plc; Warszawa; Hybrid; PLN 120,000 - 170,000; Full time

Benefits offered by this job

Performance Bonus

Private medical care (ENEL-MED)

Cafeteria benefits (MultiSport)

Hybrid working model from Poland

Job summary

Aviva Services Excellence Centre in Warsaw is seeking a Senior Data Engineer to design, build and support scalable data ingestion and transformation pipelines powering the enterprise ODS. You will work in a cloud-native AWS environment, using Kafka/MSK, AWS Glue and Python-based services.

You will collaborate with Tech Leads, Solution Architects and Domain Teams to onboard new data domains, ensuring data quality and reliability while delivering scalable data solutions.

Qualifications

• Senior Data Engineer with 5+ years in data engineering.
• Experience with Kafka or event-driven architectures.
• Hands-on AWS experience (Glue, S3, ECS, MSK, Aurora/PostgreSQL).
• Strong Python development and ETL/ELT pipeline building.

Responsibilities

• Build and maintain scalable data pipelines using Kafka/MSK, AWS Glue, Python and PySpark.
• Design ingestion, transformation, validation and publishing processes for the ODS.
• Develop reusable frameworks and onboarding patterns across domains.
• Ensure data quality, integrity, and traceability with enterprise data models.

Skills

Data engineering

Python

PySpark

CI/CD

AWS

Tools

Kafka/MSK

AWS Glue

S3

Aurora/PostgreSQL

ECS

Job description

Hi, we're glad you're here! We are hiring to our Aviva Services Excellence Centre! Take a look at our job description - maybe it suits you or one of your friends? As a (Senior) Data Engineer you will be responsible for designing, building and supporting scalable data ingestion and transformation pipelines that power the enterprise Operational Data Store (ODS). You will work within a cloud-native AWS environment, developing event-driven data solutions using Kafka (MSK), AWS Glue and Python-based engineering services. You will collaborate closely with Technical Leads, Solution Architects, API Engineers and Domain Teams to onboard new data domains into the ODS platform using reusable, metadata-driven patterns and enterprise data standards. This role focuses on delivering high-quality, reliable and scalable data pipelines that enable trusted business data across the organisation.

What will you be doing?

Building and maintaining scalable data pipelines using Kafka/MSK, AWS Glue, Python and PySpark. Designing and implementing ingestion, transformation, validation and publishing processes. Delivering end-to-end Operational Data Store (ODS) data flows integrating APIs, event streams and batch sources. Developing reusable frameworks, metadata-driven solutions and onboarding patterns across business domains. Ensuring data quality, integrity, traceability and adherence to enterprise data models and standards. Writing clean, testable and maintainable code while participating in code reviews and technical discussions. Supporting CI/CD pipelines, monitoring, logging and operational excellence initiatives. Identifying opportunities to improve platform performance, scalability and reliability. Collaborating with Product Owners, Architects, Domain SMEs and engineering teams to deliver business outcomes. Contributing to technical documentation, design artefacts and domain onboarding activities.

What we’re looking for?

Essential Strong experience in Data Engineering (Senior over 5 years, regular over 3 years). Experience with Kafka or event-driven architectures. Hands‑on experience with AWS services including: AWS Glue, S3, ECS, MSK , Aurora/PostgreSQL Strong Python development skills. Experience building ETL/ELT pipelines. Good understanding of data modelling concepts. Experience working with JSON, Avro and schema-based integrations. Familiarity with CI/CD and DevOps practices. Knowledge of data quality and data validation techniques. Desirable Experience with Apache Kafka/MSK. Experience with CDC technologies such as Debezium. Knowledge of metadata-driven data platforms. Experience working within Financial Services or Insurance organisations.

In Aviva Services Excellence Centre, we provide:

• Contract of employment
• Performance Bonus
• Private medical care (ENEL-MED)
• Cafeteria system of benefits (e.g. MultiSport card)
• Additional parent privileges: baby leave – 6 weeks leave for second parent
• Additional parent privileges: shortened working time after parental leave
• Employer‑funded group insurance
• Employee Shares Plan
• Extra day off for birthday
• Paid time off to volunteer
• Additional leave acquired over the years in the company (even 5 days more in a year)
• Wellbeing Leave - additional two weeks paid leave after 10 years of service
• Psychological support consultations
• Access to the e‑learning platforms
• Internal employee referral program
• Hybrid working model from Poland with a few days in Warsaw office per month
• Attractive office location in Warsaw - Gdański Business Center
• Additional entitlements for people with disabilities - Work Without Barriers
• Work environment that promotes diversity - Diversity Charter

Do you see yourself in Aviva Services Excellence Centre?

As a signatory to the Diversity Charter, Aviva applies a policy of equal treatment and creates a work environment that is friendly to people with disabilities.

We do not require from candidates the date of birth, marital status and attached photos to your CV. Most of our people are smart working – spending also time in our office - combining the benefits of flexibility, with time together with colleagues.

We’re inclusive - we welcome applications from people with diverse backgrounds and experiences.

Excited but not sure you tick every box? Research tells us that women, particularly, feel this way. So, regardless of gender, we encourage you to consider this role.

Aviva is for everyone! We’ve been ranked the #1 Best Workplace in Poland for a second year in a row and a top choice for Millennials by Great Place to Work! As a signatory to the Diversity Charter, Aviva applies a policy of equal treatment and creates a work environment that is friendly to people with disabilities. Most of our people are smart working – spending also time in our office - combining the benefits of flexibility, with time together with colleagues. We’re inclusive - we welcome applications from people with diverse backgrounds and experiences.

We help our 19.5 million customers to save for the future and manage the risks of everyday life. To give these customers the best possible products and service we know we must make Aviva the most attractive choice for talented, entrepreneurial people with diverse backgrounds and an evolving range of expertise and insight. So, we’re passionate about helping our 23,000 people to do the best work of their lives, to enable them to make a positive difference to the lives of our customers.