Senior Data Engineer

BPX S.A.; Warszawa; On-site; PLN 180,000 - 240,000; Full time

Job summary

BPX S.A. in Warsaw seeks an experienced Senior Data Engineer to lead the design and development of scalable, cloud-based data solutions. The role combines Python development with hands-on work across AWS services, building reusable data processing components and maintaining the data platform.

You will collaborate in an agile, international team, troubleshoot complex pipelines, and contribute to deployment and testing practices.

Qualifications

• Strong commercial experience in Data Engineering (5–10 years).
• Advanced Python skills with Pandas for data processing.
• Hands-on AWS experience including Glue, Athena, DynamoDB, Step Functions, Lambda.
• Solid experience designing and maintaining data pipelines.
• Familiarity with cloud data architectures and agile environments.
• Ability to troubleshoot complex data and pipeline issues independently.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data processing solutions.
• Build reusable Python modules to support various business requirements.
• Apply OOP and modern Python practices for maintainable code.
• Work hands-on with AWS services (Glue, Athena, DynamoDB, Step Functions, Lambda).
• Investigate issues across pipelines and implement robust fixes.
• Support migrations and testing within the data platform.
• Contribute to code quality through testing, version control, and CI/CD.

Skills

Python

Pandas

OOP

AWS

Data pipelines

Agile

Tools

AWS Glue

Amazon Athena

DynamoDB

Step Functions

AWS Lambda

Job description

Role overview

We are looking for an experienced Senior Data Engineer to join a long-term data engineering initiative focused on building and developing scalable, cloud-based data solutions.

The role combines strong Python development with hands-on work across AWS services and data pipelines. You will be responsible for developing reusable data processing components, maintaining existing solutions, troubleshooting complex pipeline issues, and supporting the evolution of the wider data platform.

We are looking for someone who is comfortable working independently on technical challenges while collaborating closely with an agile, international team.

Key responsibilities

• Design, develop, and maintain scalable data pipelines and data processing solutions.
• Build reusable and configurable modules in Python that can support different business requirements and environments.
• Apply object-oriented programming (OOP) principles and modern Python engineering practices to create maintainable and scalable solutions.
• Work hands-on with AWS services, including Glue, Athena, DynamoDB, Step Functions, and Lambda.
• Investigate and resolve issues across existing data pipelines, including root-cause analysis and implementation of robust fixes.
• Support changes and migrations within the data platform, including pipeline updates, validation, end-to-end testing, and related technical activities.
• Contribute to code quality through testing, version control, CI/CD practices, and maintainable development standards.
• Collaborate with developers, data specialists, and other stakeholders within an agile delivery environment.

Requirements

• Strong commercial experience in Data Engineering, ideally around 5–10 years.
• Advanced Python programming skills, particularly:
• pandas for data processing and manipulation,
• object-oriented programming (OOP),
• writing clean, reusable, and maintainable code.
• Hands-on experience with AWS, particularly:
• AWS Glue,
• Amazon Athena,
• DynamoDB,
• AWS Step Functions,
• AWS Lambda.
• Solid experience designing, developing, and maintaining data pipelines.
• Good understanding of cloud-based data architectures and data processing solutions.
• Experience working in agile development environments.
• Ability to independently troubleshoot and debug complex data and pipeline-related issues.
• Experience working in international or distributed project environments.

Nice to have

• Experience with Veeva or similar platforms.
• Previous exposure to pharmaceutical or healthcare data environments.
• Experience with CI/CD, automated testing, and modern software engineering practices.
• Familiarity with tools such as Azure DevOps or similar development and delivery platforms.