Senior Data Engineer

Bpxglobal; Warszawa; On-site; PLN 180,000 - 240,000; Full time

Job summary

Bpxglobal in Warszawa is seeking an experienced Senior Data Engineer to join a long-term data initiative focused on scalable, cloud-based solutions. You will blend Python development with hands-on AWS work, building reusable data pipelines and maintaining the data platform.

Designing, implementing, and testing data pipelines using AWS services, you will troubleshoot complex issues and contribute to a broader data architecture in an agile, international team.

Qualifications

• Strong commercial experience in Data Engineering.
• 5–10 years of experience preferred.
• Advanced Python programming skills.
• Experience with AWS services and data pipelines.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data processing solutions.
• Build reusable Python modules to support different business requirements.
• Apply OOP principles for maintainable, scalable code.
• Work hands-on with AWS services (Glue, Athena, DynamoDB, Step Functions, Lambda).
• Investigate and resolve issues across existing pipelines with root-cause analysis.
• Support migrations and updates within the data platform, including testing and validation.
• Contribute to code quality through testing, version control, and CI/CD practices.
• Collaborate with developers and data specialists in an agile environment.

Skills

Data Engineering

Python

AWS

Data Pipelines

OOP

CI/CD

Agile

Troubleshooting

Distributed environments

Tools

AWS Glue

Amazon Athena

DynamoDB

AWS Step Functions

AWS Lambda

Azure DevOps

Job description

We are looking for an experiencedSenior Data Engineer to join a long-term data engineering initiative focused on building and developing scalable, cloud-based data solutions.

The role combines strong Python development with hands-on work across AWS services and data pipelines. You will be responsible for developing reusable data processing components, maintaining existing solutions, troubleshooting complex pipeline issues, and supporting the evolution of the wider data platform.

We are looking for someone who is comfortable working independently on technical challenges while collaborating closely with an agile, international team.

Details:

• Start: ASAP
• Contract: B2B
• Duration: Until the end of 2026

Key responsibilities:

Design, develop, and maintain scalable data pipelines and data processing solutions.

Build reusable and configurable modules in Python that can support different business requirements and environments.

Apply object-oriented programming (OOP) principles and modern Python engineering practices to create maintainable and scalable solutions.

Work hands-on with AWS services, including Glue, Athena, DynamoDB, Step Functions, and Lambda.

Investigate and resolve issues across existing data pipelines, including root-cause analysis and implementation of robust fixes.

Support changes and migrations within the data platform, including pipeline updates, validation, end-to-end testing, and related technical activities.

Contribute to code quality through testing, version control, CI/CD practices, and maintainable development standards.

Collaborate with developers, data specialists, and other stakeholders within an agile delivery environment.

Requirements:

Strong commercial experience in Data Engineering, ideally around 5–10 years.

Advanced Python programming skills, particularly:

pandas for data processing and manipulation,

object-oriented programming (OOP),

writing clean, reusable, and maintainable code.

Hands-on experience with AWS, particularly:

AWS Glue,

Amazon Athena,

DynamoDB,

AWS Step Functions,

AWS Lambda.

Solid experience designing, developing, and maintaining data pipelines.

Good understanding of cloud-based data architectures and data processing solutions.

Experience working in agile development environments.

Ability to independently troubleshoot and debug complex data and pipeline-related issues.

Experience working in international or distributed project environments.

Nice to have:

Experience with Veeva or similar platforms.

Previous exposure to pharmaceutical or healthcare data environments.

Experience with CI/CD, automated testing, and modern software engineering practices.

Familiarity with tools such as Azure DevOps or similar development and delivery platforms.