Senior Data Engineer: Real-Time Pipelines on AWS

EPAM Systems Inc; Gdańsk; Hybride; PLN 180 000 - 300 000; Plein temps

Avantages offerts par ce poste

Hybrid by design

Remote work in Poland

Work abroad up to 60 days yearly

Relocation opportunities

Career development

Mentoring

Well-being programs

Certifications

English classes

Stock purchase plan

Health insurance

Multisport card

Shopping vouchers

Referral bonuses

Office amenities

Well-being events

Résumé du poste

EPAM Systems Inc in Gdańsk seeks a Senior Data Engineer to join an ETF analytics platform and evolve a Python-based data pipeline on AWS. You will ingest daily market data, work with a data lakehouse architecture, and contribute to a small agile team.

The role emphasizes production support, documentation, and adopting emerging technologies to improve performance and reliability within a hybrid environment in Poland.

Qualifications

• 3+ years of experience in Data Software Engineering
• Proficiency in Python development within data engineering environments
• Expertise in designing and implementing data lakehouse architectures and real-time streaming data pipelines
• Skills in integrating and managing AWS services, including S3, ECS, and EC2
• Competency in working with Lambda, Step Functions, and EventBridge
• Familiarity with CloudWatch and DynamoDB for monitoring and NoSQL data management
• Capability to provide Level 3 production support for critical data engineering systems with strong troubleshooting abilities
• Understanding of financial or banking domain concepts, enabling effective collaboration with business stakeholders
• English proficiency at an Upper-Intermediate level (B2) or higher

Responsabilités

• Design and optimize Python data pipelines for streaming market data with low latency
• Integrate AWS services to ingest, process, store, and deliver real-time and historical data
• Collaborate in a small Agile team of 3–5 engineers for rapid, iterative development
• Attend coordination meetings with client managers and internal teams to align deliverables
• Produce and maintain technical documentation for system understanding and knowledge transfer
• Provide L3 production support, perform root-cause analysis, and implement fixes
• Evaluate and adopt new technologies to enhance pipeline performance and reliability

Connaissances

Python development

Data pipelines design

Real-time streaming

Production support

English (B2+)

Outils

AWS Lambda

AWS Step Functions

AWS EventBridge

Amazon DynamoDB

Amazon S3

Amazon ECS

Amazon EC2

CloudWatch

Description du poste

EPAM Systems Inc in Gdańsk seeks a Senior Data Engineer to join an ETF analytics platform and evolve a Python-based data pipeline on AWS. You will ingest daily market data, work with a data lakehouse architecture, and contribute to a small agile team.

The role emphasizes production support, documentation, and adopting emerging technologies to improve performance and reliability within a hybrid environment in Poland.