Senior Data Engineer - Real-Time Pipelines on AWS

EPAM Systems Inc; Kraków; Hybride; PLN 180 000 - 260 000; Plein temps

Avantages offerts par ce poste

Health insurance

Employee Stock Purchase Plan

Remote work within Poland

Résumé du poste

EPAM Systems Inc is seeking a Senior Data Engineer to join an established ETF analytics platform. You will design and optimize Python data pipelines for streaming market data, integrate AWS services for ingestion and processing, and work in a small agile team to deliver reliable analytics outputs.

The role includes documentation, L3 production support, and evaluating new technologies to improve performance.

Qualifications

• 3+ years of experience in Data Software Engineering.
• Proficiency in Python development within data engineering environments, emphasizing scalable and maintainable code.
• Experience designing and implementing data lakehouse architectures and real-time streaming data pipelines.
• Experience integrating and managing AWS services (S3, ECS, EC2).
• Proficiency with Lambda, Step Functions, and EventBridge.
• Familiarity with CloudWatch and DynamoDB for monitoring and NoSQL data management.
• Ability to provide Level 3 production support and strong troubleshooting.
• Understanding of financial or banking domain concepts.

Responsabilités

• Design, develop, and optimize Python-based data pipelines with low latency.
• Integrate AWS cloud services to support ingestion, processing, storage and delivery of real-time and historical data.
• Collaborate in a small agile team of 3–5 engineers and participate in client and internal coordination.
• Produce and maintain technical documentation for knowledge transfer and system understanding.
• Provide L3 production support for incidents and root cause analysis.
• Evaluate and adopt emerging technologies to improve pipeline performance and reliability.

Connaissances

Python

Data engineering

Streaming

Scalable code

System design

Outils

AWS (S3)

ECS

EC2

Lambda

Step Functions

EventBridge

CloudWatch

DynamoDB

Description du poste

EPAM Systems Inc is seeking a Senior Data Engineer to join an established ETF analytics platform. You will design and optimize Python data pipelines for streaming market data, integrate AWS services for ingestion and processing, and work in a small agile team to deliver reliable analytics outputs.

The role includes documentation, L3 production support, and evaluating new technologies to improve performance.