Senior Data Engineer (Python, AWS)

EPAM Systems; Gdańsk; Hybride; PLN 180 000 - 300 000; Plein temps

Avantages offerts par ce poste

Hybrid by design

Remote work in Poland

Work abroad up to 60 days yearly

Relocation opportunities

Career development

Mentoring

Well-being programs

Certifications

English classes

Stock purchase plan

Health insurance

Multisport card

Shopping vouchers

Referral bonuses

Office amenities

Well-being events

Résumé du poste

EPAM Systems Inc in Gdańsk seeks a Senior Data Engineer to join an ETF analytics platform and evolve a Python-based data pipeline on AWS. You will ingest daily market data, work with a data lakehouse architecture, and contribute to a small agile team.

The role emphasizes production support, documentation, and adopting emerging technologies to improve performance and reliability within a hybrid environment in Poland.

Qualifications

• 3+ years of experience in Data Software Engineering
• Proficiency in Python development within data engineering environments
• Expertise in designing and implementing data lakehouse architectures and real-time streaming data pipelines
• Skills in integrating and managing AWS services, including S3, ECS, and EC2
• Competency in working with Lambda, Step Functions, and EventBridge
• Familiarity with CloudWatch and DynamoDB for monitoring and NoSQL data management
• Capability to provide Level 3 production support for critical data engineering systems with strong troubleshooting abilities
• Understanding of financial or banking domain concepts, enabling effective collaboration with business stakeholders
• English proficiency at an Upper-Intermediate level (B2) or higher

Responsabilités

• Design and optimize Python data pipelines for streaming market data with low latency
• Integrate AWS services to ingest, process, store, and deliver real-time and historical data
• Collaborate in a small Agile team of 3–5 engineers for rapid, iterative development
• Attend coordination meetings with client managers and internal teams to align deliverables
• Produce and maintain technical documentation for system understanding and knowledge transfer
• Provide L3 production support, perform root-cause analysis, and implement fixes
• Evaluate and adopt new technologies to enhance pipeline performance and reliability

Connaissances

Python development

Data pipelines design

Real-time streaming

Production support

English (B2+)

Outils

AWS Lambda

AWS Step Functions

AWS EventBridge

Amazon DynamoDB

Amazon S3

Amazon ECS

Amazon EC2

CloudWatch

Description du poste

We are seeking a Senior Data Engineer to join an established secondary market ETF analytics platform with over 7 years of production history. The team ingests daily trading reports from multiple sources, including file providers, market data providers, spread data, and bookings, to produce analytics outputs. Built entirely on Python and AWS with a Data Lakehouse and data pipeline architecture, the project is transitioning toward a "run-org" model, requiring someone who can confidently pick up and evolve an existing codebase.

Responsibilities

• Design, develop, and optimize Python-based data pipelines to process streaming market data with minimal latency
• Integrate AWS cloud services to support ingestion, processing, storage, and delivery of real-time and historical data
• Collaborate within a small agile team of 3 to 5 engineers, ensuring rapid decision-making and iterative development
• Participate in regular coordination meetings with client managers and internal development teams to align deliverables
• Produce and maintain comprehensive technical documentation to support system understanding and knowledge transfer
• Provide L3 support for production incidents, performing root cause analysis and implementing corrective actions
• Evaluate and adopt emerging technologies and methodologies to enhance pipeline performance and reliability

Requirements

• 3+ years of experience in Data Software Engineering
• Proficiency in Python development within data engineering environments, emphasizing scalable and maintainable code
• Expertise in designing and implementing data lakehouse architectures and real-time streaming data pipelines
• Skills in integrating and managing AWS services, including S3, ECS, and EC2
• Competency in working with Lambda, Step Functions, and EventBridge
• Familiarity with CloudWatch and DynamoDB for monitoring and NoSQL data management
• Capability to provide Level 3 production support for critical data engineering systems with strong troubleshooting abilities
• Understanding of financial or banking domain concepts, enabling effective collaboration with business stakeholders
• English proficiency at an Upper-Intermediate level (B2) or higher

We offer

• We gather like-minded people:
• Top tech minds driving innovation in AI, cloud and digital platform modernization
• Supportive team and agile, startup-like culture
• Hybrid by design mode and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business-driven relocation opportunities
• We provide growth opportunities:
• Career development programs
• Thought leadership, mentoring, soft skills and well-being programs
• Certification (Anthropic, Gemini, GCP, Azure, AWS)
• English classes
• We cover it all:
• Stable pay
• Participation in the Employee Stock Purchase Plan with a 15% discount
• Benefits package (health insurance, multisport, shopping vouchers)
• Referral bonuses up to $2,000
• Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
• Corporate, social and well-being events
• Please, note:
• Benefits listed above are available to employees only
• We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
• We will reach out to selected candidates exclusively

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.