Senior Data Engineer (Python, AWS)

EPAM Systems; Kraków; Hybride; PLN 180 000 - 260 000; Plein temps

Avantages offerts par ce poste

Health insurance

Employee Stock Purchase Plan

Remote work within Poland

Résumé du poste

EPAM Systems Inc is seeking a Senior Data Engineer to join an established ETF analytics platform. You will design and optimize Python data pipelines for streaming market data, integrate AWS services for ingestion and processing, and work in a small agile team to deliver reliable analytics outputs.

The role includes documentation, L3 production support, and evaluating new technologies to improve performance.

Qualifications

• 3+ years of experience in Data Software Engineering.
• Proficiency in Python development within data engineering environments, emphasizing scalable and maintainable code.
• Experience designing and implementing data lakehouse architectures and real-time streaming data pipelines.
• Experience integrating and managing AWS services (S3, ECS, EC2).
• Proficiency with Lambda, Step Functions, and EventBridge.
• Familiarity with CloudWatch and DynamoDB for monitoring and NoSQL data management.
• Ability to provide Level 3 production support and strong troubleshooting.
• Understanding of financial or banking domain concepts.

Responsabilités

• Design, develop, and optimize Python-based data pipelines with low latency.
• Integrate AWS cloud services to support ingestion, processing, storage and delivery of real-time and historical data.
• Collaborate in a small agile team of 3–5 engineers and participate in client and internal coordination.
• Produce and maintain technical documentation for knowledge transfer and system understanding.
• Provide L3 production support for incidents and root cause analysis.
• Evaluate and adopt emerging technologies to improve pipeline performance and reliability.

Connaissances

Python

Data engineering

Streaming

Scalable code

System design

Outils

AWS (S3)

ECS

EC2

Lambda

Step Functions

EventBridge

CloudWatch

DynamoDB

Description du poste

We are seeking a Senior Data Engineer to join an established secondary market ETF analytics platform with over 7 years of production history. The team ingests daily trading reports from multiple sources, including file providers, market data providers, spread data, and bookings, to produce analytics outputs. Built entirely on Python and AWS with a Data Lakehouse and data pipeline architecture, the project is transitioning toward a \"run-org\" model, requiring someone who can confidently pick up and evolve an existing codebase.ResponsibilitiesDesign, develop, and optimize Python-based data pipelines to process streaming market data with minimal latencyIntegrate AWS cloud services to support ingestion, processing, storage, and delivery of real-time and historical dataCollaborate within a small agile team of 3 to 5 engineers, ensuring rapid decision-making and iterative developmentParticipate in regular coordination meetings with client managers and internal development teams to align deliverablesProduce and maintain comprehensive technical documentation to support system understanding and knowledge transferProvide L3 support for production incidents, performing root cause analysis and implementing corrective actionsEvaluate and adopt emerging technologies and methodologies to enhance pipeline performance and reliabilityRequirements3+ years of experience in Data Software EngineeringProficiency in Python development within data engineering environments, emphasizing scalable and maintainable codeExpertise in designing and implementing data lakehouse architectures and real-time streaming data pipelinesSkills in integrating and managing AWS services, including S3, ECS, and EC2Competency in working with Lambda, Step Functions, and EventBridgeFamiliarity with CloudWatch and DynamoDB for monitoring and NoSQL data managementCapability to provide Level 3 production support for critical data engineering systems with strong troubleshooting abilitiesUnderstanding of financial or banking domain concepts, enabling effective collaboration with business stakeholdersEnglish proficiency at an Upper-Intermediate level (B2) or higherWe offerWe gather like-minded people:Top tech minds driving innovation in AI, cloud and digital platform modernizationSupportive team and agile, startup-like cultureHybrid by design mode and opportunity to work remotely within PolandChance to work abroad for up to 60 days annuallyBusiness-driven relocation opportunitiesWe provide growth opportunities:Career development programsThought leadership, mentoring, soft skills and well-being programsCertification (Anthropic, Gemini, GCP, Azure, AWS)English classesWe cover it all:Stable payParticipation in the Employee Stock Purchase Plan with a 15% discountBenefits package (health insurance, multisport, shopping vouchers)Referral bonuses up to $2,000Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and moreCorporate, social and well-being eventsPlease, note:Benefits listed above are available to employees onlyWe are open for working with Contractors. Terms of B2B cooperation agreements are agreed individuallyWe will reach out to selected candidates exclusivelyEPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.