Senior Python Data Engineer - Scalable Pipelines & AI

EPAM Systems; Wrocław; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid by design

Remote opportunities within Poland

Relocation opportunities

Stock purchase program

Job summary

EPAM Systems seeks a hands-on Senior Python Data Engineer to join the Regulatory Reporting team in Poland within the Investment Bank's Digital Operations Stream. You will design, build and maintain data-driven applications, and engineer data pipelines for scalable, near-real-time analytics.

Requirements include 5+ years in a similar role, expertise in Python, Spark and Databricks, and experience with Delta Lake. Hybrid work with three days at the client office in Poland is offered.

Qualifications

• Bachelor's degree in IT or CS plus 5+ years in a similar role.
• Experience with Big Data, Data warehouse and Data lake architectures.
• Hands-on building scalable data pipelines for batch and streaming analytics.
• Strong Python, Spark and Databricks expertise with data modeling.
• Experience with Delta Lake, DLT and GitLab.
• Cloud experience with Azure, Unix/Linux and shell scripting.
• Design applications with high throughput and low latency requirements.
• Experience implementing automated testing and CI/CD pipelines.
• Ability to prototype quickly and iterate with good engineering principles.
• English proficiency at B2 level or higher.

Responsibilities

• Design, implement and maintain data-driven applications.
• Develop end-to-end data solutions and pipelines.
• Engineer reliable data pipelines for sourcing, processing, distributing and storing data.
• Design data models to support growing data volumes.
• Participate in all stages of the software development lifecycle.
• Provide technical recommendations and innovative solutions.
• Collaborate with product owners and other technologists.
• Share expertise and promote engineering best practices.

Skills

Python

Spark

Databricks

Big Data

Data pipelines

Delta Lake

DLT

GitLab

Azure

Unix/Linux shell

NFRs performance

CI/CD

AI in SDLC

English B2

Education

Bachelor's degree in Computer Science or IT

Tools

SQL

Azure SQL

GitLab CI

Job description

EPAM Systems seeks a hands-on Senior Python Data Engineer to join the Regulatory Reporting team in Poland within the Investment Bank's Digital Operations Stream. You will design, build and maintain data-driven applications, and engineer data pipelines for scalable, near-real-time analytics.

Requirements include 5+ years in a similar role, expertise in Python, Spark and Databricks, and experience with Delta Lake. Hybrid work with three days at the client office in Poland is offered.