Senior Python Data Engineer — Scalable Data Pipelines & Analytics

EPAM Systems; Town of Poland (NY); Hybrid; USD 47,471 - 84,393; Full time

Job summary

EPAM Systems is seeking a hands-on Senior Python Data Engineer to join the Regulatory Reporting team in Poland within the Investment Bank's Digital Operations Stream. The role focuses on transforming how the client does business by simplifying and improving data products and platforms relied on by Regulatory and Data Clients.

Note: Working from the client’s office is required 3 days per week.

Qualifications

• Bachelor's degree in Computer Science or equivalent in IT.
• 5+ years of experience in a similar role.
• Experience with big data, data warehouse and data lake.
• Hands-on experience building scalable data pipelines for batch and streaming data.
• Proficiency with Python, Spark and Databricks.
• Experience with Delta Lake, DLT and GitLab.
• Cloud technologies such as Azure; Unix/Linux and shell scripting.

Responsibilities

• Design, implement and maintain data-driven applications.
• Develop end-to-end data solutions.
• Build reliable data pipelines for sourcing, processing, distributing and storing data.
• Design data models for large volumes and analytics.
• Contribute to SDLC with best engineering practices.
• Collaborate with product owners and technologists.

Skills

Python

Databricks

Spark

Big Data

CI/CD

AI in SDLC

English B2

Cloud Azure

Unix/Linux

Education

Bachelor's degree in CS

Tools

Delta Lake

DLT

GitLab

Azure

Unix/Linux

Shell scripting

Job description

EPAM Systems is seeking a hands-on Senior Python Data Engineer to join the Regulatory Reporting team in Poland within the Investment Bank's Digital Operations Stream. The role focuses on transforming how the client does business by simplifying and improving data products and platforms relied on by Regulatory and Data Clients.

Note: Working from the client’s office is required 3 days per week.