Senior Data Engineer (Java/Scala/Python, Spark, AWS)

EPAM Systems; Polska; On-site; PLN 180,000 - 300,000; Full time

Job summary

EPAM Systems Inc is seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. The role emphasizes Spark-based development, AWS cloud architectures, and strong SQL skills to support Gen AI and ML applications.

Responsibilities include building data platforms, ETL/ELT workflows, data modeling for lakehouse architectures, governance, and collaboration with cross-functional teams.

Qualifications

• 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications.
• Experience building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java/Scala/Python.
• Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives.
• Expertise in AWS cloud environments and cloud-native architectures.
• Advanced proficiency in SQL.
• Skills in data modeling and modern data lakehouse architectures.
• Understanding of data quality, governance, monitoring, and operational best practices.
• Competency in building secure, scalable, and highly available data solutions.
• ETL/ELT development experience.
• Proficiency in English at an Upper-Intermediate level (B2) or higher.
• Nice to have Databricks or Snowflake experience across cloud platforms.

Responsibilities

• Design, build, and maintain large-scale data pipelines and distributed processing systems using Spark.
• Develop and support data platforms that enable AI/ML and Generative AI applications.
• Architect and implement solutions within AWS cloud environments using cloud-native patterns.
• Build and optimize ETL/ELT workflows to support analytical and operational use cases.
• Implement data modeling strategies aligned with modern data lakehouse architectures.
• Ensure data quality, governance, and monitoring across all data assets.
• Deliver secure, scalable, and highly available data solutions following operational best practices.
• Collaborate with cross-functional teams to support AI-driven business initiatives.
• Write advanced SQL queries and production-grade code in Java, Scala, or Python.

Skills

Spark

AWS

SQL

Python/Java/Scala

ETL/ELT

Data Modeling

Data Governance

Gen AI/ML

English (B2+)

Tools

Databricks

Snowflake

Job description

We are seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. In this role, you will leverage your expertise in AWS, Spark, and modern data architectures to deliver secure, scalable, and highly available data solutions supporting Gen AI and ML applications.

Responsibilities

• Design, build, and maintain large-scale data pipelines and distributed processing systems using Spark
• Develop and support data platforms that enable AI/ML and Generative AI applications
• Architect and implement solutions within AWS cloud environments using cloud-native patterns
• Build and optimize ETL/ELT workflows to support analytical and operational use cases
• Implement data modeling strategies aligned with modern data lakehouse architectures
• Ensure data quality, governance, and monitoring across all data assets
• Deliver secure, scalable, and highly available data solutions following operational best practices
• Collaborate with cross-functional teams to support AI-driven business initiatives
• Write advanced SQL queries and production-grade code in Java or Scala or Python

Requirements

• 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications
• Background in building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java or Scala or Python
• Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives
• Expertise in AWS cloud environments and cloud-native architectures
• Advanced proficiency in SQL
• Skills in data modeling and modern data lakehouse architectures
• Understanding of data quality, governance, monitoring, and operational best practices
• Competency in building secure, scalable, and highly available data solutions
• Showcase of ETL/ELT development experience
• Proficiency in English at an Upper-Intermediate level (B2) or higher
• Nice to have Hands-on experience with Databricks or Snowflake, with the ability to work across modern cloud-based data platforms (experience with both is advantageous)
• Background in Financial Services