Senior Data Engineer - GenAI Pipelines on AWS & Spark

EPAM Systems Inc; Polska; On-site; PLN 180,000 - 300,000; Full time

Job summary

EPAM Systems Inc is seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. The role emphasizes Spark-based development, AWS cloud architectures, and strong SQL skills to support Gen AI and ML applications.

Responsibilities include building data platforms, ETL/ELT workflows, data modeling for lakehouse architectures, governance, and collaboration with cross-functional teams.

Qualifications

• 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications.
• Experience building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java/Scala/Python.
• Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives.
• Expertise in AWS cloud environments and cloud-native architectures.
• Advanced proficiency in SQL.
• Skills in data modeling and modern data lakehouse architectures.
• Understanding of data quality, governance, monitoring, and operational best practices.
• Competency in building secure, scalable, and highly available data solutions.
• ETL/ELT development experience.
• Proficiency in English at an Upper-Intermediate level (B2) or higher.
• Nice to have Databricks or Snowflake experience across cloud platforms.

Responsibilities

• Design, build, and maintain large-scale data pipelines and distributed processing systems using Spark.
• Develop and support data platforms that enable AI/ML and Generative AI applications.
• Architect and implement solutions within AWS cloud environments using cloud-native patterns.
• Build and optimize ETL/ELT workflows to support analytical and operational use cases.
• Implement data modeling strategies aligned with modern data lakehouse architectures.
• Ensure data quality, governance, and monitoring across all data assets.
• Deliver secure, scalable, and highly available data solutions following operational best practices.
• Collaborate with cross-functional teams to support AI-driven business initiatives.
• Write advanced SQL queries and production-grade code in Java, Scala, or Python.

Skills

Spark

AWS

SQL

Python/Java/Scala

ETL/ELT

Data Modeling

Data Governance

Gen AI/ML

English (B2+)

Tools

Databricks

Snowflake

Job description

EPAM Systems Inc is seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. The role emphasizes Spark-based development, AWS cloud architectures, and strong SQL skills to support Gen AI and ML applications.

Responsibilities include building data platforms, ETL/ELT workflows, data modeling for lakehouse architectures, governance, and collaboration with cross-functional teams.