Senior AI Data Engineer: Spark, Cloud & AI Tools

EPAM Systems, Inc.; Poland; Remote; PLN 200,000 - 320,000; Full time

Job summary

EPAM Systems, Inc. is seeking a Senior AI Data Software Engineer to join our Data Competency Center. The role offers exposure to a broad range of technologies and domains, with room to grow in any direction you choose.

You will implement data ingestion, processing, and transformation using Spark, Databricks, and cloud services, while collaborating with data scientists and IT professionals to ensure data quality and security.

Qualifications

• 4+ years experience in software development with Data Software Engineering technologies.
• Advanced knowledge of Python.
• Proficient with Spark and Databricks.
• Experience with cloud platforms such as Azure, AWS, Google Cloud Platform.
• Experience with AI development tools e.g. Claude Code, GitHub Copilot, Cursor.
• Strong understanding of data file formats like JSON, Parquet, Avro.
• Hands-on experience with SQL and NoSQL databases (Cassandra, MongoDB).
• Proficiency in data warehousing solutions and ETL processes.
• Detail-oriented with excellent analytical and problem-solving skills.
• Knowledge of software development methodologies and best practices.
• Excellent English communication skills (B2+).
• Nice to have experience with message queues (Kafka) and large data transfers.
• Experience with search technologies (Solr, OpenSearch, Lucene) is advantageous.
• Knowledge of Scala or Java.

Responsibilities

• Implement data ingestion from diverse sources using RDBMS, REST APIs, flat files, streams and time-series data.
• Transform data using Spark, Databricks and cloud services.
• Support AI adoption through agentic development environments.
• Translate project-specific business logic into code across the data platform.
• Optimize data retrieval, build dashboards, and verify data integrity.
• Collaborate with data scientists, analysts and IT professionals.
• Provide thought leadership on data software engineering best practices and trends.
• Maintain security and integrity of data sources and platforms.
• Troubleshoot, debug, and upgrade data systems and apps.

Skills

Python programming

Software development

English communication

Data software engineering

SQL

NoSQL (Cassandra, MongoDB)

Cloud platforms (Azure, AWS, GCP)

AI development tools (Claude Code, Git

Education

Bachelor's degree in Computer Science, Mathematics or related field

Tools

Spark

Databricks

Kafka

Job description

EPAM Systems, Inc. is seeking a Senior AI Data Software Engineer to join our Data Competency Center. The role offers exposure to a broad range of technologies and domains, with room to grow in any direction you choose.

You will implement data ingestion, processing, and transformation using Spark, Databricks, and cloud services, while collaborating with data scientists and IT professionals to ensure data quality and security.