Senior Data Software Engineer — Big Data, Hybrid/Remote

EPAM Systems; Poznań; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Hybrid/remote work Poland

Relocation opportunities

Stock purchase plan

Health insurance

Multisport

Shopping vouchers

Referral bonuses

Job summary

EPAM Systems is seeking a Senior Data Software Engineer to join our growing Data Practice in Poznań. You will work on diverse projects across industries, applying modern data ingestion, processing and validation with open-source tools.

Expertise in Python/Scala/Java, Spark, Databricks and Snowflake, plus cloud experience (Azure, GCP, AWS) and SQL/NoSQL databases, will help you build scalable data pipelines and collaborate with data scientists and IT teams.

Qualifications

• Bachelor’s degree in Computer Science, Mathematics or related field.
• 5+ years of software development with Big Data technologies.
• Advanced knowledge of Python, Scala, or Java.
• Proficient with Spark and Databricks and/or Snowflake.
• Experience with cloud platforms such as Azure, Google Cloud Platform, and AWS.
• Demonstrated experience with big data models, databases, and tools.
• Strong understanding of data file formats like JSON, Parquet, Avro.
• Hands-on experience with SQL and NoSQL databases, including Cassandra and MongoDB.
• Proficiency in data warehousing and ETL processes.
• Excellent English communication (B2+)

Responsibilities

• Implement data ingestion from diverse sources using RDBMS, REST APIs, flat files, streams, and time-series data.
• Process and transform data using Spark and cloud services.
• Understand and implement project-specific business logic in the primary data platform.
• Optimize data retrieval, develop dashboards, and validate data.
• Collaborate with data scientists, analysts, and IT professionals.
• Provide thought leadership on Big Data best practices and trends.
• Maintain integrity and security of big data sources and platforms.
• Troubleshoot, debug, and upgrade big data systems and applications.

Skills

Python

Scala

Java

Analytical thinking

English communication

Education

Bachelor’s degree in Computer Science, Mathematics or related technical field

Tools

Spark

Databricks

Snowflake

Hadoop

Kafka

Oozie

Airflow

HDFS

YARN

Solr/OpenSearch/Lucene

Cassandra

MongoDB

SQL

NoSQL

Job description

EPAM Systems is seeking a Senior Data Software Engineer to join our growing Data Practice in Poznań. You will work on diverse projects across industries, applying modern data ingestion, processing and validation with open-source tools.

Expertise in Python/Scala/Java, Spark, Databricks and Snowflake, plus cloud experience (Azure, GCP, AWS) and SQL/NoSQL databases, will help you build scalable data pipelines and collaborate with data scientists and IT teams.