Senior Data Software Engineer — Big Data & Cloud Impact

EPAM Systems; Województwo pomorskie; Hybrid; PLN 180,000 - 320,000; Full time

Benefits offered by this job

Hybrid by design

Remote work within Poland

Work abroad up to 60 days annually

Relocation opportunities

Certification programs (GCP, Azure, AI

English classes

Health insurance

Multisport

Shopping vouchers

Referral bonuses

Job summary

EPAM Systems is seeking a Senior Data Software Engineer to join our Data Practice. You will work on diverse data ingestion, processing, and analytics projects for clients across industries, using Spark, Databricks, Snowflake, and cloud services.

You will collaborate with data scientists, analysts, and IT professionals, shaping data platforms, data quality, and dashboards while staying current with Big Data best practices. Hybrid work option available within Poland.

Qualifications

• Bachelor’s degree in Computer Science, Mathematics or related technical field.
• 5+ years experience in software development with Big Data technologies.
• Advanced knowledge of Python, Scala, or Java.
• Proficient with Spark and Databricks and/or Snowflake.
• Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services.
• Demonstrated experience with big data models, databases, and tools.
• Strong understanding of different data file formats like JSON, Parquet, Avro.
• Hands-on experience with SQL and NoSQL databases, including Cassandra and MongoDB.
• Proficiency in data warehousing solutions, ETL processes.
• Proven ability to work within a fast-paced, team-oriented environment.
• Detail-oriented with excellent analytical and problem-solving skills.
• Knowledge of software development methodologies and best practices.
• Exceptional oral and written communication skills in English (B2+)
• Nice to have Experience with Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN
• Experience with message queues, especially Kafka
• Production experience in search technologies such as Solr, OpenSearch, or Lucene

Responsibilities

• Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP Research and utilize Big Data technologies for effective data ingestion.
• Process and transform data using tools such as Spark and various Cloud Services.
• Understand and execute project-specific business logic through programming languages supported by the primary data platform.
• Optimize data retrieval, develop dashboards, and perform data validation.
• Collaborate with diverse teams including data scientists, analysts, and IT professionals.
• Provide thought leadership on Big Data best practices and technology trends.
• Maintain and ensure integrity and security of big data sources and platforms.
• Perform troubleshooting, debugging, and upgrading of big data systems and applications.

Skills

Python

Scala

Java

Big Data

Spark

Databricks

Snowflake

Azure

GCP

AWS

SQL

NoSQL

Kafka

Hadoop

Airflow

OpenSearch

Lucene

Education

Bachelor’s degree in Computer Science or related field

Tools

Spark

Databricks

Snowflake

Cassandra

MongoDB

SQL

NoSQL

Kafka

Hadoop

Oozie

Airflow

HDFS

YARN

Solr

OpenSearch

Lucene

Job description

EPAM Systems is seeking a Senior Data Software Engineer to join our Data Practice. You will work on diverse data ingestion, processing, and analytics projects for clients across industries, using Spark, Databricks, Snowflake, and cloud services.

You will collaborate with data scientists, analysts, and IT professionals, shaping data platforms, data quality, and dashboards while staying current with Big Data best practices. Hybrid work option available within Poland.