Senior Data Software Engineer, Spark, Java, Scala

EPAM Systems; Georgia; On-site; USD 46,000 - 69,000; Full time

Benefits offered by this job

Work abroad opportunity

Relocation options

Growth programs

Certifications (GCP/Azure/AWS)

English classes

Stock Purchase Plan

Bonuses

Medical & family care

Trust days

Benefits package

Job summary

EPAM Systems is seeking a Senior Software Data Engineer to design data pipelines and production-grade data processing solutions. You will build scalable data jobs, optimize Spark workloads, and collaborate with multiple teams to deliver reliable data products across internal and external partners.

You will work remotely within Georgia, leveraging EPAM’s global platforms, and contribute to architecture decisions, data quality, and platform optimization in a fast-paced environment.

Qualifications

• 5+ years of hands-on experience in big-data environments (Hadoop, Spark).
• Strong SQL skills in Spark SQL and HiveQL.
• Proficiency in Spark, including understanding/explaining execution plans.
• Proficiency in Scala or Java.
• Experience with ETL, data pipelines, and data quality checks.
• Ability to learn internal tools and platform services.

Responsibilities

• Write data pipelines and jobs to produce datasets for new features.
• Integrate existing pipelines with org-wide platforms and services.
• Fix bugs and correct data issues from logic or implementation errors.
• Conduct ad-hoc data exploration to support design decisions.
• Monitor and troubleshoot production data pipelines.
• Develop data quality checks and data governance measures.
• Plan development scope with timelines and effort estimation.
• Maintain ticket hygiene in Radar system.
• Evolve pipelines and systems for better code quality and maintainability.
• Communicate status with engineers and project managers.

Skills

Hadoop

Spark

Spark SQL

HiveQL

Scala/Java

ETL

Data quality

Data pipelines

SQL

English communication

Tools

Spark UI

Hadoop YARN

Kafka

Teradata

AWS

Job description

We are seeking a Senior Software Data Engineer to join our team in a software engineering capacity. This is not a data-science or analytics position centered on ad-hoc data exploration; instead, the role focuses on building software, data processing jobs, and data pipelines consumed by internal and external partners. Data is our main product and first-class citizen, and we value correct, high-quality data as much as clean and maintainable code.

Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi.

Responsibilities

• Write new data pipelines and jobs to produce new outputs (datasets) in scope of new features development
• Adopt existing data pipelines to integrate with new org-wide platforms, tools, services, and languages
• Fix bugs in code and correct data caused by incorrect logic or implementation
• Perform ad-hoc data exploration, validation, and investigation to help select the right tech design and support Product Management team decisions
• Monitor and troubleshoot production issues with pipelines owned by the team
• Develop and adopt data quality checks to monitor data issues in the systems
• Scope and plan new development, including assessing level of effort and providing timelines
• Maintain tickets hygiene in Radar (ticketing system)
• Evolve jobs, apps, and systems to a better state across all aspects: code quality, complexity, maintainability, and documentation
• Communicate with other data engineers in the team, peer teams (QA, UAT, Platform, etc), project managers, and engineering managers on status, blockers, estimates, and timelines

Requirements

• 3+ years of hands-on experience in the big-data field, including Hadoop (HDFS, YARN or Mesos) and Spark
• Excellent knowledge and hands-on experience of SQL in context of Big Data: Spark SQL, HiveQL
• Excellent knowledge of Spark, including ability to understand and optimize Spark execution plans via Spark UI, with upcoming migration to Spark 3
• Excellent knowledge of Scala or Java
• Understanding of batch processing and ETL principles in Data Warehouses
• Familiarity with data completeness signals and orchestration
• Knowledge of approaches for historical reprocessing and data correction
• Skills in handling bad data and late data in inputs and outputs
• Understanding of schema migrations and datasets evolution
• Strong speaking English, with ability to rely on information heard verbally in meetings and to explain own ideas clearly to native speakers
• Capability to learn fast new set of tools and technology used internally at the company: platform services, telemetry providers, Spark-as-a-Service, build system, and more

Nice to have

• Understanding of functional programming ideas and principles
• Experience in building and using web services
• Familiarity with any of Teradata, Vertica, Oracle, Tableau
• Skills in Spark Streaming and Kafka
• Knowledge of Apache Iceberg, Trino (Presto), Druid, Cassandra, or Blob storage like AWS
• Experience with Splunk
• Experience with Snowflake

We offer

• We connect like-minded people
  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events
• We invest in your growth
  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers
• We cover it all
  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Five trust days per year (sick leave without a medical certificate)
  • Benefits package (sports activities, a variety of stores and services)

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.