Senior Big Data Engineer - Spark, Scala & Infra

Grid Dynamics; Warszawa; On-site; PLN 80,000 - 100,000; Full time

Benefits offered by this job

Flexible schedule

Medical insurance

Sports benefits

Corporate social events

Professional development opportunities

Job summary

Grid Dynamics in Warsaw is looking for a motivated Data Engineer to develop and optimize data pipelines for extensive data sets. You will collaborate with a distributed team, focusing on designing and coding in Scala/Spark while implementing algorithms for data processing.

The ideal candidate has solid experience with big data technologies including Spark and SQL, and is eager to work in a dynamic environment with opportunities for professional development and flexible scheduling.

Qualifications

• Experience with Scala and Spark for developing data pipelines.
• Familiarity with Kubernetes and SQL, especially Spark SQL.
• Knowledge of Hive and Airflow for data management.

Responsibilities

• Develop and optimize data pipelines and infrastructure.
• Implement and verify algorithms for data analysis.
• Participate in infrastructure upgrades and system improvements.
• Enhance crash analytics and contribute to dev analytics.
• Build observation and management tools for infrastructure health.

Skills

Scala

Spark

Kubernetes

Hive / Iceberg

Airflow

SQL

Job description

Grid Dynamics in Warsaw is looking for a motivated Data Engineer to develop and optimize data pipelines for extensive data sets. You will collaborate with a distributed team, focusing on designing and coding in Scala/Spark while implementing algorithms for data processing.

The ideal candidate has solid experience with big data technologies including Spark and SQL, and is eager to work in a dynamic environment with opportunities for professional development and flexible scheduling.