Senior Big Data Engineer

Grid Dynamics; Warszawa; On-site; PLN 80,000 - 100,000; Full time

Benefits offered by this job

Flexible schedule

Medical insurance

Sports benefits

Corporate social events

Professional development opportunities

Job summary

Grid Dynamics in Warsaw is looking for a motivated Data Engineer to develop and optimize data pipelines for extensive data sets. You will collaborate with a distributed team, focusing on designing and coding in Scala/Spark while implementing algorithms for data processing.

The ideal candidate has solid experience with big data technologies including Spark and SQL, and is eager to work in a dynamic environment with opportunities for professional development and flexible scheduling.

Qualifications

• Experience with Scala and Spark for developing data pipelines.
• Familiarity with Kubernetes and SQL, especially Spark SQL.
• Knowledge of Hive and Airflow for data management.

Responsibilities

• Develop and optimize data pipelines and infrastructure.
• Implement and verify algorithms for data analysis.
• Participate in infrastructure upgrades and system improvements.
• Enhance crash analytics and contribute to dev analytics.
• Build observation and management tools for infrastructure health.

Skills

Scala

Spark

Kubernetes

Hive / Iceberg

Airflow

SQL

Job description

Are you passionate about big data, scalable infrastructure, and innovative tech solutions?

About The Project

Join a forward‑thinking team focused on building robust pipelines and infrastructure for generating reports from vast data sets. Your role will involve designing, coding, and verifying jobs in the latest Scala/Spark versions, ensuring accurate statistical algorithms for our stakeholders. Collaborate with a distributed team of top‑tier big data engineers from Europe and beyond, contributing to impactful data solutions.

Responsibilities

• Develop and optimize data pipelines and infrastructure
• Implement and verify algorithms for data analysis
• Participate in infrastructure upgrades, cloud migrations, and system improvements
• Enhance crash analytics and contribute to dev analytics
• Build observation and management tools for infrastructure health and performance

Requirements

Availability to work daily until 8 PM Polish time

• Scala
• Spark, Spark Streaming
• Kubernetes (mostly to understand how Spark on Kube works)
• Hive / Iceberg
• Airflow
• SQL, specifically familiarity with Spark SQL (window functions, complex group by cases)

Nice to have

• Flink
• Experience with Claude

We offer

• Opportunity to work on bleeding‑edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package – medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well‑equipped office

About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.