Senior Big Data Engineer

Grid Dynamics; Poznań; On-site; PLN 257,842 - 343,790; Full time

Benefits offered by this job

Medical insurance

Flexible schedule

Competitive salary

Professional development opportunities

Job summary

Grid Dynamics in Poznań, Poland is looking for a Senior Big Data Engineer to join their innovative team. This role focuses on designing and verifying data jobs using Scala/Spark, while working on key projects involving cloud migration and infrastructure improvements.

Ideal candidates will have expertise in big data technologies like Spark and Kubernetes, as well as strong SQL skills. The position offers a flexible schedule and a competitive salary alongside a comprehensive benefits package.

Qualifications

• Strong proficiency in Scala and Spark for big data projects.
• Experience with Kubernetes for Spark deployments.
• Familiarity with SQL, particularly Spark SQL and complex queries.

Responsibilities

• Design, code, and verify jobs using Scala/Spark.
• Upgrade Spark infrastructure and migrate to the cloud.
• Develop tools for infrastructure observation and management.

Skills

Scala

Spark

Kubernetes

Hive/Iceberg

Airflow

SQL (Spark SQL)

Job description

Overview

Are you passionate about big data, scalable infrastructure, and innovative tech solutions? We are seeking a talented Senior Big Data Engineer to join our dynamic team working on cutting-edge data projects for a global leader in tech innovation.

About the Project

Join a forward-thinking team focused on building robust pipelines and infrastructure for generating reports from vast data sets. Your role will involve designing, coding, and verifying jobs in the latest Scala/Spark versions, ensuring accurate statistical algorithms for our stakeholders. Collaborate with a distributed team of top-tier big data engineers from Europe and beyond, contributing to impactful data solutions.

Responsibilities

• Infrastructure work (Spark upgrade, cloud migration, etc)
• Dev Analytics contributions
• Crash Analytics extension and improvement
• Infrastructure observation and management tooling.

Requirements

• Scala
• Spark, Spark Streaming
• Kubernetes (mostly to understand how Spark on Kube works)
• Hive / Iceberg
• Airflow
• SQL, specifically familiarity with Spark SQL (window functions, complex group by cases)
• Availability to work until 8 PM Polish time

Nice to have

• Flink
• Experience with Claude

We offer

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office

About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.