Senior Big Data Engineer: Azure Spark & Databricks Platform

Luxoft

Kraków

On-site

PLN 180,000 - 260,000

Full time

19 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Private Medical & Dental care & Life
MyBenefit program
Internal Mobility program

Job summary

Luxoft in Kraków is seeking a Senior Big Data Engineer to join ACQA platform development on Azure. You will design and implement scalable data pipelines using Spark, Java and Scala, and collaborate with federated teams across platforms.

The role covers managing the Databricks platform, building and operating CI/CD pipelines with GitLab, and deploying containerised workloads in Kubernetes. 7+ years of experience and Poland-based eligibility are preferred.

Qualifications

  • Development of big data technologies like Apache Spark
  • Programming complex production systems in Java and Scala
  • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
  • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
  • Experience with containerisation in development, build and runtime environments including experience of Kubernetes
  • 7+ years of general experience

Responsibilities

  • Work with multiple federated teams to enable them to build BigData solutions
  • Manage the ACQA Databricks platform – provide monitoring and other tooling

Skills

Big Data
Apache Spark
Java
Scala
Azure Cloud
CI/CD (GitLab)
Kubernetes
Containerisation
Team coordination

Tools

GitLab
Databricks
Kubernetes

Job description

Luxoft in Kraków is seeking a Senior Big Data Engineer to join ACQA platform development on Azure. You will design and implement scalable data pipelines using Spark, Java and Scala, and collaborate with federated teams across platforms.

The role covers managing the Databricks platform, building and operating CI/CD pipelines with GitLab, and deploying containerised workloads in Kubernetes. 7+ years of experience and Poland-based eligibility are preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Cloud Platform Engineer - Databricks/Big Data
Cloud Platform Engineer - Databricks/Big Data

Luxoft • Kraków

On-site
PLN 120,000 - 180,000
Senior BigData Platform Engineer - Azure, Spark, Databricks
Senior BigData Platform Engineer - Azure, Spark, Databricks

Luxoft • Kraków

On-site
PLN 320,000 - 480,000
Private Medical
Dental care
Life Insurance
+1
Senior BigData Platform Engineer - Azure, Spark, Databricks
Senior BigData Platform Engineer - Azure, Spark, Databricks

Luxoft • Wrocław

On-site
PLN 140,000 - 210,000
Private Medical & Dental care
Life Insurance covered
Internal Mobility program
Senior Big Data Platform Engineer (Azure/Databricks)
Senior Big Data Platform Engineer (Azure/Databricks)

Luxoft • Wrocław

On-site
PLN 180,000 - 360,000
Senior Data Engineer: Azure, Databricks & Data Pipelines
Senior Data Engineer: Azure, Databricks & Data Pipelines

Luxoft • Wrocław

On-site
PLN 180,000 - 280,000
Senior Cloud Platform Engineer - Azure & Big Data
Senior Cloud Platform Engineer - Azure & Big Data

Luxoft • Polska

On-site
PLN 180,000 - 300,000
LuxMed health
Dental care
Life and travel insurance
+5
Senior Spark & Databricks Data Engineer - Azure Streaming
Senior Spark & Databricks Data Engineer - Azure Streaming

Accenture PLC • Kraków

Hybrid
PLN 240,000 - 360,000
Permanent employment contract or B2B.
Individual support of a People Lead...
A wide training package (soft, tech, &
+4
Senior .NET Lead – Azure DevOps & Databricks Platform
Senior .NET Lead – Azure DevOps & Databricks Platform

Luxoft • Kraków

On-site
PLN 200,000 - 320,000
Private medical care
Dental care
Life insurance
+1
Senior Python & PySpark Data Engineer – Platform Lead
Senior Python & PySpark Data Engineer – Platform Lead

Luxoft • Kraków

On-site
PLN 240,000 - 360,000
Private medical insurance
Dental care
Life insurance
+2
Senior Azure Databricks Engineer: Real-Time Data Pipelines
Senior Azure Databricks Engineer: Real-Time Data Pipelines

Luxoft • Województwo mazowieckie

On-site
PLN 180,000 - 300,000
Professional training
Career growth opportunities
Luxoft employee benefits
Top locations