Senior Azure Databricks Engineer: Real-Time Data Pipelines

Luxoft

Województwo mazowieckie

On-site

PLN 180,000 - 300,000

Full time

9 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Professional training
Career growth opportunities
Luxoft employee benefits

Job summary

Luxoft in Poland seeks an experienced Azure Databricks Developer to design and implement scalable cloud-based data solutions. You will work on data pipelines, real-time streaming, and cloud analytics, collaborating with engineers, architects, and business teams.

The role focuses on Azure Databricks pipelines, governance, and security, with a strong emphasis on CI/CD automation and Azure services, contributing to the trading platform’s data layer.

Qualifications

  • 10+ years in development.
  • 3+ years with Azure Databricks and DevOps.
  • Strong Python and PySpark/SQL skills.
  • Experience with real-time streaming and event-driven arch.
  • Deep ETL/ELT and big data processing knowledge.
  • Familiarity with Azure DevOps CI/CD pipelines.
  • Knowledge of data security, governance, and compliance in cloud envs.
  • Excellent problem solving in an agile team.
  • Strong communication and collaboration abilities.

Responsibilities

  • Build, implement and maintain data pipelines using Azure Databricks.
  • Design and optimize data storage, retrieval and pipelines.
  • Collaborate across teams for data integration across sources.
  • Apply data governance, security and compliance best practices.
  • Monitor performance and troubleshoot Azure data pipelines.
  • Automate deployment and monitoring with CI/CD pipelines.
  • Stay updated on Azure tech and suggest improvements.

Skills

Azure Databricks
Azure DevOps
Python
PySpark
SQL
Real-time streaming
ETL/ELT
Data security
Agile
Communication

Tools

CI/CD pipelines

Job description

Luxoft in Poland seeks an experienced Azure Databricks Developer to design and implement scalable cloud-based data solutions. You will work on data pipelines, real-time streaming, and cloud analytics, collaborating with engineers, architects, and business teams.

The role focuses on Azure Databricks pipelines, governance, and security, with a strong emphasis on CI/CD automation and Azure services, contributing to the trading platform’s data layer.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Data Engineer Real-Time Pipelines DevOps
Azure Databricks Data Engineer Real-Time Pipelines DevOps

DXC Luxoft • Warszawa

On-site
PLN 150,000 - 230,000
Professional training
Senior Data Engineer: Azure, Databricks & Data Pipelines
Senior Data Engineer: Azure, Databricks & Data Pipelines

Luxoft • Wrocław

On-site
PLN 180,000 - 280,000
Senior Big Data Engineer: Azure Spark & Databricks Platform
Senior Big Data Engineer: Azure Spark & Databricks Platform

Luxoft • Kraków

On-site
PLN 180,000 - 260,000
Private Medical & Dental care & Life
MyBenefit program
Internal Mobility program
Azure Databricks Developer
Azure Databricks Developer

DXC Luxoft • Warszawa

On-site
PLN 150,000 - 230,000
Professional training
Azure Databricks Developer
Azure Databricks Developer

Luxoft • Województwo mazowieckie

On-site
PLN 180,000 - 300,000
Professional training
Career growth opportunities
Luxoft employee benefits
Databricks Data Engineer: Pipelines, PySpark & Azure
Databricks Data Engineer: Pipelines, PySpark & Azure

ITConnect • Polska

Hybrid
PLN 180,000 - 240,000
Senior Data Engineer: Real-Time Pipelines & AI-Driven SDLC
Senior Data Engineer: Real-Time Pipelines & AI-Driven SDLC

Luxoft • Wrocław

On-site
PLN 230,000 - 280,000
Senior Data Engineer - Azure Data Pipelines & Governance
Senior Data Engineer - Azure Data Pipelines & Governance

Luxoft • Wrocław

On-site
PLN 120,000 - 180,000
Medical & Dental care
Life Insurance
Internal Mobility program
Cloud Platform Engineer - Databricks/Big Data
Cloud Platform Engineer - Databricks/Big Data

Luxoft • Kraków

On-site
PLN 120,000 - 180,000
Senior .NET Platform Lead — Azure & Data Pipelines
Senior .NET Platform Lead — Azure & Data Pipelines

Luxoft • Wrocław

On-site
PLN 250,000 - 450,000
Private Medical & Dental care
Life Insurance
Internal Mobility program
Top locations