Azure Databricks Developer

Luxoft

Województwo mazowieckie

On-site

PLN 180,000 - 300,000

Full time

8 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Professional training
Career growth opportunities
Luxoft employee benefits

Job summary

Luxoft in Poland seeks an experienced Azure Databricks Developer to design and implement scalable cloud-based data solutions. You will work on data pipelines, real-time streaming, and cloud analytics, collaborating with engineers, architects, and business teams.

The role focuses on Azure Databricks pipelines, governance, and security, with a strong emphasis on CI/CD automation and Azure services, contributing to the trading platform’s data layer.

Qualifications

  • 10+ years in development.
  • 3+ years with Azure Databricks and DevOps.
  • Strong Python and PySpark/SQL skills.
  • Experience with real-time streaming and event-driven arch.
  • Deep ETL/ELT and big data processing knowledge.
  • Familiarity with Azure DevOps CI/CD pipelines.
  • Knowledge of data security, governance, and compliance in cloud envs.
  • Excellent problem solving in an agile team.
  • Strong communication and collaboration abilities.

Responsibilities

  • Build, implement and maintain data pipelines using Azure Databricks.
  • Design and optimize data storage, retrieval and pipelines.
  • Collaborate across teams for data integration across sources.
  • Apply data governance, security and compliance best practices.
  • Monitor performance and troubleshoot Azure data pipelines.
  • Automate deployment and monitoring with CI/CD pipelines.
  • Stay updated on Azure tech and suggest improvements.

Skills

Azure Databricks
Azure DevOps
Python
PySpark
SQL
Real-time streaming
ETL/ELT
Data security
Agile
Communication

Tools

CI/CD pipelines

Job description

We are seeking an experienced Azure Databricks Developer to join our dynamic team. The ideal candidate will have strong expertise in Azure Databricks and Azure DevOps to design and implement scalable cloud-based data solutions. You will work closely with other data engineers, architects, and business teams to develop and optimize data pipelines, real-time data streaming, and cloud-based analytics solutions.

The applications primarily consist of data pipelines built in Azure Databricks. They either transform data and load it into downstream systems, or ingest data from upstream systems and transform it for further processing.

You will be part of the SaaS Data Layer implementation team responsible for building and maintaining the client environments of the new trading platform.

Luxoft will invest into your professional training and allow you to grow your professional career.

Responsibilities:
  • Cloud expertise in Azure Databricks, Azure DevOps, Azure Log Analytics. Knowledge of Azure network concepts, Azure Service Bus, Azure Functions is a plus.
  • Develop, implement, and maintain data pipelines and ETL processes using Azure Databricks.
  • Design and manage Azure Databricks for optimized data storage and retrieval.
  • Collaborate with cross-functional teams to define and implement data integration solutions across multiple sources and platforms.
  • Implement best practices for data governance, security, and compliance in cloud-based solutions.
  • Monitor and troubleshoot performance issues in Azure-based applications and data pipelines.
  • Automate deployment and monitoring processes using CI/CD pipelines.
  • Stay updated with emerging Azure technologies and provide recommendations for improvements.
Mandatory Skills Description:
  • 10+ years experience in development
  • 3+ years of hands-on experience with Azure cloud services, including Databricks and DevOps.
  • Strong proficiency Python and Pyspark or SQL for data transformation and analysis.
  • Experience with real-time data streaming and event-driven architectures.
  • Deep understanding of ETL/ELT workflows and big data processing frameworks.
  • Knowledge of Azure DevOps and CI/CD pipelines for automated deployments.
  • Familiarity with data security, governance, and compliance best practices in cloud environments.
  • Excellent problem-solving skills and ability to work in an agile development environment.
  • Strong communication and collaboration skills.
Nice-to-Have Skills Description:
  • Agile
  • Certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect.
  • Experience with Power BI or other visualization tools.
  • Knowledge of machine learning and AI-based analytics on Azure.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Developer
Azure Databricks Developer

DXC Luxoft • Warszawa

On-site
PLN 150,000 - 230,000
Professional training
Azure Data Engineer - freelance
Azure Data Engineer - freelance

Lingaro • Polska

On-site
PLN 180,000 - 300,000
Azure Data Engineer with Databricks - Freelancer (Part-time)
Azure Data Engineer with Databricks - Freelancer (Part-time)

Lingaro • Polska

On-site
PLN 180,000 - 240,000
Azure Data Engineer for Databricks & Data Pipelines
Azure Data Engineer for Databricks & Data Pipelines

Lingaro • Polska

On-site
PLN 180,000 - 300,000
Azure Databricks Data Engineer Real-Time Pipelines DevOps
Azure Databricks Data Engineer Real-Time Pipelines DevOps

DXC Luxoft • Warszawa

On-site
PLN 150,000 - 230,000
Professional training
Senior Data Engineer (Azure/Databricks)
Senior Data Engineer (Azure/Databricks)

Solid Company • Poznań

On-site
PLN 120,000 - 150,000
Private medical care
Co-financing for the sports card
Constant support of dedicated consultant
+1
Azure Data Engineer
Azure Data Engineer

Aon plc • Polska

Hybrid
PLN 180,000 - 260,000
Senior BigData Platform Engineer - Azure, Spark, Databricks
Senior BigData Platform Engineer - Azure, Spark, Databricks

Luxoft • Wrocław

On-site
PLN 140,000 - 210,000
Private Medical & Dental care
Life Insurance covered
Internal Mobility program
Senior Data Engineer/Analyst - Azure Databricks
Senior Data Engineer/Analyst - Azure Databricks

Euroclear • Polska

On-site
PLN 180,000 - 260,000
Senior Azure Databricks Engineer: Real-Time Data Pipelines
Senior Azure Databricks Engineer: Real-Time Data Pipelines

Luxoft • Województwo mazowieckie

On-site
PLN 180,000 - 300,000
Professional training
Career growth opportunities
Luxoft employee benefits
Top locations