Azure Databricks Developer

Luxoft; Polska; Presencial; PLN 180.000 - 240.000; Jornada completa

Descripción de la vacante

Luxoft joins a dynamic team to build cloud-based data solutions using Azure Databricks and DevOps. You will design and maintain scalable data pipelines, enabling real-time streaming and analytics for trading platform environments.

The role emphasizes data governance, security, and collaboration across cross-functional teams, with a focus on Azure services and modern CI/CD practices.

Formación

• 3+ years hands-on with Azure cloud services incl. Databricks and DevOps.
• Strong Python and PySpark or SQL for data transformation.
• Experience with real-time streaming and event-driven architectures.
• Deep ETL/ELT knowledge and big data processing frameworks.
• Familiar with CI/CD and cloud security best practices.
• Excellent problem solving and agile teamwork.
• Strong communication and collaboration skills.

Responsabilidades

• Develop and maintain data pipelines and ETL processes in Azure Databricks.
• Design Azure Databricks storage and retrieval for optimization.
• Collaborate across teams to implement data integration across sources.
• Enforce data governance, security, and compliance in cloud solutions.
• Monitor and troubleshoot Azure-based data pipelines and apps.
• Automate deployment and monitoring with CI/CD pipelines.
• Keep up with new Azure technologies and propose improvements.

Conocimientos

Azure cloud services

Python

Pyspark

SQL

Real-time data streaming

ETL/ELT

CI/CD

Agile

Data governance

Problem solving

Communication

Herramientas

Azure Databricks

Azure DevOps

Azure Log Analytics

Azure Functions

Azure Service Bus

Descripción del empleo

DXC Luxoft is a global IT services and consulting company, part of DXC Technology, delivering cutting-edge digital and software solutions worldwide. We partner with leading financial institutions and global enterprises, helping them transform and scale through modern technology.

Join a global community of engineers and be part of building impactful, modern technology solutions!

Project Description:

We are seeking an experienced Azure Databricks Developer to join our dynamic team. The ideal candidate will have strong expertise in Azure Databricks and Azure DevOps to design and implement scalable cloud-based data solutions. You will work closely with other data engineers, architects, and business teams to develop and optimize data pipelines, real-time data streaming, and cloud-based analytics solutions.

The applications primarily consist of data pipelines built in Azure Databricks. They either transform data and load it into downstream systems, or ingest data from upstream systems and transform it for further processing.

You will be part of the SaaS Data Layer implementation team responsible for building and maintaining the client environments of the new trading platform.

Luxoft will invest into your professional training and allow you to grow your professional career.

Responsibilities:

• Cloud expertise in Azure Databricks, Azure DevOps, Azure Log Analytics. Knowledge of Azure network concepts, Azure Service Bus, Azure Functions is a plus.
• Develop, implement, and maintain data pipelines and ETL processes using Azure Databricks.
• Design and manage Azure Databricks for optimized data storage and retrieval.
• Collaborate with cross-functional teams to define and implement data integration solutions across multiple sources and platforms.
• Implement best practices for data governance, security, and compliance in cloud-based solutions.
• Monitor and troubleshoot performance issues in Azure-based applications and data pipelines.
• Automate deployment and monitoring processes using CI/CD pipelines.
• Stay updated with emerging Azure technologies and provide recommendations for improvements.

Mandatory Skills Description:

• 3+ years of hands-on experience with Azure cloud services, including Databricks and DevOps.
• Strong proficiency Python and Pyspark or SQL for data transformation and analysis.
• Experience with real-time data streaming and event-driven architectures.
• Deep understanding of ETL/ELT workflows and big data processing frameworks.
• Knowledge of Azure DevOps and CI/CD pipelines for automated deployments.
• Familiarity with data security, governance, and compliance best practices in cloud environments.
• Excellent problem-solving skills and ability to work in an agile development environment.
• Strong communication and collaboration skills.

Nice-to-Have Skills Description:

• Agile
• Certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect.
• Experience with Power BI or other visualization tools.
• Knowledge of machine learning and AI-based analytics on Azure.