Senior Azure Data Engineer

Cyclad Sp. z o.o.; Remote; PLN 240,000 - 320,000; Full time

Job summary

A leading IT service provider is looking for an experienced Azure Data Engineer with Databricks expertise to join a remote development team. You will design and maintain scalable cloud-based data platforms using Microsoft Azure and Databricks, collaborating with architects and data scientists. The role demands a strong background in data engineering with proven skills in Azure Data Factory and Databricks, alongside proficiency in Python and SQL. This full-time position offers flexibility and a supportive international environment.

Benefits

Private medical care with dental care

Life insurance

Flexibility in the workplace

International environment

Qualifications

• 3+ years hands-on experience with Azure Data Factory and Databricks.
• 5+ years in data engineering or backend/full-stack development.
• Strong SQL skills with experience in relational and non-relational data.

Responsibilities

• Design, build, and deploy scalable data pipelines using Azure Databricks.
• Curate structured, semi-structured, and unstructured data through pipelines.
• Maintain robust data pipeline architecture ensuring quality and reliability.

Skills

Azure Data Factory

Databricks

Python

SQL

Spark

CI/CD

Git

Airflow

Tools

Azure Event Hubs

CosmosDB

Spark Streaming

Job description

In Cyclad We work with top international IT companies to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are seeking an experienced Azure Data Engineer with Databricks expertise to join a remote development team. The role focuses on designing, building, and maintaining scalable, cloud-based data platforms using the Microsoft Azure analytics stack and modern Databricks features. The candidate will collaborate closely with architects, data scientists, and business stakeholders to deliver secure, production-ready data solutions.

Project information

• Type of project: IT services
• Budget: 150-180 PLN net /h - b2b
• Only candidates with citizenship in the European Union and residence in Poland
• Start date: ASAP (depending on candidate's availability)

Project scope

• Design, build, and deploy scalable data pipelines using Azure Databricks and the Azure Analytics stack
• Curate structured, semi-structured, and unstructured data by creating efficient, cost-effective, and scalable pipelines
• Create and maintain robust data pipeline architecture ensuring data quality, reliability, and scalability
• Assemble and manage large, complex datasets to meet functional and non-functional business requirements
• Identify, design, and implement process improvements, including automation and optimization of data delivery
• Work with real-time and streaming analytics solutions where applicable
• Collaborate closely with Product Owners, Scrum Masters, architects, and data leadership to ensure timely, high-quality delivery
• Align with Data Engineering chapter standards, processes, and best practices
• Apply solid software engineering practices, including unit testing, CI/CD, and version control
• Troubleshoot complex data-related issues and perform root cause analysis
• Ensure data security, governance, and compliance with data management frameworks
• Data Processing & Analytics: Databricks, Spark, SQL, real-time analytics tools
• Programming & Scripting: Python, SQL
• Workflow & Orchestration: Airflow

Requirements

• Minimum 3+years' hands-on experience with Azure Data Factory and Databricks (modern features, including Unity Catalog and 2025 capabilities)
• At least 5+ years' experience in data engineering or backend/full-stack software development
• Solid software engineering background: writing unit tests in Python, proficient with Git, and CI/CD pipelines
• Strong SQL skills and experience structuring and modelling data in both relational and non-relational formats
• Experience with data transformation tools, Spark, and real-time analytics solutions on Azure
• Familiarity with modern cloud infrastructure and analytics tools, including Azure Event Hubs, CosmosDB, Spark Streaming, or Airflow is a plus
• Exposure to data catalogue tools (Collibra, Alation) and data management frameworks (e.g., DAMA) is a plus
• Strong verbal and written communication skills in English

We offer

• Full-time job agreement based on b2b
• Private medical care with dental care (covering 70% of costs) + rehabilitation package.; family package option possible
• Life insurance
• Flexibility and international environment