In Cyclad We work with top international IT companies to boost, cutting-edge technologies that shape the world of the future. We are seeking an experienced Azure Data Engineer with Databricks expertise to join a remote development team. The role focuses on designing, building, and maintaining data platforms using the Microsoft Azure analytics stack and modern Databricks features. The candidate will collaborate closely with architects, data scientists, and business stakeholders to deliver secure, production-ready data solutions.
Project information:
- Type of project: IT services
- Budget: 150-180 PLN net /h - b2b
- Only candidates with citizenship in the European Union and residence in Poland
- Start date: ASAP (depending on candidate's availability)
Project scope:
- Design, build, and deploy scalable data pipelines using Azure Databricks and the Azure Analytics stack
- Curate structured, semi-structured, and unstructured data by creating efficient, cost-effective, and scalable pipelines
- Create and maintain robust data pipeline architecture ensuring data quality, reliability, and scalability
- Assemble and manage large, complex datasets to meet functional and non-functional business requirements
- Identify, design, and implement process improvements, including automation and optimization of data delivery
- Work with real-time and streaming analytics solutions where applicable
- Collaborate closely with Product Owners, Scrum Masters, architects, and data leadership to ensure timely, high-quality delivery
- Align with Data Engineering chapter standards, processes, and best practices
- Apply solid software engineering practices, including unit testing, CI/CD, and version control
- Troubleshoot complex data-related issues and perform root cause analysis
- Ensure data security, governance, and compliance with data management frameworks
- Data Processing & Analytics: Databricks, Spark, SQL, real-time analytics tools
- Programming & Scripting: Python, SQL
- Workflow & Orchestration: Airflow
Requirements:
- Minimum 3+ years' hands-on experience with Azure Data Factory and Databricks (modern features, including Unity Catalog and 2025 capabilities)
- At least 5+ years' experience in data engineering or backend/full-stack software development
- Solid software engineering background: writing unit tests in Python, proficient with Git, and CI/CD pipelines
- Strong SQL skills and experience structuring and modelling data in both relational and non-relational formats
- Experience with data transformation tools, Spark, and real-time analytics solutions on Azure
- Familiarity with modern cloud infrastructure and analytics tools, including Azure Event Hubs, CosmosDB, Spark Streaming, or Airflow is a plus
- Exposure to data catalogue tools (Collibra, Alation) and data management frameworks (e.g., DAMA) is a plus
- Strong verbal and written communication skills in English
We offer:
- Full-time job agreement based on b2b
- Private medical care with dental care (covering 70% of costs) + rehabilitation package.; family package option possible
- Multisport card (also for an accompanying person)
- Life insurance
- Flexibility and international environment