Azure Data Engineer with Databricks - Freelancer (Part-time)

Lingaro; Polska; Presencial; PLN 180.000 - 240.000; Jornada completa

Descripción de la vacante

Lingaro is seeking Azure Data Engineers with Databricks experience to design and implement data pipelines, data warehouses, and ETL workflows on Azure. You will build scalable data processing solutions and partner with data scientists, analysts, and business stakeholders.

Required: Azure cloud skills, Databricks, SQL, Python/PySpark, and strong English. Experience with Agile methods (Jira, Azure DevOps) is a plus. A proactive, collaborative mindset is valued at Lingaro.

Formación

• Experience with Azure cloud-based infrastructure and Databricks implementation.
• Experience with SQL.
• Experience with Python, PySpark.
• Strong English communication to convey information clearly to stakeholders.
• Working experience in Agile methodologies – supporting tools (JIRA, Azure DevOps).
• English at least at B2 level, ideally C1.
• Nice to have familiarity with other cloud technologies, data warehouses, data governance, and business analysis.

Responsabilidades

• Designing and implementing data processing systems on Azure platform.
• Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms.
• Integrating and transforming data to align with the target data model.
• Designing and optimizing data storage (data lakes, data warehouses, distributed file systems).
• Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to improve performance.
• Collaborating with data scientists, analysts, and business stakeholders to understand requirements and provide technical solutions.
• Taking ownership and ensuring delivery of tasks efficiently and to high standards.
• Ability to work under Agile methodologies.

Conocimientos

English proficiency

Communication skills

Agile experience

Herramientas

Azure

Databricks

SQL

Python

PySpark

JIRA

Azure DevOps

Descripción del empleo

Growth through diversity, equity, and inclusion. As an ethical business, we do what is right — including ensuring equal opportunities and fostering a safe, respectful workplace for each of us. We believe diversity fuels both personal and business growth. We're committed to building an inclusive community where all our people thrive regardless of their backgrounds, identities, or other personal characteristics.

We are seeking Azure Data Engineers experienced with Databricks. Ideal candidates will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows.

Tasks:

• Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
• Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms.
• Integrating and transforming data to ensure its compatibility with the target data model or format.
• Experience in designing and optimizing of data storage (data lakes, data warehouses, distributed file systems)
• Familiarity with partitioning, compression, optimization of data storage and retrieval.
• Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
• Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
• Taking ownership and demonstrating responsibility throughout the solution delivery process, ensuring that all tasks are executed efficiently, effectively, and to the highest standard.
• Ability to work under Agile methodologies.

Requirements:

• Experience in Azure cloud-based infrastructure and Databricks implementation.
• Experience with SQL.
• Experience with Python, PySpark.
• Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders.
• Working experience in Agile methodolgies – supporting tools (JIRA, Azure DevOps).
• English at least at B2 level, ideally C1.

Nice to have:

• Experience or familiarity with other cloud technologies, data warehouses, data governance, and business analysis.

Missing one or two of these qualifications? We still want to hear from you! If you bring a positive mindset, we'll provide an environment where you feel valued and empowered to learn and grow.