Azure Data Engineer with Databricks (AI&Data)

Accenture Technology; Warszawa, Wrocław; On-site; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Permanent employment

Coaching path

Training package

Employee Assistance Program

Employee Share Purchase Plan

Private medical care

Job summary

Accenture Technology Poland poszukuje specjalisty ds. danych do projektów na platformie Azure. Będziesz projektować i wdrażać skalowalne potoki danych, integrując różnorodne źródła danych z wykorzystaniem Databricks i Azure Data Factory.

Wymagana praktyczna znajomość SQL, PySpark oraz modelowania danych. Doświadczenie w CI/CD i DevOps dla przepływów danych oraz komunikatywność w kontaktach z klientem będą kluczowe.

Qualifications

• Wymagane praktyczne doświadczenie w implementacji rozwiązań z jezior danych i potoków danych (Databricks, Azure Data Factory).
• Doświadczenie w projektowaniu i implementacji rozwiązań w chmurze Azure (mile widziana znajomość AWS, GCP).
• Znajomość SQL, PySpark, modelowania danych (3NF, gwiazda/snowflake) oraz wzorców ELT/ETL.

Responsibilities

• Tworzenie i wdrażanie skalowalnych rozwiązań przetwarzania danych na Azure, transformacja i czyszczenie dużych zestawów danych.
• Projektowanie, budowa i utrzymanie niezawodnych potoków danych z różnych źródeł (bazy danych, API, platformy strumieniowe).
• Współpraca z zespołami data engineerów, data scientists i architektów chmur w celu dostarczenia end‑to‑end platformy danych.
• Udział na wszystkich kluczowych etapach rozwoju projektów z analitykami biznesowymi, ekspertami ds. źródeł danych i właścicielami produktu.

Skills

Databricks

Azure Data Factory

SQL

PySpark

Data modeling

ELT/ETL design patterns

Python

Cloud architecture

CI/CD

DevOps

Power BI

Tools

Databricks

Azure Data Factory

Terraform

ARM templates

Git

Azure DevOps

Job description

Nasze wymagania:

• Hands‑on experience with implementing solutions with data lakes and pipelines (Databricks, Azure Data Factory).
• Proven experience in designing and implementing solutions in Azure cloud (knowledge of AWS, GCP will be an additional advantage).
• Proficiency in SQL, PySpark, data modeling (3NF, star/snowflake schemas) and ELT/ETL design patterns (including Azure Data Factory).
• Experience with Python or similar scripting languages for data transformation, orchestration, and automation.
• Familiarity with advanced Databricks features (Unity Catalog, MLflow, Jobs & Pipelines).
• Understanding of cloud data architecture principles including data Lakehouse concepts, Medallion architecture, API integration, and event‑driven architecture.
• Experience with CI/CD and DevOps practices for data workflows (Git, Azure DevOps) and analytics integration (e.g., Power BI).
• Excellent communication and client‑facing skills with the ability to explain technical concepts clearly.
• Strong collaboration skills across multidisciplinary teams.

Mile widziane:

• Knowledge of modern data stack tools (e.g., dbt, Power BI, Tableau, Looker).
• Experience with infrastructure‑as‑code tools (e.g., Databricks Asset Bundles, Terraform, ARM templates).
• Experience with cost optimization and FinOps principles for cloud data solutions.
• Familiarity with machine learning or GenAI integration — operationalizing AI/ML models or leveraging LLMs within Databricks/Azure.
• Databricks Associate or Professional certifications.
• Microsoft Certifications in the areas of Microsoft Fabric and Azure.

Zakres obowiązków:

• Develop and implement scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets efficiently.
• Design, build, and maintain robust data pipelines integrating data from diverse sources (databases, APIs, streaming platforms).
• Collaborate with cross‑functional teams including data engineers, data scientists, and cloud architects to deliver end‑to‑end data platform solutions.
• Engage at all critical stages of project development with business analysts, source system experts, data architects, engineers, and product owners.
• Clearly communicate and document technical work, factoring in performance and cost considerations in all design decisions

Oferujemy:

• A permanent employment contract.
• Individual support of a People Lead and a defined path for professional development, with the possibility of coaching sessions.
• A wide training package (soft, technical, language training; access to e‑learning platforms; Gallup test; GenAI training; possibility of co‑financing certifications).
• Employee Assistance Program – legal, financial, and psychological consultations.
• Eligibility for the Employee Share Purchase Plan and quarterly dividends if owning company shares.
• Paid employee referral program.
• Private medical care and life insurance.
• Access to the Worksmile platform, including Multisport and a broad portfolio of benefits.