Senior Databricks Engineer

Aether Biomedical; Deutschland; Vor Ort; EUR 41.697 - 60.229; Vollzeit

Zusammenfassung

Avanade Poland is seeking a Senior Databricks Engineer to work on data engineering projects across domains, focusing on Databricks and Azure cloud.

You will design and maintain scalable data pipelines, collaborate with data scientists and analysts, and mentor team members as needed. Remote work within Poland or hybrid offices in Wroclaw and Krakow, with opportunities to grow into AI engineering.

Qualifikationen

• Commercial experience with Databricks and Azure cloud services.
• Proficient in Python and PySpark, SQL.
• Strong data engineering concepts: ETL, modeling, warehousing, governance.
• Experience with Docker and Kubernetes.
• English proficiency at B2 level or higher.

Aufgaben

• Design, build, and maintain scalable data pipelines.
• End-to-end development of data architectures and ETL processes.
• Collaborate with data scientists, analysts, and other engineering teams to ensure data integration.
• Implement engineering best practices across data systems.
• Optimize performance of data workflows and ensure reliability of data solutions.
• Stay up-to-date with the latest developments in data engineering.
• Act as a Team Lead in the project if needed.
• Possibility to develop yourself in AI engineering.

Kenntnisse

Databricks

Azure Cloud

Python

PySpark

SQL

ETL

Data Modeling

Data Warehousing

Data Governance

Docker

Kubernetes

English B2

OCR

Tools

Azure Data Factory

Data Lake

SQL Database

Azure Databricks

Jobbeschreibung

We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.Avanade website; Privacy policyThis role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:

As Senior Databricks Engineer, you will be working in projects for various domains and industries, focused mostly around Databricks and Azure cloud.

Among your tasks there will be:

• Designing, building, and maintaining scalable, efficient, and reliable data pipelines
• End-to-end development of data architectures and ETL processes
• Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization
• Implementing best engineering practices across data systems
• Optimizing performance of data workflows and ensuring the reliability of data solutions
• Staying up-to-date with the latest developments in data engineering world
• Acting as a Team Lead in the project if needed
• Possibility to develop yourself in AI engineering

Required skills:

• commercial experience with: Databricks Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)
• Python and PySpark
• SQL
• Data Engineering concepts such as ETL, data modeling, data warehousing, data governance
• Docker and Kubernetes
• English (B2)

Nice to have:

• Knowledge of OCR and corresponding libraries (e.g. easyOCR)
• Any experience in data science area

If you want to ask any questions before applying, feel free to reach out via LinkedIn!