Databricks Engineer

Aether Biomedical; Deutschland; Vor Ort; EUR 42.000 - 70.000; Vollzeit

Zusammenfassung

Avanade Poland is seeking a Databricks Engineer to work on projects focusing on Databricks and Azure cloud. The role supports remote work within Poland or hybrid work at offices in Wroclaw and Krakow.

You will design and optimize scalable data pipelines, collaborate with data scientists and engineers, and mentor junior data engineers while exploring advanced AI technologies.

Qualifikationen

• Databricks expertise across platforms and Azure services (Data Factory, Data Lake, SQL Database, Azure Databricks).
• Proficiency in Python and PySpark with strong SQL skills.
• Solid understanding of data engineering concepts: ETL, data modeling, data warehousing, governance.

Aufgaben

• Designing, building, and maintaining scalable data pipelines.
• End-to-end development of data architectures and ETL processes.
• Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization.
• Implementing best engineering practices across data systems.
• Optimizing performance and reliability of data workflows and data solutions.
• Staying up-to-date with the latest developments in data engineering.
• Mentoring and guiding junior data engineers.
• Opportunity to develop yourself in advanced AI technologies.

Kenntnisse

Databricks

Azure

Python

PySpark

SQL

Data engineering concepts

English (B2)

Tools

Docker/Kubernetes

easyOCR

Jobbeschreibung

We're looking for specialists open to cooperate on B2B basis, for our customer - Avanade Poland. Avanade website; Privacy policy This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:

As Databricks Engineer, you will be working in projects for various domains and industries, focused mostly around Databricks and Azure cloud.

Responsibilities:

• Designing, building, and maintaining scalable, efficient, and reliable data pipelines
• End-to-end development of data architectures and ETL processes
• Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization
• Implementing best engineering practices across data systems
• Optimizing performance of data workflows and ensuring the reliability of data solutions
• Staying up-to-date with the latest developments in data engineering world
• Mentoring and providing guidance to junior data engineers
• Possibility to develop yourself in advanced AI technologies

Required skills:

• Databricks
• Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)
• Python and PySpark
• SQL
• Data Engineering concepts such as ETL, data modeling, data warehousing, data governance
• English (B2)

Nice to have:

• Experience with Docker/Kubernetes
• Knowledge of OCR and corresponding libraries (e.g. easyOCR)
• Any experience in data science area

If you want to ask any questions before applying, feel free to reach out via LinkedIn!