Data Engineering Lead — Databricks & Azure Platform

Vienna Insurance Group (VIG); Wien; Vor Ort; EUR 90.000 - 130.000; Vollzeit

Benefits dieser Stelle

Home office

Flexible hours

37.5 hours / week

Onboarding program

Childcare services

Health care center

Canteen

Sports facilities

Employee Assistance Program

Flat hierarchy

Zusammenfassung

Vienna Insurance Group (VIG) is seeking a Lead Data Engineer in Vienna to orchestrate a growing data engineering team and drive production-grade Databricks pipelines. You will collaborate with data scientists, engineers, and product owners to design scalable data platforms and implement robust data pipelines.

You will work hands-on with Databricks, Python, Spark SQL, and Lakehouse concepts while using Azure Data Factory for data ingestion and workflow orchestration.

Qualifikationen

• Degree in Computer Science, Software Engineering, Data Engineering/Data Science, or equivalent experience.
• 5+ years in data engineering with leadership experience.
• Hands-on with Databricks (Python, Spark SQL, Lakehouse), Declarative Pipelines, Jobs/Workflows.
• Experience with Azure Data Factory, data modeling, performance tuning, and operating production data systems.
• DataOps mindset: versioning, testing, automated deployments, observability, robust release processes.
• Excellent leadership, communication, teamwork; independent, solution-oriented; very good English; German is a plus.

Aufgaben

• Lead and grow a data engineering team; coordinate projects with data scientists, engineers, and product owners.
• Design, build, and operate scalable Databricks pipelines using Python, Declarative Pipelines, and Jobs/Workflows.
• Use Azure Data Factory for ingestion/orchestration; integrate and optimize SQL/NoSQL databases.
• Define standards, reusable templates, and documentation for group-wide use.
• Ensure pipeline quality via versioning, testing, monitoring, SLAs/SLOs, and automated deployments.
• Manage platform costs and pipeline performance.

Kenntnisse

Databricks

Python

Spark SQL

Lakehouse

Declarative Pipelines

Jobs/Workflows

Azure Data Factory

Data modeling

Performance tuning

Observability

Release processes

Leadership

English

Ausbildung

Bachelor's degree in Computer Science

Tools

Azure Data Factory

SQL/NoSQL databases

Databricks

Jobbeschreibung

Vienna Insurance Group (VIG) is seeking a Lead Data Engineer in Vienna to orchestrate a growing data engineering team and drive production-grade Databricks pipelines. You will collaborate with data scientists, engineers, and product owners to design scalable data platforms and implement robust data pipelines.

You will work hands-on with Databricks, Python, Spark SQL, and Lakehouse concepts while using Azure Data Factory for data ingestion and workflow orchestration.