Data Engineer for Databricks Platform (all humans)

Erste Digital; Wien; Vor Ort; EUR 60.000 - 95.000; Vollzeit

Benefits dieser Stelle

Health center

Employee benefits

Referral program

Zusammenfassung

Erste Digital, part of Erste Group, is looking for a data engineer to build and optimize data solutions on Databricks using PySpark and Delta Lake. You will manage a centralized ingestion framework, design end-to-end pipelines, and partner with stakeholders to ensure data quality and robust diagnostics.

You will contribute to IaC practices, CI/CD improvements, and mentor junior team members, while leveraging AWS/Azure cloud familiarity and strong communication across technical and business teams.

Qualifikationen

• 2–5 years of experience in data engineering or a similar role.
• Recent direct work experience with SQL and Python for data processing, transformation, and analysis & with Databricks and/or PySpark (Delta Lake, Spark SQL, structured streaming)
• Good understanding and expertise in data ingestion patterns, ETL/ELT processes, and data modeling fundamentals
• Experience with software engineering best practices: version control (Git), code reviews, CI/CD pipelines
• Familiarity with cloud platforms, preferably AWS and/or MS Azure
• Strong analytical and problem-solving skills
• Clear verbal and written communication; ability to interact with both technical and business stakeholders
• Systematic, collaborative approach with a continuous learning mindset
• Solid documentation practices
• Not mandatory but beneficial: Terraform, DataOps/MLOps, Unity Catalog, workflow orchestration tools
• Language skills: English professional proficiency; German (e.g. B2) is a plus

Aufgaben

• Work hands-on with the Databricks platform, PySpark, and Delta Lake to build and optimize data solutions
• Manage, operate, and continuously improve a centralized data ingestion framework
• Design, build, and maintain data ingestion pipelines end-to-end
• Troubleshoot and resolve data quality incidents in collaboration with data consumers and stakeholders
• Develop and implement data quality frameworks and monitoring solutions
• Expand platform capabilities by evaluating, testing, and adopting new Databricks features
• Contribute to infrastructure-as-code practices and CI/CD pipeline improvements
• Mentor junior team members and support knowledge sharing within the team

Kenntnisse

SQL

Python

Data ingestion

ETL/ELT

Data modeling

Communication

Problem-solving

Documentation

Continuous learning

Tools

Databricks

PySpark

Delta Lake

Git

CI/CD

Terraform

Unity Catalog

Workflow orchestration

Jobbeschreibung

Make a difference in the financial life of millions of people: At Erste Digital you are co-creating the digital future, in which better financial health is possible. #believeinyourself

We are part of Erste Group – the largest banking group in Central and Eastern Europe with more than 2,500 branches and over 45,000 employees. Our more than 2,000 IT experts and enthusiasts are the bank's Digital Muscle.

What to do:

• Work hands-on with the Databricks platform, PySpark, and Delta Lake to build and optimize data solutions


• Manage, operate, and continuously improve a centralized data ingestion framework


• Design, build, and maintain data ingestion pipelines end-to-end


• Troubleshoot and resolve data quality incidents in collaboration with data consumers and stakeholders


• Develop and implement data quality frameworks and monitoring solutions


• Expand platform capabilities by evaluating, testing, and adopting new Databricks features


• Contribute to infrastructure-as-code practices and CI/CD pipeline improvements


• Mentor junior team members and support knowledge sharing within the team

You check these boxes:

• 2–5 years of experience in the recent years in data engineering or a similar role


• Recent active and direct work experience with SQL and Python for data processing, transformation, and analysis & with Databricks and/or PySpark (Delta Lake, Spark SQL, structured streaming)


• Good understanding and expertise in data ingestion patterns, ETL/ELT processes, and data modeling fundamentals


• Experience with software engineering best practices: version control (Git), code reviews, CI/CD pipelines


• Familiarity with cloud platforms, preferably AWS and/or MS Azure


• Strong analytical and problem-solving skills


• Clear verbal and written communication; ability to interact with both technical and business stakeholders


• Systematic, collaborative approach with a continuous learning mindset


• Solid documentation practices


• Not mandatory but beneficial: experience with HashiCorp Terraform, DataOps/MLOps practices, Unity Catalog, workflow orchestration tools


• Language skills: English professional proficiency; German (e.g. B2) is a plus

Why you will like us:

• Possibility to benefit and learn from our international, talented and passionate community at Erste


• Interest groups and clubs: Take part in discussions and get involved in projects. Numerous interest groups invite you to engage with a topic


• Health Centre – The Erste Campus operates a fully equipped health center that offers all employees a high standard of medical services during working hours.


• Employee benefits – Benefit from special conditions for financial services and insurances, supermarkets, clothing stores and many more.


• Employee Referral Program – Become a talent scout for career opportunities in IT. We are rewarding every successful referral for Erste Digital


• A competitive and performance-related salary dependent on your professional and personal qualifications is granted - the minimum wage for this position in accordance with the respective collective agreement is EUR 52.136,- gross per year. But this is just a formality, we are more than happy to discuss your actual expectations.

The way we are:

Erste Group considers the diversity of its employees as key to innovation and success. As employer we are proud to offer everyone equal chances, irrespective of age, skin colour, religious belief, gender, sexual orientation or origin.