Data Engineer for Databricks Platform (all humans)

Erste Digital GmbH; Wien; Vor Ort; EUR 47.000 - 57.000; Vollzeit

Benefits dieser Stelle

Health Centre

Employee benefits

Employee Referral Program

Zusammenfassung

Erste Digital GmbH is seeking a data engineer to build and optimize data solutions on Databricks with PySpark and Delta Lake. You will design end-to-end data ingestion pipelines and maintain centralized ingestion frameworks.

You will troubleshoot data quality issues, implement data quality monitoring, and contribute to CI/CD and IaC initiatives while mentoring junior teammates. English proficiency is required; German is a plus.

Qualifikationen

• 2–5 years of experience in data engineering or a similar role
• Proficient in SQL and Python for data processing, transformation, and analysis
• Experience with Databricks and/or PySpark (Delta Lake, Spark SQL, structured streaming)
• Understanding of data ingestion patterns, ETL/ELT, and data modeling fundamentals
• Experience with software engineering best practices: Git, code reviews, CI/CD pipelines
• Familiarity with cloud platforms, preferably AWS and/or MS Azure
• Strong analytical and problem-solving skills; good communication with technical and business stakeholders
• Not mandatory but beneficial: Terraform, DataOps/MLOps, Unity Catalog, orchestration tools
• English professional proficiency; German (e.g. B2) a plus

Aufgaben

• Work hands-on with Databricks platform, PySpark, and Delta Lake to build and optimize data solutions
• Manage, operate, and improve a centralized data ingestion framework
• Design, build, and maintain data ingestion pipelines end-to-end
• Troubleshoot and resolve data quality incidents with data consumers and stakeholders
• Develop and implement data quality frameworks and monitoring solutions
• Expand platform capabilities by evaluating and adopting new Databricks features
• Contribute to infrastructure-as-code practices and CI/CD pipeline improvements
• Mentor junior team members and support knowledge sharing within the team

Kenntnisse

SQL

Python

Data modeling

Tools

Databricks

PySpark

Delta Lake

Spark SQL

Structured streaming

Git

CI/CD

AWS

Azure

Terraform

Jobbeschreibung

Make a difference in the financial life of millions of people: At Erste Digital you are co-creating the digital future, in which better financial health is possible. #believeinyourself

We are part of Erste Group – the largest banking group in Central and Eastern Europe with more than 2,500 branches and over 45,000 employees. Our more than 2,000 IT experts and enthusiasts are the bank's Digital Muscle.

What to do:

• Work hands-on with the Databricks platform, PySpark, and Delta Lake to build and optimize data solutions

• Manage, operate, and continuously improve a centralized data ingestion framework

• Design, build, and maintain data ingestion pipelines end-to-end

• Troubleshoot and resolve data quality incidents in collaboration with data consumers and stakeholders

• Develop and implement data quality frameworks and monitoring solutions

• Expand platform capabilities by evaluating, testing, and adopting new Databricks features

• Contribute to infrastructure-as-code practices and CI/CD pipeline improvements

• Mentor junior team members and support knowledge sharing within the team

You check these boxes:

• 2–5 years of experience in the recent years in data engineering or a similar role

• Recent active and direct work experience with SQL and Python for data processing, transformation, and analysis & with Databricks and/or PySpark (Delta Lake, Spark SQL, structured streaming)

• Good understanding and expertise in data ingestion patterns, ETL/ELT processes, and data modeling fundamentals

• Experience with software engineering best practices: version control (Git), code reviews, CI/CD pipelines

• Familiarity with cloud platforms, preferably AWS and/or MS Azure

• Strong analytical and problem-solving skills

• Clear verbal and written communication; ability to interact with both technical and business stakeholders

• Systematic, collaborative approach with a continuous learning mindset

• Solid documentation practices

• Not mandatory but beneficial: experience with HashiCorp Terraform, DataOps/MLOps practices, Unity Catalog, workflow orchestration tools

• Language skills: English professional proficiency; German (e.g. B2) is a plus

Why you will like us:

• Possibility to benefit and learn from our international, talented and passionate community at Erste

• Interest groups and clubs: Take part in discussions and get involved in projects. Numerous interest groups invite you to engage with a topic

• Health Centre – The Erste Campus operates a fully equipped health center that offers all employees a high standard of medical services during working hours.

• Employee benefits – Benefit from special conditions for financial services and insurances, supermarkets, clothing stores and many more.

• Employee Referral Program – Become a talent scout for career opportunities in IT. We are rewarding every successful referral for Erste Digital

• A competitive and performance-related salary dependent on your professional and personal qualifications is granted - the minimum wage for this position in accordance with the respective collective agreement is EUR 52.136,- gross per year. But this is just a formality, we are more than happy to discuss your actual expectations.

The way we are:

Erste Group considers the diversity of its employees as key to innovation and success. As employer we are proud to offer everyone equal chances, irrespective of age, skin colour, religious belief, gender, sexual orientation or origin.