Senior Data Platform Engineer (f/m/x)

Klinikum Austria Gesundheitsgruppe GmbH; Wien; Vor Ort; EUR 70.000 - 90.000; Vollzeit

Benefits dieser Stelle

Hybrid working model

Individual training and development opportunities

Meal allowance

Health initiatives

Company pension scheme

Team events

Good public transport connections

Support for relocation process

Zusammenfassung

Klinikum Austria Gesundheitsgruppe GmbH is seeking an experienced Senior Data Platform Engineer to manage and further develop a cloud-based data platform in AWS. You will be responsible for the administration, optimization, and troubleshooting of big data architectures.

The ideal candidate should possess strong knowledge of Linux and Hadoop services, along with experience in Terraform, Spark, and Python. This role involves on-call duties and offers a hybrid working model.

Qualifikationen

• Very good knowledge of Linux.
• Strong experience with Hadoop services such as HDFS, Zookeeper, Yarn, Impala, Spark, and Kafka.
• Experience with Terraform for infrastructure automation.
• Programming skills in Spark and Python.
• Practical experience with on-call duty and structured troubleshooting.
• Team-oriented working style with a strong team spirit.

Aufgaben

• Administer, monitor, and optimize a big data platform in the AWS Cloud.
• Manage and maintain Cloudera On-Cloud PaaS services as well as AWS-native technologies.
• Deploy and automate infrastructure in AWS using Terraform and ArgoCD.
• Execute updates and incident management for all platform components.
• Advise data platform developers on suitable services for business use cases.
• Take over 3rd-level support, including monitoring and troubleshooting.
• Optimize workloads, e.g., Flink job memory management.

Kenntnisse

Linux

Hadoop services (HDFS, Zookeeper, Yarn, Impala, Spark, Kafka)

Terraform

Spark

Python

On-call duty experience

Team-oriented working style

Kubernetes (nice to have)

Cloudera services (Hue, Knox, Ranger, etc.)

Rolling restarts in production environments

Jobbeschreibung

Our client, an established company in the software industry, operates a modern, cloud-based data platform in an AWS environment. To strengthen the team, we are looking for an experienced Senior Data Platform Engineer who is passionate about managing, optimizing, and further developing complex big data architectures.

Your responsibilities:

• Administration, monitoring, and optimization of a big data platform in the AWS Cloud
• Management and maintenance of Cloudera On-Cloud PaaS services as well as AWS-native technologies such as Kafka, Flink, NiFi, Iceberg Tables, and DynamoDB
• Deployment and automation of infrastructure in AWS using Terraform and ArgoCD
• Execution of updates, upgrades, and incident management for all platform components
• Advising data platform developers on selecting suitable services for business use cases
• Taking over 3rd-level support, including monitoring, error analysis, and troubleshooting to ensure a highly available system (including 24/7 on-call duty)
• Optimization of workloads, e.g.:
  • Flink job memory management
  • Impala and Trino query optimization
• Evaluation and implementation of cloud-native services in accordance with the existing system architecture

Your profile:

• Very good knowledge of Linux
• Strong experience with Hadoop services such as HDFS, Zookeeper, Yarn, Impala, Spark, and Kafka
• Experience with Terraform for infrastructure automation
• Programming skills in Spark and Python
• Practical experience with on-call duty and structured troubleshooting
• Team-oriented working style and strong team spirit
• Nice to have:
  • Experience with Kubernetes
  • Specific knowledge of Cloudera services such as HDFS, Zookeeper, Yarn, Impala, Hue, Spark, Kafka, Flink, Knox, Ranger RAZ, Streams Messaging Manager, NiFi, and Kudu
  • Experience with rolling restarts in production environments

What you can look forward to:

• Hybrid working model and flexible working hours
• Individual training and development opportunities
• Working with modern cloud and big data technologies
• Meal allowance as well as free drinks and fruit
• Health initiatives and company pension scheme
• Team events and professional exchange in engineering communities
• Good public transport connections and parking facilities
• Support with any required relocation process