Platform Engineer

avacone Switzerland; Basel; Hybrid; CHF 120,000 - 180,000; Full time

Job summary

avacone Switzerland is seeking an experienced Platform Engineer to support, maintain and further develop Cloudera, Elastic Stack and Dataiku platform environments. The role combines platform operations, solution development, automation and user support.

You will work closely with data engineers, data scientists, analysts and business stakeholders to deliver stable, scalable and efficient data and analytics solutions.

Qualifications

• Experience with Hadoop ecosystem technologies such as HDFS, YARN, Hive, Spark and Kafka.
• Experience with Elasticsearch, Logstash, Kibana and Beats.
• Experience designing data pipelines, ETL processes and streaming solutions.
• Programming or scripting experience with Python and/or Scala.
• Experience integrating platforms and external systems through REST APIs.

Responsibilities

• Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms.
• Design and develop data pipelines, workflows, dashboards and platform integrations.
• Build and support real-time streaming solutions using Apache Kafka.
• Develop custom scripts, plugins and integrations using Python, Scala and REST APIs.
• Design and automate ETL and data ingestion processes using tools such as Apache NiFi and Logstash.
• Create Kibana dashboards, reports, queries and search solutions.
• Support the deployment and operationalisation of machine learning models in Dataiku.
• Automate platform deployments and operations using Ansible, Terraform or similar tools.
• Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies.
• Troubleshoot platform, workflow and integration issues.
• Create reusable scripts, templates, libraries and technical documentation.
• Provide guidance, training and platform support to users and internal teams.
• Support occasional weekend or public holiday activities related to system changes or testing.

Skills

Python/Scala scripting

REST API integration

CI/CD knowledge

GitHub workflows

Troubleshooting

Communication skills

English proficiency

Tools

Cloudera

Elastic Stack

Dataiku DSS

Job description

We are looking for an experienced

Cloudera, Elastic Stack & Dataiku

Position Overview

We are looking for an experienced Platform Engineer to support, maintain and further develop our Cloudera, Elastic Stack and Dataiku platform environment.

The role combines platform operations, solution development, automation and user support. You will work closely with data engineers, data scientists, analysts and business stakeholders to deliver stable, scalable and efficient data and analytics solutions.

Key Responsibilities

• Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms
• Design and develop data pipelines, workflows, dashboards and platform integrations
• Build and support real-time streaming solutions using Apache Kafka
• Develop custom scripts, plugins and integrations using Python, Scala and REST APIs
• Design and automate ETL and data ingestion processes using tools such as Apache NiFi and Logstash
• Create Kibana dashboards, reports, queries and search solutions
• Support the deployment and operationalisation of machine learning models in Dataiku
• Automate platform deployments and operations using Ansible, Terraform or similar tools
• Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies
• Troubleshoot platform, workflow and integration issues
• Create reusable scripts, templates, libraries and technical documentation
• Provide guidance, training and platform support to users and internal teams
• Support occasional weekend or public holiday activities related to system changes or testing
  

Requirements

Required Skills and Experience

• Strong experience with at least two of the following platforms:
  • Cloudera
  • Elastic Stack
  • Dataiku DSS
• Good knowledge of Hadoop ecosystem technologies such as HDFS, YARN, Hive, Spark and Kafka
• Experience with Elasticsearch, Logstash, Kibana and Beats
• Experience designing data pipelines, ETL processes and streaming solutions
• Programming or scripting experience with Python and/or Scala
• Experience integrating platforms and external systems through REST APIs
• Good knowledge of GitHub, branching strategies, pull requests and code reviews
• Experience with CI/CD, infrastructure automation and deployment processes
• Understanding of clean code, secure coding and documentation standards
• Strong troubleshooting, analytical and communication skills
• Ability to translate business requirements into practical technical solutions
• Professional English skills

Preferred Qualifications

• Experience with machine learning deployment and data science platforms
• Knowledge of Apache NiFi, Terraform, Ansible or Puppet
• Experience working in enterprise-scale data and analytics environments
• Familiarity with agile and DevOps working practices

General Information

• Workload: 100%
• Start Date: As soon as possible
• Location: Flexible, with availability during Swiss working hours

Expected Outcomes

• Stable and well-maintained platform environments
• Reliable delivery of data pipelines, dashboards and analytics solutions
• Automated and optimised platform operations
• Effective user support and knowledge transferClear, reusable and up-to-date technical documentation