Platform Engineer for Dataiku, Cloudera & Elastic Stack

avacone Switzerland; Basel; Vor Ort; CHF 110.000 - 170.000; Vollzeit

Zusammenfassung

avacone Switzerland in Basel seeks an experienced Platform Engineer to support, maintain and develop our Cloudera, Elastic Stack and Dataiku platform environment.

You will work with data engineers, data scientists and analysts to deliver stable, scalable analytics solutions, driving automation, data pipelines and CI/CD across the stack.

This role emphasizes operations, scripting in Python/Scala, and collaboration with stakeholders to translate requirements into robust platform solutions.

Qualifikationen

• Experience with at least two platforms (Cloudera, Elastic Stack, Dataiku DSS) is required.
• Knowledge of Hadoop ecosystem technologies (HDFS, YARN, Hive, Spark, Kafka) is important.
• Experience with Elasticsearch, Logstash, Kibana, Beats and data pipelines is needed.
• Proficiency in Python and/or Scala for scripting and integration work.
• Experience integrating platforms via REST APIs and working with GitHub, branching, PRs and code reviews.
• Experience with CI/CD, infrastructure automation and deployment processes, with a focus on clean code and proper documentation.
• Strong troubleshooting, analytical and communication skills; ability to translate business requirements into technical solutions.
• Professional English skills are required.

Aufgaben

• Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms.
• Design and develop data pipelines, workflows, dashboards and platform integrations.
• Build real-time streaming solutions using Apache Kafka.
• Develop custom scripts, plugins and integrations using Python or Scala and REST APIs.
• Design and automate ETL and data ingestion using NiFi and Logstash.
• Create Kibana dashboards, reports, queries and search solutions.
• Support deployment and operationalisation of ML models in Dataiku.
• Automate platform deployments and operations using Ansible, Terraform or similar tools.
• Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies.
• Troubleshoot platform, workflow and integration issues; create reusable scripts and documentation.
• Provide guidance, training and platform support to users and internal teams.
• Support weekend or public holiday activities related to system changes or testing.

Kenntnisse

Cloudera platform

Elastic Stack

Dataiku DSS

Hadoop ecosystem

Elasticsearch/Logstash/Kibana

Python/Scala

REST APIs

GitHub/CI/CD

Tools

GitHub Actions

Jenkins

Ansible

Terraform

Puppet

Jobbeschreibung

avacone Switzerland in Basel seeks an experienced Platform Engineer to support, maintain and develop our Cloudera, Elastic Stack and Dataiku platform environment.

You will work with data engineers, data scientists and analysts to deliver stable, scalable analytics solutions, driving automation, data pipelines and CI/CD across the stack.

This role emphasizes operations, scripting in Python/Scala, and collaboration with stakeholders to translate requirements into robust platform solutions.