Platform Engineer

avacone Switzerland; Basel; Hybrid; CHF 100.000 - 160.000; Vollzeit

Zusammenfassung

avacone Switzerland seeks an experienced Platform Engineer to advance and sustain our Cloudera, Elastic Stack and Dataiku platform environment. You will partner with data engineers and scientists to deliver scalable data analytics solutions, develop pipelines, and automate operations.

Responsibilities include building streaming solutions with Kafka, automating deployments with Ansible/Terraform, and enabling ML model deployment in Dataiku.

Qualifikationen

• Strong experience with two or more platforms among Cloudera, Elastic Stack, Dataiku DSS
• Solid knowledge of Hadoop ecosystem (HDFS, YARN, Hive, Spark, Kafka)
• Experience with Elasticsearch, Logstash, Kibana and Beats
• Proficiency in Python and/or Scala scripting
• API integration via REST
• GitHub workflows, code reviews and CI/CD processes
• Secure coding practices and documentation standards
• Excellent problem solving and communication skills
• Business requirements translated into technical solutions
• Professional English communication

Aufgaben

• Support, maintain and optimize Cloudera, Elastic Stack and Dataiku platforms
• Design and develop data pipelines, workflows and platform integrations
• Build real-time streaming solutions using Apache Kafka
• Develop scripts and integrations in Python/Scala
• Design ETL and data ingestion with NiFi and Logstash
• Create Kibana dashboards and reporting
• Deploy and operationalize ML models in Dataiku
• Automate deployments using Ansible, Terraform or similar tools
• Implement CI/CD pipelines with GitHub Actions or Jenkins
• Troubleshoot platform, workflow and integration issues
• Create reusable scripts, templates and technical documentation
• Provide guidance and training to users and internal teams
• Occasional weekend/public holiday work related to system changes or testing

Kenntnisse

Cloudera

Elastic Stack

Dataiku DSS

Tools

GitHub

Jenkins

Ansible

Terraform

Jobbeschreibung

We are looking for an experienced Platform Engineer to support, maintain and further develop our Cloudera, Elastic Stack & Dataiku platform environment. The role combines platform operations, solution development, automation and user support. You will work closely with data engineers, data scientists, analysts and business stakeholders to deliver stable, scalable and efficient data and analytics solutions.

Key Responsibilities

• Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms
• Design and develop data pipelines, workflows, dashboards and platform integrations
• Build and support real-time streaming solutions using Apache Kafka
• Develop custom scripts, plugins and integrations using Python, Scala and REST APIs
• Design and automate ETL and data ingestion processes using tools such as Apache NiFi and Logstash
• Create Kibana dashboards, reports, queries and search solutions
• Support the deployment and operationalisation of machine learning models in Dataiku
• Automate platform deployments and operations using Ansible, Terraform or similar tools
• Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies
• Troubleshoot platform, workflow and integration issues
• Create reusable scripts, templates, libraries and technical documentation
• Provide guidance, training and platform support to users and internal teams
• Support occasional weekend or public holiday activities related to system changes or testing

Requirements

Required Skills and Experience

• Strong experience with at least two of the following platforms:
  • Cloudera
  • Elastic Stack
  • Dataiku DSS
• Good knowledge of Hadoop ecosystem technologies such as HDFS, YARN, Hive, Spark and Kafka
• Experience with Elasticsearch, Logstash, Kibana and Beats
• Experience designing data pipelines, ETL processes and streaming solutions
• Programming or scripting experience with Python and/or Scala
• Experience integrating platforms and external systems through REST APIs
• Good knowledge of GitHub, branching strategies, pull requests and code reviews
• Experience with CI/CD, infrastructure automation and deployment processes
• Understanding of clean code, secure coding and documentation standards
• Strong troubleshooting, analytical and communication skills
• Ability to translate business requirements into practical technical solutions
• Professional English skills

Preferred Qualifications

• Experience with machine learning deployment and data science platforms
• Knowledge of Apache NiFi, Terraform, Ansible or Puppet
• Experience working in enterprise-scale data and analytics environments
• Familiarity with agile and DevOps working practices

General Information

• Workload: 100%
• Start Date: As soon as possible
• Location: Flexible, with availability during Swiss working hours

Expected Outcomes

• Stable and well-maintained platform environments
• Reliable delivery of data pipelines, dashboards and analytics solutions
• Automated and optimised platform operations
• Effective user support and knowledge transfer
• Clear, reusable and up-to-date technical documentation