Platform Engineer: Cloudera, Elastic & Dataiku

avacone Switzerland; Greater London; Hybrid; GBP 85,000 - 130,000; Full time

Job summary

Cloudera, Elastic Stack & Dataiku is seeking an experienced Platform Engineer to support, maintain and advance our data platform environment. You will collaborate with data engineers, scientists and stakeholders to deliver scalable analytics solutions.

You will design pipelines, dashboards and integrations, automate deployments, and support ML model deployment in Dataiku, while ensuring robust, secure operations and clear documentation.

Qualifications

• Experience with big data platforms and data pipelines.
• Hands-on development with Python/Scala and REST APIs.
• CI/CD, automation and platform operations experience.

Responsibilities

• Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms.
• Design and develop data pipelines, workflows, dashboards and platform integrations.
• Build streaming solutions using Apache Kafka.
• Develop scripts and integrations using Python/Scala and REST APIs.
• Automate ETL and data ingestion with NiFi and Logstash.
• Create Kibana dashboards, reports and search solutions.
• Support ML model deployment in Dataiku.
• Automate deployments with Ansible, Terraform or similar.
• Implement CI/CD with GitHub Actions or Jenkins.
• Troubleshoot platform, workflow and integration issues.
• Create reusable scripts, templates and technical docs.
• Provide guidance and training to users and teams.
• Occasional weekend/public holiday work for system changes.

Skills

Platform engineering

Python

Scala

REST APIs

CI/CD

Troubleshooting

Communication

English proficiency

Tools

GitHub Actions

Jenkins

Terraform

Ansible

NiFi

Logstash

Kibana

Beats

Dataiku DSS

Job description

Cloudera, Elastic Stack & Dataiku is seeking an experienced Platform Engineer to support, maintain and advance our data platform environment. You will collaborate with data engineers, scientists and stakeholders to deliver scalable analytics solutions.

You will design pipelines, dashboards and integrations, automate deployments, and support ML model deployment in Dataiku, while ensuring robust, secure operations and clear documentation.