Solutions Architect - Big Data and DevOps (f/m/d)

Stackable; City Of London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

An innovative technology company in the UK is seeking a skilled Solutions Architect with a strong background in Big Data technologies. This role involves architecting and implementing scalable data solutions, developing Kubernetes infrastructures, and ensuring best practices in DevOps. The ideal candidate will have hands-on experience with tools like Apache Spark and proficiency in software development with Rust, Java, or Python. Flexible remote and onsite work options are available.

Benefits

Diverse training opportunities

Social benefits (UK pension schema)

Choice of development tools

Qualifications

• Strong hands-on experience with modern Big Data technologies.
• Proficiency in cloud-native technologies and containerization.
• Strong knowledge of DevOps tools.

Responsibilities

• Design and implement Stackable Data Platform solutions.
• Develop and maintain Kubernetes-based infrastructures.
• Design and deploy CI/CD pipelines and infrastructure automation.

Skills

Big Data technologies

Kubernetes

DevOps practices

Apache Spark

Apache Kafka

Terraform

Ansible

Python

Job description

Overview

stackable - who are we?

Stackable is an innovative technology company focused on delivering cutting-edge, opensource Big Data solutions for data lakehouses, data mesh, event processing and AI. We specialise in designing, deploying, and managing scalable datainfrastructures that empower businesses to harness the power of data effectively. Our core product, the Stackable Data Platform, enables companies of all sizes to easily integrate and manage their sovereign data platforms in their respective IT infrastructure.

Your mission at stackable:

We are looking for a skilled Solutions Architect with a strong background in Big Data to join our team. The ideal candidate will have expertise in open source Big Data technologies and Kubernetes and DevOps practices. This role will be instrumental in designing, implementing, and optimizing cloud-based and on-premise data solutions for our clients.

Responsibilities

• You will architect and implement Stackable Data Platform solutions, ensuring scalability, reliability, and security.
• You will develop and maintain Kubernetes-based infrastructures to support data processing and analytics workloads.
• You will design and deploy CI/CD pipelines, infrastructure automation, and monitoring solutions.
• You will work closely with clients and internal teams to translate business requirements into technical solutions.
• You will ensure best practices in DevOps, infrastructure as code, and security.Collaborate with cross-functional teams, including data engineers, software developers,and enterprise architects.

Why you should join us

• Collaboration with an international team based in UK and Germany
• Working either remote or onsite with our customers from UK
• A technology-focused start-up culture
• Choice of development tools
• The chance to shape a sustainable and future-oriented open source product
• Our engineering mindset: our aim is make bring architectures and software available in the most automated, maintainable and robust way possible!
• Diverse training opportunities and social benefits (e.g. UK pension schema)

What do you offer?

• Strong hands-on experience working with modern Big Data technologies such as Apache Spark, Trino, Apache Kafka, Apache Hadoop, Apache HBase, Apache Nifi, Apache Airflow, Opensearch
• Proficiency in cloud-native technologies such as containerization and Kubernetes
• Strong knowledge of DevOps tools (Terraform, Ansible, ArgoCD, GitOps, etc.)
• Proficiency in software development using Rust (ideally), Java, or Python
• Experience with Solution Architecture and designing enterprise-grade data platforms
• Understanding of networking, security, and access controls in on-premenvironments.
• Fluent English skills