Devops Lead, Yorkshire

Axiom Software Solutions; Leeds; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A tech solutions provider is seeking an experienced Devops Lead to design and implement real-time systems using Kafka. You will oversee the configuration and maintenance of Kafka clusters and collaborate with various teams to ensure scalable solutions. The role requires at least 8 years of experience in real-time architecture and a strong grasp of Kafka-related tools. This position offers a hybrid work model in Leeds.

Qualifications

• 8+ years of experience in real-time architecture and Apache Kafka.
• Extensive experience with event-driven frameworks.
• Strong knowledge of integrating data processing tools and platforms.

Responsibilities

• Design and architect scalable, real-time systems in Kafka.
• Configure, deploy, and maintain Kafka clusters.
• Collaborate with cross-functional teams for data requirements.
• Implement security measures to protect Kafka clusters.
• Monitor Kafka performance and troubleshoot issues.

Skills

Ansible Tower

Apache Kafka

Kafka Streams

Spark Streaming

Kafka Connect

Flink

Beam

GCP Pub/Sub

Problem-solving

Job description

Overview

Job Title : Devops Lead

Location : Leeds, United Kingdom (Hybrid- 2 days / week)

Job Type : Contract Inside IR35

Client : Wipro

Mandatory Skills : Ansible Tower

Experience : 8+ Years

Detailed JD

A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms.

As part of the CTO Data Ingestion Service, the incumbent will be required to :

• Designing and architecting scalable, real-time systems in Kafka.
• Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.
• Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.
• Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.
• Implementing security measures to protect Kafka clusters and data streams.
• Monitoring Kafka performance and troubleshooting issues to ensure optimal performance.
• Providing technical guidance and support to development operations teams.
• Staying updated with the latest Kafka features, updates and industry practices.

Required Skills & Experience

• Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks.
• Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.
• Experience with cloud platforms such as GCP Pub/Sub.
• Excellent problem-solving skills.

Knowledge Experience / Qualifications

• Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.
• Monitoring Kafka performance, enhancing decision making and operational efficiency.
• Collaborating with development teams to integrate Kafka applications and services.
• Maintain an architectural library for Kafka deployment models and patterns.
• Helping developers to maintain Kafka connectors such as JDBC, MongoDB and S3 connectors, along with topics schemas, to streamline data ingestion from databases, NoSQL data stores and cloud storage, enabling faster data insight.
• Kafka