Enable job alerts via email!

Devops Lead

TN United Kingdom

Leeds

Hybrid

GBP 60,000 - 100,000

Full time

13 days ago

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

Job summary

An innovative firm is seeking a Kafka Real-Time Architect to design and implement scalable, real-time data processing systems. This role involves architecting Kafka clusters for high availability and integrating them with various data processing platforms. The ideal candidate will have extensive experience with Apache Kafka and its ecosystem, ensuring optimal performance and security of data streams. Join a dynamic team that values collaboration and problem-solving, where your expertise will drive critical business operations and enhance real-time data processing capabilities.

Qualifications

  • 8+ years of extensive experience with Apache Kafka and real-time architecture.
  • Strong knowledge of event-driven frameworks and Kafka data pipelines.

Responsibilities

  • Design and architect scalable, real-time systems in Kafka.
  • Integrate Kafka with data processing tools and monitor performance.

Skills

Apache Kafka
Kafka Streams
Kafka Connect
Spark Streaming
Flink
Beam
Ansible Tower
GCP Pub/Sub
Problem-solving

Job description

Social network you want to login/join with:

Location: Leeds, United Kingdom (Hybrid- 2 days/week)

Job Type: Contract Inside IR35

Client: Wipro

Mandatory Skills: Ansible Tower

Experience: 8+ Years

Detailed JD:

A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms

As part of the CTO Data Ingestion Service, the incumbent will be required to:

Designing and architecting scalable, real-time systems in Kafka.

Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.

Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam.

Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.

Implementing security measures to protect Kafka clusters and data streams.

Monitoring Kafka performance and troubleshooting issues to ensure optimal performance.

Providing technical guidance and support to development operations teams.

Staying updated with the latest Kafka features, updates and industry practices.

Required Skills Experience

Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks.

Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.

Experience with cloud platform such as GCP Pub/Sub.

Excellent problem-solving skills.

Knowledge & Experience / Qualifications

Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.

Monitoring Kafka performance, enhancing decision making and operational efficiency

Collaborating with development teams to integrate Kafka applications and services.

Maintain an architectural library for Kafka deployment models and patterns

Helping developers to maintain Kafka connectors such as JDBC, MongoDB and S3 connectors, along with topics schemas, to streamline data ingestion from databases, NoSQL data stores and cloud storage, enabling faster data insight.

Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.

Similar jobs

Lead DevOps Engineer - Fully Remote Outside IR35

JR United Kingdom

Leeds

Remote

GBP 60,000 - 100,000

6 days ago
Be an early applicant

DevOps Lead

Pyramid Consulting, Inc

Leeds

On-site

USD 70,000 - 120,000

7 days ago
Be an early applicant

Lead DevOps Engineer - Fully Remote Outside IR35

JR United Kingdom

Greater Manchester

Remote

GBP 60,000 - 90,000

3 days ago
Be an early applicant

Lead DevOps Engineer - Fully Remote Outside IR35

JR United Kingdom

Bolton

Remote

GBP 60,000 - 100,000

6 days ago
Be an early applicant

Lead DevOps Engineer - Fully Remote Outside IR35

JR United Kingdom

Ashton-under-Lyne

Remote

GBP 60,000 - 100,000

6 days ago
Be an early applicant

Lead DevOps Engineer - Fully Remote Outside IR35

JR United Kingdom

Leigh

Remote

GBP 60,000 - 90,000

6 days ago
Be an early applicant

DevOps Lead

JR United Kingdom

Leeds

On-site

GBP 60,000 - 100,000

3 days ago
Be an early applicant

Lead DevOps Engineer - SaaS Product (MS Azure)

ZigZag Global

Remote

GBP 60,000 - 100,000

6 days ago
Be an early applicant

Lead DevOps Engineer - SaaS Product (MS Azure)

ZigZag Global

London

Remote

GBP 75,000 - 85,000

6 days ago
Be an early applicant