Solution Architect

Axiom Software Solutions Limited; Leeds; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

A leading company is seeking a Solution Architect to join their team in Leeds on a hybrid basis. The role involves designing scalable real-time systems using Kafka, ensuring high availability, and collaborating with cross-functional teams. Candidates should have extensive experience with Kafka and real-time technologies like Spark, along with strong problem-solving skills.

Qualifications

• Extensive experience with Apache Kafka and real-time architecture including event-driven frameworks.
• Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
• Experience with cloud platforms such as GCP Pub/Sub.

Responsibilities

• Designing and architecting scalable, real-time systems in Kafka.
• Configuring, deploying, and maintaining Kafka clusters.
• Monitoring Kafka performance and troubleshooting issues.

Skills

Apache Kafka

Real-time architecture

Problem-solving

Job description

Job title: Solution Architect

Location: Leeds, UK (Hybrid- 3 days/week)

Type: Contract

Client: Wipro

Job description

As part of the CTO Data Ingestion Service, the incumbent will be required to:

1. Designing and architecting scalable, real-time systems in Kafka, with a focus on on-premise Cloudera open source Kafka and disaster recovery aspects.
2. Configuring, deploying, and maintaining Kafka clusters to ensure high availability, resiliency, and scalability, including understanding and explaining features like KRAFT.
3. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
4. Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.
5. Implementing security measures to protect Kafka clusters and data streams.
6. Monitoring Kafka performance, troubleshooting issues, and enhancing disaster recovery strategies.
7. Providing technical guidance and support to development operations teams.
8. Staying updated with the latest Kafka features, industry practices, and real-time technologies like Spark.

Mandatory keywords:

• Experience with on-premise/cloudera open source Kafka
• Focus on disaster recovery aspects
• Knowledge of Kafka resiliency and new features like KRAFT
• Experience with real-time technologies such as Spark

Required Skills & Experience

• Extensive experience with Apache Kafka and real-time architecture including event-driven frameworks.
• Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam.
• Experience with cloud platforms such as GCP Pub/Sub.
• Excellent problem-solving skills.

Knowledge & Experience / Qualifications

• Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.
• Monitoring Kafka performance, enhancing decision making and operational efficiency.
• Collaborating with development teams to integrate Kafka applications and services.
• Maintaining an architectural library for Kafka deployment models and patterns.
• Helping developers to maintain Kafka connectors such as JDBC, MongoDB, and S3 connectors, along with topic schemas, to streamline data ingestion from databases, NoSQL data stores, and cloud storage, enabling faster data insights.