Kafka Developer

Test Triangle; Leeds; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading technology firm in the UK is seeking an experienced professional to manage the Kafka integration environment. The role involves overseeing the build and support of Kafka clusters, ensuring high availability, and managing SSL certificates. Candidates should have extensive experience in application integration development, knowledge of cloud services, and a solid background in using monitoring tools. This position offers an opportunity to innovate and automate processes in the integration landscape.

Qualifications

• 5+ years of experience in application integration development.
• 2+ years of experience in Cloud Integration Services and Kafka.
• 3 years of experience in building & managing Open Source / Apache Kafka platforms.
• Experience in Disaster recovery planning & testing.
• Understand clustering and virtualization technologies.

Responsibilities

• Manage Kafka Cluster build and high availability.
• Build and support producer/consumer apps.
• Manage SSL certificate and public key.
• Set up monitoring tools for Kafka components.
• Conduct regular assessments of platform health.

Skills

Application integration development

Cloud Integration Services

Apache Kafka

Database Interaction (Oracle/PostgreSQL)

Disaster recovery planning

Monitoring tools (SPLUNK, Prometheus, Grafana)

Infrastructure knowledge

Clustering and virtualization

Strong communications

Job description

5+ years of experience in application integration development

2+ years of experience in Cloud Integration Services and Kafka

3 years of experience in building & managing Confluent / Apache Kafka platforms in Cloud and/or on premise environments.

Responsibilities

• Manage Kafka Cluster build, including Design, Infrastructure planning, High Availability and Disaster Recovery
• Build and support producer / consumer apps
• SSL Certificate management including public key management
• Setting up monitoring tools such as SPLUNK, Prometheus, Grafana to provide metrics from various Kafka cluster components (eg., Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry, KSQL)
• Undertake Lifecycle Management across the Kafka on premise environments.
• Research and recommend innovative ways to maintain the environment and ensure automation is undertaken.
• Undertake regular assessments of the platform health and stability, create improvement plans and ensure automation/lifecycle management is undertaken.

Qualifications

• 5+ years of experience in application integration development
• 2+ years of experience in Cloud Integration Services and Kafka
• 3 years of experience in building & managing Open Source / Apache Kafka platforms in Cloud and/or on premise environments.
• Interaction with Oracle / PostgreSQL databases
• Experience in Disaster recovery planning & testing for the Middleware Services block application and supporting Product Grid block application testing
• Experience in Setting up monitoring tools for Kafka clusters.
• Knowledge of Infrastructure, Network topologies and Storage (SAN/NAS/DAS)
• Understand clustering and virtualisation technologies
• Architect, being able to attend Architecture forums and demonstrate pros/cons of different solutions
• Strong Communications and ability to work with business areas+