Lead Kafka Middleware Engineer

Request Technology, LLC; Coppell (TX); On-site; USD 140,000 - 165,000; Full time

Job summary

A prestigious financial institution seeks a Lead Kafka Middleware Engineer in Coppell, Texas. The ideal candidate will design and maintain scalable middleware solutions, focusing on Kafka administration, IaC, and cloud automation. This full-time role offers a competitive salary range of $140,000 to $165,000 based on experience.

Qualifications

• 10+ years of experience in infrastructure middleware administration.
• In-depth expertise in Kafka administration including cluster management.

Responsibilities

• Design, implement and manage highly available Kafka clusters.
• Develop and maintain IaC using Ansible and Terraform.
• Automate cloud resource provisioning using cloud-native tools.

Skills

IaC

Cloud Automation

Troubleshooting

Problem Solving

Education

Bachelors degree in Computer Science

Tools

Ansible

Terraform

AWS

Azure

GitHub

Jenkins

Splunk

Prometheus

Grafana

Job description

6 days ago Be among the first 25 applicants

Request Technology, LLC provided pay range

This range is provided by Request Technology, LLC. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$140,000.00/yr - $165,000.00/yr

Direct message the job poster from Request Technology, LLC

Prestigious Financial Institution is currently seeking a Lead Kafka Middleware Engineer with deep expertise in Kafka administration, infrastructure as code (IaC), cloud automation, container orchestration and CI/CD pipelines. The ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable middleware solutions, ensuring high availability, performance, and security. Candidate will play a crucial role in automating infrastructure provisioning, deployments, and operations, enabling our organization to rapidly deliver and scale applications.

Responsibilities:

• Design, implement and manage highly available and scalable Kafka clusters.
• Monitor Kafka performance, troubleshoot issues and optimize configurations.
• Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration Management.
• Create and maintain reusable IaC modules.
• Design and implement cloud-based infrastructure solutions on AWS and Azure.
• Automate cloud resource provisioning, scaling and management using cloud-native tools and services.
• Deploy and Manage containerized applications using Kubernetes and Rancher
• Troubleshoot container-related issues and optimize container performance.
• Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins.
• Automated the build, test and deployment of middleware components.
• Integrate IaC and container technologies into CI/CD pipelines.
• Document all processes and procedures.
• Work with development teams to ensure smooth deployments.

Qualifications:

• Strong proficiency in IaC tools, specifically Ansible, Terraform and bash scripting.
• Extensive experience with cloud automation and provisioning on AWS and Azure.
• Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins.
• Strong scripting skills in languages like Python and Bash.
• Excellent troubleshooting and problem-solving skills
• Understanding of networking principles.
• Experience with monitoring tools like Splunk, Splunk OTEL, Prometheus and Grafana.
• Bachelors degree in Computer Science, Engineering or a related field (or equivalent experience)
• 10+ years of experience in infrastructure middleware administration.
• In-depth expertise in Kafka administration, including cluster management, performance tuning, and security.
• AWS Solutions Architect, CKAD or CKA certifications preferred.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

Referrals increase your chances of interviewing at Request Technology, LLC by 2x

DevOps Engineer with Ariba or SAC experience - 100% Remote

Irving, TX $150,000.00-$165,000.00 2 weeks ago

Middleware Integration Engineer - API/Webhooks/Kafka - 100% Remote

Dallas, TX $150,000.00-$170,000.00 5 days ago

Cloud Platform Engineer -DevOps and Windriver

Dallas, TX $120,000.00-$150,000.00 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.