Middeware Engineer - Kafka Administration

Request Technology; Chicago (IL); Hybrid; USD 150,000 - 165,000; Full time

Job summary

An established industry player is looking for a highly skilled Infrastructure Middleware Engineer to lead the design and management of scalable Kafka solutions. This role involves automating infrastructure provisioning, implementing cloud-based solutions on AWS and Azure, and optimizing CI/CD pipelines. The ideal candidate will have extensive experience in Kafka administration, infrastructure as code, and container orchestration. Join a dynamic team and play a crucial role in enhancing middleware solutions that ensure high performance and security. This is an exciting opportunity to contribute to innovative projects in a collaborative environment.

Qualifications

• 10+ years of experience in infrastructure middleware administration.
• Strong proficiency in IaC tools like Ansible and Terraform.

Responsibilities

• Design and manage scalable Kafka clusters and cloud-based infrastructure.
• Automate infrastructure provisioning and CI/CD pipelines.

Skills

Kafka Administration

Infrastructure as Code (IaC)

Cloud Automation

Container Orchestration

CI/CD Pipelines

Troubleshooting

Scripting (Python, Bash)

Networking Principles

Education

Bachelor's degree in Computer Science or Engineering

Tools

Ansible

Terraform

AWS

Azure

Kubernetes

Rancher

GitHub

Artifactory

Harness

Jenkins

Job description

Chicago, IL

Request Technology Chicago, IL

1 week ago Be among the first 25 applicants

Base pay range

$150,000.00/yr - $165,000.00/yr

Executive Recruiter / Account Manager / Owner

Lead Associate Principal, Software Engineering: Middleware - KAFKA Administrator

LOCATION: CHICAGO, IL

Hybrid 3 days onsite

Open to h1b

SELLING POINTS: 10 years Kafka administration, infrastructure as a code, cloud/automation, container orchestration.

We are seeking a highly skilled and experienced Infrastructure Middleware Engineer with deep expertise in Kafka administration, infrastructure as code (IaC), cloud automation, container orchestration and CI/CD pipelines. The ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable middleware solutions, ensuring high availability, performance, and security. You will play a crucial role in automating infrastructure provisioning, deployments, and operations, enabling our organization to rapidly deliver and scale applications.

Primary Duties and Responsibilities:

• Design, implement and manage highly available and scalable Kafka clusters.
• Monitor Kafka performance, troubleshoot issues and optimize configurations.
• Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration Management.
• Create and maintain reusable IaC modules.
• Design and implement cloud-based infrastructure solutions on AWS and Azure.
• Automate cloud resource provisioning, scaling and management using cloud-native tools and services.
• Deploy and manage containerized applications using Kubernetes and Rancher.
• Troubleshoot container-related issues and optimize container performance.
• Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins.
• Automate the build, test and deployment of middleware components.
• Integrate IaC and container technologies into CI/CD pipelines.
• Document all processes and procedures.
• Work with development teams to ensure smooth deployments.

Qualifications:

• Strong proficiency in IaC tools, specifically Ansible, Terraform and bash scripting.
• Extensive experience with cloud automation and provisioning on AWS and Azure.
• Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins.
• Strong scripting skills in languages like Python and Bash.
• Excellent troubleshooting and problem-solving skills.
• Understanding of networking principles.
• Experience with monitoring tools like Splunk, Splunk OTEL, Prometheus and Grafana.

Technical Skills:

Education and/or Experience:

• Bachelor's degree in Computer Science, Engineering or a related field (or equivalent experience).
• 10+ years of experience in infrastructure middleware administration.
• In-depth expertise in Kafka administration, including cluster management, performance tuning, and security.

Certificates or Licenses:

AWS Solutions Architect, CKAD or CKA certifications preferred.

Seniority level

Not Applicable

Employment type

Full-time

Job function

Information Technology