Lead Middleware Engineer - Kafka Administration / IaC / DevOps at Request Technology Dallas, TX

Comunidade Metodista; Dallas (TX); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Comunidade Metodista in Dallas, TX, is seeking a Lead Middleware Kafka Administrator with deep expertise in Kafka, IaC, and cloud automation. You will design, deploy, and maintain highly available Kafka clusters, build reusable IaC modules with Terraform and Ansible, and drive secure, scalable middleware solutions in a hybrid environment.

The role requires current Kafka administration with 8+ years, 5+ years in Terraform/Ansible, and strong scripting.

Qualifications

• 8+ years of Kafka administration experience.
• 5+ years with Terraform and Ansible for IaC.
• Strong scripting and cloud automation skills.
• Experience with CI/CD pipelines and monitoring tools.

Responsibilities

• Design and manage highly available Kafka clusters.
• Develop and maintain Terraform/Ansible IaC modules.
• Implement cloud-based infrastructure on AWS/Azure.
• Automate provisioning and container orchestration with Kubernetes/Rancher.
• Design CI/CD pipelines integrating GitHub, Artifactory, Harness and Jenkins.
• Monitor performance and tune configurations for security and reliability.

Skills

Kafka administration

Infrastructure as Code

Terraform

Ansible

Bash scripting

Python

Kubernetes

Cloud automation

CI/CD

Monitoring

Security

Education

Bachelor's degree in Computer Science or Engineering

Tools

Harness

Jenkins

GitHub

Artifactory

Prometheus

Grafana

Splunk

Job description

Lead Middleware Kafka Administration / DevOps / IaC

The key to this rule is CURRENT Kafka administration (minimum eight years).

Five years in Terraform, Ansible, and Infrastructure as a Code IaC.

Nice to haves: Kubernetes, Rancher, GitHub, Artifactory.

LOCATION:

Dallas, TX.

Hybrid 3 days onsite.

Open to h1b.

Looking for 10 years Kafka administration infrastructure as a code cloud/automation container orchestration CID pipeline Kafka Ansible Terraform Bash Kubernetes Rancher GitHub artifactory harness Jenkins AWS Azure CICD IaC automated Cloud provisioning cluster management performance tuning and security.

We are seeking a highly skilled and experienced Infrastructure Middleware Engineer with deep expertise in Kafka administration, infrastructure as code (IaC), cloud automation, container orchestration and CI/CD pipelines. The ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable middleware solutions, ensuring high availability, performance, and security.

Primary Duties and Responsibilities:

• Design, implement and manage highly available and scalable Kafka clusters.
• Monitor Kafka performance, troubleshoot issues and optimize configurations.
• Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration Management.
• Create and maintain reusable IaC modules.
• Design and implement cloud-based infrastructure solutions on AWS and Azure.
• Automate cloud resource provisioning, scaling and management using cloud-native tools and services.
• Deploy and Manage containerized applications using Kubernetes and Rancher.
• Troubleshoot container-related issues and optimize container performance.
• Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins.
• Automated the build, test and deployment of middleware components.
• Integrate IaC and container technologies into CI/CD pipelines.
• Document all processes and procedures.
• Work with development teams to ensure smooth deployments.

The requirements listed are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the primary functions.

Qualifications:

• Strong proficiency in IaC tools, specifically Ansible, Terraform and bash scripting.
• Extensive experience with cloud automation and provisioning on AWS and Azure.
• Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins.
• Strong scripting skills in languages like Python and Bash.
• Excellent troubleshooting and problem-solving skills.
• Understanding of networking principles.
• Experience with monitoring tools like Splunk, Splunk OTEL, Prometheus and Grafana.

Technical Skills:

• Kafka, Ansible, Terraform, Bash, Kubernetes, Rancher, GitHub, Artifactory, Harness, Jenkins, AWS, Azure, CI/CD, IaC, Automated Cloud Provisioning.

Education and/or Experience:

• Bachelors degree in Computer Science, Engineering or a related field (or equivalent experience).
• 10+ years of experience in infrastructure middlware administration.
• In-depth expertise in Kafka administration, including cluster management, performance tuning, and security.

Certificates or Licenses:

• AWS Solutions Architect, CKAD or CKA certifications preferred.