Kafka Platform Engineer — High-Availability DataOps

IMCS Group; St. Louis (MO); On-site; USD 99,000 - 121,000; Full time

Job summary

IMCS Group in Saint Louis, MO is seeking a Kafka Admin to manage enterprise-scale Hadoop, Kafka, and AWS cloud platforms, ensuring high availability, security, and performance across data pipelines.

Responsibilities include deploying and tuning Kafka clusters (including AWS MSK), monitoring lag and health, implementing IaC with Terraform and Ansible, and integrating CI/CD with Jenkins or GitHub Actions. Experience with Kubernetes, Docker, and cloud services is required.

Qualifications

• Experience managing enterprise-scale Kafka deployments and AWS MSK.
• Proficient with security, IAM, and encryption standards.
• Strong automation and IaC skills (Terraform, Ansible, CloudFormation).
• Hands-on with CI/CD, monitoring, and incident response.

Responsibilities

• Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments.
• Monitor broker health, lag, and replication; perform capacity planning.
• Implement security with SSL, SASL, ACLs; ensure compliance.
• Design and maintain CI/CD pipelines; automate deployments with IaC.
• Provide Level 2/3 production support and on-call coverage.

Skills

Kafka Administration

Shell Scripting

Python

Jenkins

Git

Ansible

Terraform

Docker

Kubernetes

Monitoring (Grafana/Prometheus)

Security & HA

Education

Bachelor’s degree in Computer Science or related field

Tools

AWS MSK

Airflow

Spark

Cloudera CDP

Kubernetes

Terraform

Docker

GCP

Kafka

Job description

IMCS Group in Saint Louis, MO is seeking a Kafka Admin to manage enterprise-scale Hadoop, Kafka, and AWS cloud platforms, ensuring high availability, security, and performance across data pipelines.

Responsibilities include deploying and tuning Kafka clusters (including AWS MSK), monitoring lag and health, implementing IaC with Terraform and Ansible, and integrating CI/CD with Jenkins or GitHub Actions. Experience with Kubernetes, Docker, and cloud services is required.