Senior Kafka Platform Engineer - Onsite, Enterprise Scale

Apex Systems; Maryland Heights (MO); Sur place; USD 150 000 - 190 000; Plein temps

Avantages offerts par ce poste

Comprehensive benefits

Training programs

Résumé du poste

Apex Systems is seeking a Senior Kafka Engineer / Administrator to support and enhance a large-scale streaming platform spanning on-premises and cloud environments. The role focuses on Kafka administration, production support, platform reliability, automation, and enablement across Cloudera, Confluent Platform, and AWS MSK.

The candidate will contribute to modernization efforts and help transition workloads to AWS MSK, working collaboratively with cross-functional teams and coordinating across

Qualifications

• Five or more years of experience in data, platform, infrastructure, or systems engineering.

Responsabilités

• Administer and support Kafka clusters across Cloudera, Confluent Platform, and AWS MSK.
• Monitor platform health, availability, scalability, and performance.
• Manage Kafka topics, partitions, replication, retention, quotas, ACLs, and consumer groups.
• Tune Kafka brokers, producers, and consumers for throughput, latency, and reliability.
• Perform cluster patching, upgrades, capacity planning, and performance troubleshooting.
• Participate in production support, incident response, on-call coverage, and root-cause analysis.
• Support the ongoing transition of workloads from on-premises environments to AWS MSK.
• Build and maintain Kafka and AWS MSK infrastructure using Terraform and manage deployments through GitLab CI/CD pipelines.
• Build and maintain Datadog dashboards, monitoring, and alerting for Kafka and AWS MSK.
• Serve as a technical liaison between the platform team and producer/consumer application teams.

Connaissances

Kafka administration

Terraform

GitLab CI/CD

Datadog monitoring

AWS MSK

Cloudera

Confluent Platform

Bash/Python scripting

Linux networking

Production support

Outils

Terraform

GitLab CI/CD

Datadog

AWS MSK

Cloudera

Confluent Platform

Description du poste

Apex Systems is seeking a Senior Kafka Engineer / Administrator to support and enhance a large-scale streaming platform spanning on-premises and cloud environments. The role focuses on Kafka administration, production support, platform reliability, automation, and enablement across Cloudera, Confluent Platform, and AWS MSK.

The candidate will contribute to modernization efforts and help transition workloads to AWS MSK, working collaboratively with cross-functional teams and coordinating across