Senior Kafka Administrator

Pyramid Consulting, Inc; St. Louis (MO); On-site; USD 69,000 - 76,000; Full time

Job summary

Senior Kafka Administrator is sought for an immediate on-site contract with Pyramid Consulting, Inc. The role focuses on on-prem Confluent Platform operations, hardware refresh planning, and reliability improvements across on-prem and cloud components in Denver or St.

Louis. Responsibilities include designing and operating highly available Kafka clusters, managing topics and retention, upgrades, and implementing Connect, Schema Registry, MirrorMaker, and REST Proxy.

Qualifications

• 5+ years in systems/platform engineering, SRE, or DevOps.
• 4 years operating Kafka in production at scale.
• Experience with Apache Kafka and AWS MSK operations.
• Hardware refreshes or major cluster rebuilds/migrations with minimal downtime.
• Strong Linux fundamentals and networking.
• Proficiency in automation/scripting.
• Experience with monitoring/observability tools such as Data Dog, Grafana, and JMX exporters.
• Proven ability to produce clear, comprehensive documentation.

Responsibilities

• Own and evolve the on-prem event streaming platform with a primary focus on Confluent Platform.
• Lead planning and execution of a hardware refresh for on-prem clusters.
• Drive reliability and performance while embedding DevOps/automation across provisioning, deployment, observability, and incident response.
• Design, deploy, and operate highly available Kafka clusters (on-prem, cloud, and/or managed services).
• Manage topics, partitions, quotas, retention policies, and consumer group strategies for performance and cost.
• Own upgrades, patches, and migrations.
• Implement and manage Kafka components: Kafka Connect, Schema Registry, MirrorMaker/Confluent Replicator, and REST Proxy.
• Conduct performance tuning, throughput testing, and benchmarking.
• Develop operational documentation, including standards, runbooks, and monitoring configurations.
• Facilitate knowledge transfer sessions and documentation handoff at project milestones.

Skills

Kafka administration

SRE / DevOps

AWS MSK

Linux

Automation

Networking

Documentation

Performance tuning

Tools

Kafka Connect

Schema Registry

MirrorMaker/Confluent Replicator

REST Proxy

Data Dog

Grafana

JMX exporters

Job description

Immediate need for a talented Senior Kafka Administrator. This is a 06+ Month contract opportunity with long-term potential and is located in Denver, CO / St. Louis, MO (Onsite).

Job Diva ID: 26-32192

Pay Range: $50/hr - $55/hr. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities:

• Own and evolve the on-prem event streaming platform with a primary focus on Confluent Platform.
• Lead planning and execution of a hardware refresh for on-prem clusters.
• Drive reliability and performance while embedding DevOps/automation across provisioning, deployment, observability, and incident response.
• Design, deploy, and operate highly available Kafka clusters (on-prem, cloud, and/or managed services).
• Manage topics, partitions, quotas, retention policies, and consumer group strategies for performance and cost.
• Own upgrades, patches, and migrations.
• Implement and manage Kafka components: Kafka Connect, Schema Registry, MirrorMaker/Confluent Replicator, and REST Proxy.
• Conduct performance tuning, throughput testing, and benchmarking.
• Develop operational documentation, including standards, runbooks, and monitoring configurations.
• Facilitate knowledge transfer sessions and documentation handoff at project milestones.

Key Requirements and Technology Experience:

• Experience with Apache Kafka and AWS MSK operations and integration.
• Experience executing hardware refreshes or major cluster rebuilds/migrations with minimal downtime.
• 5+ years in systems/platform engineering, SRE, or DevOps; 4 years operating Kafka in production at scale.
• Deep knowledge of Kafka internals: partitions, replication, retention/compaction, rebalance strategies.
• Hands-on experience with Kafka Connect, Schema Registry, and MirrorMaker/Confluent Replicator.
• Strong Linux fundamentals and networking skills (TCP, DNS, load balancing).
• Proficiency in automation/scripting.
• Experience with monitoring/observability tools such as Data Dog, Grafana, and JMX exporters.
• Proven ability to produce clear, comprehensive documentation.

Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.