Senior Kafka Engineer & CDP Admin — Real-Time Data Pipelines

Ensisinfo Inc; Denver, St. Louis (CO, MO); On-site; USD 130,000 - 180,000; Full time

Job summary

Ensisinfo Inc is seeking a Senior Kafka Engineer/Administrator to join our team in Denver, CO or St. Louis, MO. You will design, deploy, and manage Kafka clusters, optimize CDP environments, and ensure reliability in enterprise-scale data streaming infrastructure.

The role requires hands-on Kafka administration experience, CDP/CDH proficiency, and strong scripting and monitoring skills. Join a fast-paced, collaborative tech environment with opportunities to influence production systems and

Qualifications

• 3+ years of hands-on Apache Kafka administration and engineering.
• Experience with Cloudera Data Platform (CDP) or CDH.
• Proficiency in Kafka configuration, tuning, and performance optimization.
• Experience with Kafka Connect, Kafka Streams, and Schema Registry.
• Familiarity with Linux/Unix systems administration and shell scripting.
• Strong understanding of distributed systems, networking, and data streaming concepts.
• Experience with monitoring tools such as Prometheus, Grafana, or Confluent Control Center.
• Excellent problem-solving skills and ability to work independently in a collaborative environment.

Responsibilities

• Design, deploy, and manage Apache Kafka clusters in production environments.
• Administer and optimize CDP environments.
• Monitor Kafka broker performance, throughput, and consumer lag to ensure system reliability.
• Develop and maintain Kafka configuration management, tuning, and capacity planning.
• Collaborate with data engineering teams to design and implement real-time data streaming pipelines.
• Troubleshoot and resolve complex Kafka and Cloudera infrastructure issues.
• Implement security best practices including Kafka ACLs, SSL/TLS, and Kerberos authentication.
• Maintain documentation for configurations, runbooks, and operational procedures.

Skills

Kafka administration

Cloudera CDP/CDH

Kafka tuning

Kafka Connect

Kafka Streams

Schema Registry

Unix/Linux

Distributed systems

Prometheus

Grafana

Confluent Control Center

Shell scripting

Tools

Prometheus

Grafana

Confluent Control Center

Job description

Ensisinfo Inc is seeking a Senior Kafka Engineer/Administrator to join our team in Denver, CO or St. Louis, MO. You will design, deploy, and manage Kafka clusters, optimize CDP environments, and ensure reliability in enterprise-scale data streaming infrastructure.

The role requires hands-on Kafka administration experience, CDP/CDH proficiency, and strong scripting and monitoring skills. Join a fast-paced, collaborative tech environment with opportunities to influence production systems and