Kafka Infrastructure Lead, Real-Time Data Pipelines

Cigna Healthcare; Walnut Creek (CA); Hybrid; USD 110,000 - 176,000; Full time

Benefits offered by this job

Health benefits

401(k)

Tuition reimbursement

Paid time off

Job summary

The Cigna Group in Walnut Creek, CA seeks an Infrastructure Engineering Advisor to design and develop Kafka-based data pipelines and messaging solutions that support real-time and near real-time data processing across the organization.

You will configure, deploy, and monitor Kafka clusters; collaborate with application partners to define integration patterns; optimize configurations for reliability and security; and use automation to reduce manual effort, all within a hybrid work schedule.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering or related field and 3 years of Kafka systems administration experience.
• Experience building Kafka clusters with HA and DR capabilities.
• SSL, SASL/LDAP authentication and Kafka ACLs in Zookeeper.
• Kafka Connect cluster deployment and connectors.
• Schema registry and data schemas management.
• Upgrade, monitoring, performance tuning and feature adds on Kafka clusters.
• On-Premises and AWS cloud experience for Kafka.
• Automation using shell scripting, Ansible and Terraform.

Responsibilities

• Configure, deploy, and monitor Kafka clusters.
• Collaborate with application partners to define integration patterns.
• Optimize configurations for efficiency and reliability and ensure security measures are implemented.
• Use automation to perform day to day operations to reduce man hours and operational burden.
• Diagnose and resolve errors in a timely manner not impacting customers.
• Hybrid work schedule.

Skills

Kafka

AWS

Azure

Terraform

Ansible

Okta

Security

Automation

Education

Bachelor’s degree in Computer Science or related

Tools

Kafka Connect

Schema Registry

EC2 / AWS

Job description

The Cigna Group in Walnut Creek, CA seeks an Infrastructure Engineering Advisor to design and develop Kafka-based data pipelines and messaging solutions that support real-time and near real-time data processing across the organization.

You will configure, deploy, and monitor Kafka clusters; collaborate with application partners to define integration patterns; optimize configurations for reliability and security; and use automation to reduce manual effort, all within a hybrid work schedule.