Devops Engineer - Remote / Telecommute

Cynet Systems Inc; Minneapolis (MN); Remote; USD 90,000 - 130,000; Full time

Job summary

A leading company is seeking a Kafka Administrator to consult with teams on Kafka integration and manage Kafka clusters. The role involves automating processes, enhancing monitoring, and supporting CI/CD pipelines. Candidates should have 2+ years of Kafka experience and strong technical skills.

Qualifications

• 2+ years of experience with Kafka clustering & administration.
• Experience building, deploying, and supporting Kafka clusters using IaC.
• Strong verbal and written communication skills.

Responsibilities

• Consult with teams on leveraging Kafka within pipelines.
• Architect, build, and support Kafka clusters via IaC.
• Automate operational processes and manage CI/CD pipelines.

Skills

Kafka clustering & administration

Infrastructure-as-Code

Automated processes development

Linux/Unix system management

Git workflows

Agile/Lean methodologies

Strong technical acumen

Strong analytical skills

Tools

Chef

Ansible

Jenkins

Artifactory

Kubernetes

Docker

AWS

Azure

Job description

Job Description:

Responsibilities:

• Consult with inquiring teams on how to leverage Kafka within their pipelines.
• Architect, Build and Support existing and new Kafka clusters via IaC.
• Partner with Client teams to route traffic through Kafka by utilizing open-source agents and collectors deployed via Chef
• Remediate any health issues within Kafka.
• Automate (where possible) any operational processes on the team.
• Create new and/or update monitoring dashboards and alerts as needed.
• Manage a continuous improvement / continuous development (CI/CD) pipeline.
• Perform PoC’s on new components to expand/enhance team’s Kafka offerings.

Skills and Qualifications:

• 2+ years of experience with Kafka clustering & administration.
• 2+ years of experience building, deploying, and supporting multiple Kafka clusters using IaC (Infrastructure-as-Code) best practices.
• Experience developing automated processes within and around Kafka to help supplement the service.
• Experience working with multiple teams to build and architect data pipeline solutions where Kafka will be involved.
• Experience with Linux/Unix and system management.
• IaC (Infrastructure-as-Code) experience with Virtual/Physical Servers using Chef, Ansible, Jenkins, Artifactory, etc.
• Understanding of Git workflows, continuous improvement / continuous development (CI/CD) concepts.
• Strong verbal and written communication skills.
• Strong technical acumen.
• Strong analytical skills.
• Experience working in Agile/Lean methodologies.

Preferred Qualifications:

• Knowledge and experience with Client, Elastic, Kibana and Grafana.
• Knowledge and experience with log collection agents such as Open-Telemetry, Fluent Bit, FluentD, Beats and LogStash.
• Knowledge and experience with Kubernetes / Docker.
• Knowledge and experience with Kafka-Connect.
• Knowledge and experience with AWS or Azure.
• Knowledge and experience with Streaming Analytics.