Devops Kafka Confluent Architect

MethodHub; Dallas (TX); On-site; USD 100,000 - 150,000; Part time

Job summary

A leading IT consulting firm is looking for a DevOps Architect based in Dallas, Texas. The role involves setting up CI/CD pipelines, deploying applications in Kubernetes, and automating disaster recovery strategies. Candidates should have extensive experience with tools like Jenkins, Terraform, and Ansible, particularly in hybrid environments. This is a contract position at a mid-senior level.

Qualifications

• Experience setting up CI/CD pipelines using various DevOps tools.
• Experience deploying applications on Kubernetes.
• Expertise in hybrid environments and data center operations.

Responsibilities

• Set up CI/CD pipelines for application deployment in Kubernetes.
• Automate disaster recovery strategy and data replication.
• Collaborate with the DevOps team to establish connectivity between services.

Skills

CI/CD pipelines

Kubernetes

Terraform

Ansible

Kafka

AWS

Python

Tools

Jenkins

Artifactory

Rancher

Vault

Helm

Job description

Responsibilities

• As a DevOps Architect, set up CI/CD pipelines for application deployment in Kubernetes
• Set up Confluent Kafka (MRC or CFK) across all regions in a hybrid environment
• Set up Rancher and downstream Kubernetes clusters in multiple environments and regions
• Set up IaC pipelines using Terraform Enterprise (TFE) and Ansible to automate Kafka cluster deployments
• Set up IaC pipelines using TFE and Ansible to automate Rancher and downstream Kubernetes cluster deployments
• Work in the DevOps team to build new shared infrastructure services for on-premises failover environment (S3, Confluent Kafka, Data Store)
• Collaborate with the DevOps team to establish connectivity between new failover shared services and existing shared services (Secret, identity, LDAP, DNS, Artifactory, Jenkins, Splunk)
• Automate disaster recovery (DR) strategy and data replication between Cloud and failover environments across all applications and shared services; implement CI/CD deployment tools

Must have

• Experience setting up CI/CD pipelines using tools such as Jenkins, Artifactory, Confluent CFK, Kubernetes, Vault, SonarQube, GitHub, Terraform, Ansible, Rancher, and Harness
• Experience deploying applications on Kubernetes using Rancher, Helm Charts, and Harness
• Experience deploying Kafka MRC or CFK and monitoring with tools like LogicMonitor and Splunk
• Experience with AWS and on-premises hybrid environments, especially setting up Confluent CFK or MRC and S3 replication with Cloudian
• CRDs
• K8 Operators
• All general Kubernetes concepts including PVCs

CFK Administration:

• Kafka
• Kraft/Zookeeper
• Kafka Connect
• Kafka backup solution and support
• Pilot Kafka data replication between AWS and On-Prem
• Experience with Rancher RKE2 Kubernetes clusters and orchestration
• K8S cluster management, monitoring, and operational tools integration
• K8s cluster and secrets management integration
• K8s CSI plug-ins with object, file and block storage vendors
• Kubernetes backup solution and support
• S3/Cloudian object storage for shared infrastructure
• Specializing in Cloud Infrastructure Modernization, virtualization, data center setup, DR & BC strategies, and DevOps
• Experience in on-premises data center operations, AWS hosted data center and operations management
• Hands-on experience with migration tools
• Experience with continuous deployment tools, techniques, and automation frameworks – especially Terraform Enterprise and Ansible
• Hands-on experience writing testable scripts using Python or other languages
• Experience managing Helm charts and deploying into Kubernetes
• Expertise with monitoring tools/frameworks like Splunk, LogicMonitor, SignalFX, and Prometheus
• Worked on projects involving deployment and management of microservices and hybrid cloud/on-prem infrastructure
• Intermediate knowledge of development tools like Maven/Gradle, Java, and distributed message brokers like Kafka, RabbitMQ, ActiveMQ, Amazon Kinesis

Good to Have

• Knowledge of setting up CI/CD pipelines for streaming Flink-based applications

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Information Technology

Industries

• IT Services and IT Consulting