Technology Engineer - (Redis & Kafka)

GSS Tech Group; Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

GSS Tech Group is seeking an experienced Technology Engineer to design, implement, and optimize Redis and Kafka platforms for real-time, mission-critical applications. You will work on distributed systems, platform engineering, automation, and DevOps, collaborating with development, security, and operations teams to ensure scalable, secure platforms.

You will design and manage Redis and Kafka deployments, drive automation, and support cloud-native platforms across AWS/Azure/OCI/OpenShift.

Qualifications

• Experience designing and managing Redis and Kafka platforms.
• Strong automation, Cloud and CI/CD expertise.
• Proven track record in enterprise-scale distributed systems.

Responsibilities

• Design, implement, configure, and manage Redis clusters.
• Deploy and optimize Kafka clusters for high throughput.
• Ensure HA, resilience, security, and disaster recovery.
• Build and maintain CI/CD pipelines (Git, Jenkins, ArgoCD).
• Automate infrastructure provisioning and cloud deployments.
• Support cloud-native platform deployments across multiple clouds.

Skills

Distributed systems

DevOps

Platform engineering

Automation

CI/CD

Cloud technologies

Agile/Scrum

Production support

Tools

Redis

Kafka

OpenShift

Jenkins

ArgoCD

Git

GitOps

Job description

We are seeking an experienced Technology Engineer with strong expertise in Redis, Kafka, and cloud-native platform engineering to join our Technology Engineering team. The ideal candidate will be responsible for designing, implementing, administering, and optimizing enterprise Redis and Kafka platforms supporting high-performance, real-time, mission-critical applications.

The role requires strong experience in distributed systems, platform engineering, automation, DevOps, cloud technologies, CI/CD, and production support. The successful candidate will work closely with development, infrastructure, security, and operations teams to ensure platform scalability, resilience, performance, and security.

Key Responsibilities

• Design, implement, configure, and manage Enterprise Redis and Open Source Redis clusters.
• Deploy, administer, and optimize Apache Kafka clusters for high-throughput, real-time streaming environments.
• Ensure high availability, scalability, resilience, disaster recovery, and security of Redis and Kafka platforms.
• Perform Redis and Kafka performance tuning, capacity planning, health monitoring, and optimization.
• Troubleshoot complex production issues across distributed platform environments.
• Manage platform upgrades, patching, configuration management, and lifecycle maintenance.
• Build and maintain CI/CD pipelines using Git, Jenkins, ArgoCD, and GitOps methodologies.
• Automate infrastructure provisioning and deployment using modern cloud automation tools.
• Support cloud-native platform deployments across AWS, Azure, OCI, and OpenShift environments.
• Collaborate with development teams to support caching, messaging, streaming, and distributed application requirements.
• Implement monitoring, alerting, logging, and operational best practices for production environments.
• Drive platform governance, engineering standards, security compliance, and operational excellence.
• Work closely with Infrastructure, DevOps, Security, Architecture, and Application Engineering teams.
• Support Agile delivery methodologies and participate in sprint planning, backlog refinement, and technical discussions.
• Research, evaluate, and benchmark new platform technologies and engineering best practices.
• Ensure platform compliance with organizational security, regulatory, encryption, anonymization, and data integrity standards.

Required Technical Skills

Redis

• Strong hands-on experience with Enterprise Redis and Open Source Redis.
• Redis Cluster design, deployment, administration, and management.
• Redis performance tuning and optimization.
• High Availability (HA), replication, clustering, backup, and disaster recovery.
• Redis security and production support.

Apache Kafka

• Kafka installation, setup, configuration, and administration.
• High-throughput messaging platforms.
• Kafka cluster management.
• Kafka monitoring and troubleshooting.
• Event-driven architecture implementation.

DevOps & Platform Engineering

• OpenShift.
• Jenkins.
• ArgoCD.
• Git.
• GitOps.
• CI/CD pipeline implementation.
• Infrastructure automation.
• Production platform support.

Cloud Technologies

Experience working with one or more public cloud platforms:

• AWS
• Microsoft Azure
• Oracle Cloud Infrastructure (OCI)

Distributed Systems

Strong understanding of:

• Distributed systems architecture
• Distributed services resiliency
• Network fundamentals
• Host-level routing
• Streaming platforms
• Distributed caching
• Performance tuning
• Large-scale platform operations

Streaming Technologies

Experience with:

• Kafka
• Streaming datasets at scale

Good to have:

• Kafka Streams
• Apache Flink
• Apache Beam
• Apache Spark
• Similar streaming technologies

Software Engineering

• Design patterns
• Automated unit testing
• Integration testing
• Production troubleshooting
• Platform monitoring
• Cloud-native application architecture

Security & Compliance

Strong understanding of:

• Security engineering practices
• Infrastructure security
• Encryption
• Data anonymization
• Data integrity
• Regulatory compliance
• Secure logging practices
• PII handling
• Memory data protection
• Vulnerability management

Functional Skills

• Experience working in Agile/Scrum environments.
• Strong analytical and problem-solving skills.
• Experience designing enterprise platform architectures.
• Technology research and benchmarking.
• Ability to influence engineering decisions across multiple teams.
• Strong ownership mindset with minimal supervision.
• Excellent troubleshooting and production support capabilities.

Soft Skills

• Excellent verbal and written communication skills.
• Strong stakeholder management and collaboration skills.
• Strategic thinking with an innovation and R&D mindset.
• Self-motivated and proactive approach to problem-solving. ???
• Ability to work effectively in cross-functional and geographically distributed teams.
• Strong presentation and interpersonal skills.

Nice to Have

• Apache Flink
• Apache Beam
• Kafka Streams
• Apache Spark
• Event-driven microservices
• Cloud-native architectures
• Infrastructure as Code (IaC)
• Kubernetes
• Container orchestration
• Large-scale financial services or enterprise platform experience

Preferred Experience

• Enterprise Platform Engineering
• Technology Platforms
• Data Platforms
• Real-Time Streaming Platforms
• Cloud Infrastructure
• High-Availability Distributed Systems
• Banking or Financial Services domain (preferred)