Senior Associate-Cloud Engineer

Acuity-Knowledge-Partners; Bengaluru; On-site; INR 2,000,000 - 3,200,000; Full time

Job summary

Acuity-Knowledge-Partners in Bengaluru is seeking a Cloud Engineer to lead a multi-year transformation, delivering a cloud-native, event-driven platform supporting real-time trade processing and analytics across AWS and Azure.

You will architect, build, automate, deploy and support cloud services; collaborate with architects, security, data and infra teams to ensure resilient, compliant and scalable solutions.

Qualifications

• Bachelor's degree required in CS/Engineering/IT or related field.
• 4–8 years of cloud engineering experience with 2+ years hands-on AWS and 2+ years hands-on Azure.
• Experience in large enterprises and Agile delivery teams.
• Strong AWS experience across EC2, S3, IAM, CloudWatch, Route 53.
• DevOps: Terraform, GitHub Actions / Azure DevOps, CI/CD pipelines, Linux administration and scripting.
• Messaging & integration: Apache Kafka, Confluent, event-driven architectures, APIs and microservices.
• Containers: Docker and Kubernetes.

Responsibilities

• Build and support multi-cloud infrastructure across AWS and Azure environments.
• Configure networking, routing, DNS, load balancing and security controls; support HA/DR designs across AZs and regions.
• Deploy and manage Kafka infrastructure (MSK, Confluent) and event streaming for real-time processing.
• Configure topics, partitions, consumer groups, Schema Registry, ACLs and replication.
• Develop IaC solutions using Terraform, CloudFormation and Azure Bicep; build CI/CD pipelines.
• Automate provisioning and environment builds; contribute to deployment modules.
• Monitor and observability with CloudWatch, Azure Monitor, OpenSearch, Grafana, Prometheus.
• Ensure security/compliance with IAM, TLS, encryption at rest/in transit, secrets management.
• Collaborate with Cyber Security and Infrastructure during architecture reviews.

Skills

Cloud engineering

AWS

Azure

Kafka

Terraform

CI/CD

Docker

Kubernetes

Databricks

Security

Education

Bachelor's degree in Computer Science, Engineering, Information Technology or related field

Tools

Confluent Cloud

Confluent Platform

MSK

Megaport

ExpressRoute

Direct Connect

VPC/VNet peering

Terraform (IaC)

CloudFormation

Azure Bicep

Job description

We are seeking a Cloud Engineer for a multi-year strategic transformation program modernizing the global middle- and back-office technology platform through a cloud-native, event-driven architecture. The platform leverages AWS, Azure, Kafka-based event streaming, Databricks, modern workflow orchestration, API-led integration and scalable cloud infrastructure. The Cloud Engineer will help design, build, automate, deploy and support critical cloud infrastructure services spanning both AWS (primary) and Azure environments. The successful candidate will work closely with architects, application development teams, infrastructure engineering, security and data engineering teams to deliver highly resilient, secure and scalable cloud solutions supporting real-time trade processing, event-driven integration, analytics and regulatory reporting.

Key responsibilities

• Multi-cloud infrastructure engineering: build and support cloud infrastructure across AWS and Azure environments, and implement secure connectivity using technologies such as Megaport, ExpressRoute, Direct Connect, Private Endpoints and VPC/VNet peering.
• Configure and maintain cloud networking, routing, DNS, load balancing and security controls, and support high-availability and disaster-recovery designs across multiple availability zones and regions.
• Event-driven platform engineering: deploy and manage Kafka infrastructure including Confluent Cloud, Confluent Platform and Amazon MSK, and implement event-streaming infrastructure for realtime trade and lifecycle event processing.
• Configure topics, partitions, consumer groups, Schema Registry, ACLs and cluster linking / replication, and support event replay, resiliency, monitoring, recovery and operational controls.
• Cloud automation & DevOps: develop Infrastructure-as-Code solutions using Terraform, CloudFormation and Azure Bicep (preferred), and build CI/CD pipelines supporting cloud infrastructure deployments.
• Automate infrastructure provisioning and environment build processes, and contribute to platform engineering standards and reusable deployment modules.
• Platform monitoring & observability: implement monitoring and alerting for cloud infrastructure and event platforms using CloudWatch, Azure Monitor, OpenSearch, Grafana and Prometheus.
• Monitor Kafka consumer lag, throughput, infrastructure utilization, connectivity and operational health.
• Security & compliance: implement secure cloud controls consistent with financial-services standards, supporting IAM, Azure Entra ID, RBAC, TLS, encryption at rest and in transit, and secrets management.
• Partner with Cyber Security and Infrastructure teams during architecture reviews and approvals.
• Data & analytics platform support: support connectivity and integration between Kafka platforms and Databricks, and implement secure data-ingestion patterns from real-time event streams into analytics platforms.
• Assist with cloud storage services including Amazon S3 and Azure Data Lake Storage (ADLS), and support data governance, retention and resiliency requirements.
• Bachelor's degree in Computer Science, Engineering, Information Technology or a related field.
• 4–8 years of cloud engineering experience, including 2+ years hands-on AWS and 2+ years hands on Azure.
• Experience supporting production cloud environments within large enterprises and working within Agile delivery teams.
• Strong AWS experience across EC2, VPC, IAM, S3, CloudWatch, Route 53, Security Groups and Amazon MSK.
• DevOps expertise: Terraform, GitHub Actions / Azure DevOps, CI/CD pipelines, Linux administration and Shell or Python scripting.
• Messaging & integration: Apache Kafka, Confluent, event-driven architectures, APIs and microservices, and ESB / integration concepts.
• Containers: Docker and Kubernetes (EKS / AKS preferred).

Preferred qualifications

• Experience with Confluent Cloud and Cluster Linking.
• Experience implementing multi-cloud networking with Megaport.
• Experience building real-time event-streaming platforms and working with Databricks.
• Experience in Capital Markets, Investment Banking or Financial Services.
• Understanding of trade lifecycle concepts across FX, Rates, Derivatives and Securities.
• Exposure to event-driven reference architectures and enterprise integration patterns.
• AWS and/or Azure cloud certifications.