Senior Associate-Cloud Engineer

Acuity Knowledge Partners; Bengaluru; On-site; INR 1,200,000 - 2,200,000; Full time

Job summary

Acuity Knowledge Partners is seeking a Cloud Engineer in Bengaluru to design, build, automate, deploy and support cloud infrastructure across AWS and Azure. You will work with Kafka-based event streaming and Databricks to enable real-time processing and analytics, while ensuring security and compliance.

The role requires 4–8 years of cloud engineering experience, strong Terraform and CI/CD skills, and hands-on AWS and Azure expertise in production environments.

Qualifications

• Bachelor's degree in CS/Engineering/IT.
• 4–8 years of cloud engineering experience.
• Hands-on AWS (2+ years) and Azure (2+ years) in production environments.
• Proficient with Terraform, CI/CD, Linux and scripting (Shell/Python).

Responsibilities

• Design, build, automate, deploy and support cloud infrastructure on AWS and Azure.
• Manage multi-cloud networking and secure connectivity across AZs.
• Deploy and manage Kafka infrastructure (Confluent Cloud/Platform, MSK) for real-time processing.
• Develop IaC and CI/CD pipelines using Terraform, CloudFormation and Azure Bicep.
• Implement security controls (IAM, TLS, encryption in transit/rest) and monitoring.
• Collaborate with security, data engineering and application teams.

Skills

Cloud engineering

AWS

Azure

DevOps

Terraform

GitHub Actions

Azure DevOps

CI/CD

Linux

Python / Shell scripting

Kafka

Databricks

Kubernetes

Security

Education

Bachelor's degree in Computer Science, Engineering, Information Technology

Tools

Terraform

GitHub Actions

Azure DevOps

CI/CD pipelines

Linux

CloudFormation / Azure Bicep

Job description

We are seeking a Cloud Engineer for a multi-year strategic transformation program modernizing the global middle- and back-office technology platform through a cloud-native, event-driven architecture. The platform leverages AWS, Azure, Kafka-based event streaming, Databricks, modern workflow orchestration, API-led integration and scalable cloud infrastructure. The Cloud Engineer will help design, build, automate, deploy and support critical cloud infrastructure services spanning both AWS (primary) and Azure environments. The successful candidate will work closely with architects, application development teams, infrastructure engineering, security and data engineering teams to deliver highly resilient, secure and scalable cloud solutions supporting real-time trade processing, event-driven integration, analytics and regulatory reporting.

Key responsibilities

• Multi-cloud infrastructure engineering: build and support cloud infrastructure across AWS and Azure environments, and implement secure connectivity using technologies such as Megaport, ExpressRoute, Direct Connect, Private Endpoints and VPC/VNet peering.
• Configure and maintain cloud networking, routing, DNS, load balancing and security controls, and support high-availability and disaster-recovery designs across multiple availability zones and regions.
• Event-driven platform engineering: deploy and manage Kafka infrastructure including Confluent Cloud, Confluent Platform and Amazon MSK, and implement event-streaming infrastructure for realtime trade and lifecycle event processing.
• Configure topics, partitions, consumer groups, Schema Registry, ACLs and cluster linking / replication, and support event replay, resiliency, monitoring, recovery and operational controls.
• Cloud automation & DevOps: develop Infrastructure-as-Code solutions using Terraform, CloudFormation and Azure Bicep (preferred), and build CI/CD pipelines supporting cloud infrastructure deployments.
• Automate infrastructure provisioning and environment build processes, and contribute to platform engineering standards and reusable deployment modules.
• Platform monitoring & observability: implement monitoring and alerting for cloud infrastructure and event platforms using CloudWatch, Azure Monitor, OpenSearch, Grafana and Prometheus.
• Monitor Kafka consumer lag, throughput, infrastructure utilization, connectivity and operational health.
• Security & compliance: implement secure cloud controls consistent with financial-services standards, supporting IAM, Azure Entra ID, RBAC, TLS, encryption at rest and in transit, and secrets management.
• Partner with Cyber Security and Infrastructure teams during architecture reviews and approvals.
• Data & analytics platform support: support connectivity and integration between Kafka platforms and Databricks, and implement secure data-ingestion patterns from real-time event streams into analytics platforms.
• Assist with cloud storage services including Amazon S3 and Azure Data Lake Storage (ADLS), and support data governance, retention and resiliency requirements.
• Bachelor's degree in Computer Science, Engineering, Information Technology or a related field.
• 4-8 years of cloud engineering experience, including 2+ years hands-on AWS and 2+ years hands on Azure.
• Experience supporting production cloud environments within large enterprises and working within Agile delivery teams.
• Strong AWS experience across EC2, VPC, IAM, S3, CloudWatch, Route 53, Security Groups and Amazon MSK.
• DevOps expertise: Terraform, GitHub Actions / Azure DevOps, CI/CD pipelines, Linux administration and Shell or Python scripting.
• Messaging & integration: Apache Kafka, Confluent, event-driven architectures, APIs and microservices, and ESB / integration concepts.
• Containers: Docker and Kubernetes (EKS / AKS preferred).

Preferred qualifications

• Experience with Confluent Cloud and Cluster Linking.
• Experience implementing multi-cloud networking with Megaport.
• Experience building real-time event-streaming platforms and working with Databricks.
• Experience in Capital Markets, Investment Banking or Financial Services.
• Understanding of trade lifecycle concepts across FX, Rates, Derivatives and Securities.
• Exposure to event-driven reference architectures and enterprise integration patterns.
• AWS and/or Azure cloud certifications.