Cloud Data Engineer

CloudXtreme; Hyderabad, Pune District, Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

CloudXtreme in Hyderabad, India is seeking a seasoned cloud data engineer to design, develop and deploy data warehouses and data marts on AWS, leveraging scalable services, secure networking, and robust data governance.

You will implement event-driven architectures, real-time ingestion with Kafka and Kinesis, and containerized platforms with Docker and Kubernetes, while building CI/CD pipelines (Jenkins, GitHub, CodePipeline) in an Agile environment.

Qualifications

• Experience designing and implementing data warehouses on AWS.
• Strong background in deploying a broad set of AWS services (database, networking, security).
• Hands-on with CI/CD using Jenkins, GitHub, and AWS Code services.

Responsibilities

• Design, develop, and integrate data warehouses and data marts on AWS.
• Configure and automate provisioning of AWS resources using IaC tools like Terraform/CloudFormation.
• Build containerized platforms using Kubernetes and Docker; implement real-time data ingestion with Kafka/Kinesis.

Skills

AWS cloud architecture

Data warehouse design

Real-time data streaming

CI/CD automation

Kubernetes

Kafka

Security best practices on AWS

Infrastructure as code

Tools

Kinesis

Lambda

Redshift

RDS

Terraform

Ansible

Puppet

Chef

CloudFormation

CodeCommit

CodeBuild

CodeDeploy

CodePipeline

Jenkins

GitHub

Docker

Kubernetes

Job description

Role & responsibilities

Total experience with strong experience in designing, developing, integrating, implementing Data Warehouses, Data marts and application development on the public cloud AWS platform Experience in deploying and configuring a wide range of AWS services including databases, networking, and security Experienced with event-driven architecture and worked on real-time data ingestion strategy Big data/Stream platform development experience using Kafka Experience working with Kinesis, Lambda, Redshift, RDS Big Data Experience in configuring and automating the provisioning of Amazon Web Services resources and services Experience implementing infrastructure as code/systems management/automation tools using Terraform, Ansible/Puppet/Chef, CloudFormation Good Experience working on CI/CD automation using CodeCommit, CodeBuild, CodeDeploy, CodePipeline, Jenkins, GitHub, Docker Experience in designing and setting-up complex CI and CD workflows (Jenkins/Jenkinsfiles, GitLab CI, Spinnaker, AWS CodeDeploy, Docker containers) Good experience in designing and working on AWS Kinesis, Redshift, Glue, Data Pipeline, API Gateway, Docker Containers, Kubernetes, AutScaling, Elastic Load Balancer, Cloud Watch Events Experience in building container hosting-platform using Kubernetes Experience working within Agile, Scrum, or SAFe methodologies