Cloud Data Engineer

Aanseacore; India; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Aanseacore is seeking an experienced Cloud Data Engineer to design, develop, and implement scalable cloud data platforms on AWS. The role emphasizes real-time ingestion, data warehouses, and data marts using streaming and batch pipelines.

You will build and automate infrastructure, develop complex CI/CD workflows, and collaborate with cross-functional teams in an Agile environment. Strong Kubernetes and container skills are required for deployment and orchestration.

Qualifications

• Strong experience designing, developing, integrating, and implementing Data Warehouses, Data Marts, and cloud data solutions.
• Hands-on experience with AWS cloud services, including databases, networking, security, and resource provisioning.
• Strong experience with AWS Kinesis, Lambda, Redshift, RDS, Glue, Data Pipeline, API Gateway, and CloudWatch Events.
• Experience with event-driven architecture and real-time data ingestion.
• Strong Big Data and streaming platform experience, particularly Apache Kafka.
• Experience with Infrastructure as Code and automation using Terraform, Ansible, Puppet, Chef, or CloudFormation.
• Strong experience with CI/CD automation using Jenkins, GitHub, AWS CodeCommit, CodeBuild, CodeDeploy, and CodePipeline.
• Experience designing complex CI/CD workflows, including Jenkins/Jenkinsfiles, GitLab CI, Spinnaker, AWS CodeDeploy, and Docker.
• Hands-on experience with Docker, Kubernetes, container orchestration, and container hosting platforms.
• Experience with Auto Scaling, Elastic Load Balancer, and AWS infrastructure automation.
• Experience working with Agile, Scrum, or SAFe methodologies.
• Strong analytical, problem-solving, collaboration, and communication skills.

Responsibilities

• Design, develop, integrate, and implement scalable cloud-based Data Warehouses and Data Marts.
• Design and implement real-time data ingestion solutions using Kafka, Kinesis, and event-driven architectures.
• Develop and manage AWS-based data solutions using Redshift, RDS, Glue, Lambda, Data Pipeline, and API Gateway.
• Configure, automate, and manage AWS infrastructure, databases, networking, security, and cloud resources.
• Implement Infrastructure as Code and infrastructure automation using Terraform, CloudFormation, Ansible, Puppet, or Chef.
• Design, implement, and maintain complex CI/CD pipelines and deployment workflows using Jenkins, GitLab CI, AWS DevOps services, and Docker.
• Build and manage containerized applications and Kubernetes-based container hosting platforms.
• Configure and optimize AWS services including Auto Scaling, Elastic Load Balancing, and CloudWatch.
• Automate application and infrastructure deployments across development, testing, and production environments.
• Collaborate with data engineering, application development, DevOps, cloud, and business teams to deliver scalable solutions.
• Participate in Agile/Scrum/SAFe ceremonies, technical planning, troubleshooting, and continuous improvement initiatives.

Skills

Data warehousing

AWS

Kafka

Kubernetes

CI/CD automation

Terraform

Python

Big Data

Real-time ingestion

Agile

Tools

AWS Redshift

AWS Kinesis

AWS Lambda

AWS RDS

AWS Glue

Data Pipeline

API Gateway

CloudWatch Events

Terraform

Jenkins

CodePipeline

Docker

Kubernetes

Job description

We are seeking an experienced Cloud Data Engineer with strong expertise in designing, developing, integrating, and implementing Data Warehouses, Data Marts, and cloud-based data solutions on AWS. The ideal candidate will have hands-on experience with AWS services, real-time data ingestion, event-driven architectures, Big Data and streaming platforms, Infrastructure as Code, CI/CD automation, containerization, and Kubernetes. The role will involve building scalable cloud data platforms, automating infrastructure and deployments, implementing complex CI/CD workflows, and collaborating with cross-functional teams in Agile environments.

Skill / Qualifications

• Strong experience designing, developing, integrating, and implementing Data Warehouses, Data Marts, and cloud data solutions.
• Hands-on experience with AWS cloud services, including databases, networking, security, and resource provisioning.
• Strong experience with AWS Kinesis, Lambda, Redshift, RDS, Glue, Data Pipeline, API Gateway, and CloudWatch Events.
• Experience with event-driven architecture and real-time data ingestion.
• Strong Big Data and streaming platform experience, particularly Apache Kafka.
• Experience with Infrastructure as Code and automation using Terraform, Ansible, Puppet, Chef, or CloudFormation.
• Strong experience with CI/CD automation using Jenkins, GitHub, AWS CodeCommit, CodeBuild, CodeDeploy, and CodePipeline.
• Experience designing complex CI/CD workflows, including Jenkins/Jenkinsfiles, GitLab CI, Spinnaker, AWS CodeDeploy, and Docker.
• Hands-on experience with Docker, Kubernetes, container orchestration, and container hosting platforms.
• Experience with Auto Scaling, Elastic Load Balancer, and AWS infrastructure automation.
• Experience working with Agile, Scrum, or SAFe methodologies.
• Strong analytical, problem-solving, collaboration, and communication skills.

Job Responsibilities

• Design, develop, integrate, and implement scalable cloud-based Data Warehouses and Data Marts.
• Design and implement real-time data ingestion solutions using Kafka, Kinesis, and event-driven architectures.
• Develop and manage AWS-based data solutions using Redshift, RDS, Glue, Lambda, Data Pipeline, and API Gateway.
• Configure, automate, and manage AWS infrastructure, databases, networking, security, and cloud resources.
• Implement Infrastructure as Code and infrastructure automation using Terraform, CloudFormation, Ansible, Puppet, or Chef.
• Design, implement, and maintain complex CI/CD pipelines and deployment workflows using Jenkins, GitLab CI, AWS DevOps services, and Docker.
• Build and manage containerized applications and Kubernetes-based container hosting platforms.
• Configure and optimize AWS services including Auto Scaling, Elastic Load Balancing, and CloudWatch.
• Automate application and infrastructure deployments across development, testing, and production environments.
• Collaborate with data engineering, application development, DevOps, cloud, and business teams to deliver scalable solutions.
• Participate in Agile/Scrum/SAFe ceremonies, technical planning, troubleshooting, and continuous improvement initiatives.