AWS Data Engineer

Viraaj HR Solutions Private Limited; Chennai District; On-site; INR 1,200,000 - 2,300,000; Full time

Benefits offered by this job

Autonomy

AWS sponsorship

Flexible hours

Job summary

Viraaj HR Solutions Private Limited is actively seeking an experienced Data Engineer to architect and implement scalable AWS data pipelines and data lakes for enterprise clients across India.

You will design, deploy, and optimize data workflows using Glue, Lambda, Step Functions, and EMR, while ensuring governance and reliability across the data platform.

Qualifications

• Experience designing scalable AWS data pipelines and data lakes.
• Hands-on with Glue Data Catalog, partitioning, governance.
• Strong coding in Python/SQL and automation via IaC/CI/CD.

Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions, and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging, and governance.
• Automate infrastructure provisioning and deployments using Terraform, CloudFormation, and CI/CD.
• Implement real-time streaming data workflows using Kinesis, MSK, or DynamoDB Streams with analytics tools.
• Ensure data quality and reliability through monitoring (CloudWatch), alerting, and testing.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI.

Skills

AWS Glue

AWS Lambda

AWS S3

Terraform

Apache Airflow

SQL

Python

Amazon Redshift

Tools

Kinesis

CloudFormation

Spark on EMR

Job description

About The Opportunity

A fast-scaling tech consultancy in the Cloud Data Engineering & Analytics space, we partner with enterprise clients across India to build modern, scalable data platforms on AWS. Our engineers design and deploy data pipelines, data lakes, and analytics architectures that turn raw data into real-time business insights—leveraging AWS-native services, IaC, and DevOps best practices to deliver speed, reliability, and security at scale.

About The Opportunity

A fast-scaling tech consultancy in the Cloud Data Engineering & Analytics space, we partner with enterprise clients across India to build modern, scalable data platforms on AWS. Our engineers design and deploy data pipelines, data lakes, and analytics architectures that turn raw data into real-time business insights—leveraging AWS-native services, IaC, and DevOps best practices to deliver speed, reliability, and security at scale.

Role & Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions, and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging (Glue Data Catalog), and governance controls.
• Automate infrastructure provisioning and deployments using Terraform, CloudFormation, and CI/CD pipelines.
• Implement real-time streaming data workflows using Kinesis, MSK, or DynamoDB Streams integrated with downstream analytics tools.
• Ensure data quality and reliability through monitoring (CloudWatch), alerting, and pipeline testing frameworks.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI (QuickSight, Looker).

Skills & Qualifications

Must-Have

• AWS Glue
• AWS Lambda
• AWS S3
• Terraform
• Apache Airflow
• SQL
• Python
• Amazon Redshift

Preferred

• Amazon Kinesis
• AWS Step Functions
• Apache Spark on EMR

Benefits & Culture Highlights

• Work on high-impact, client-facing AWS data projects with autonomy and technical ownership.
• Growth path into Lead Data Engineer or Cloud Solutions Architect roles within 18–24 months.
• Flexible work hours within on-site structure + regular upskilling and AWS certification sponsorship.

Skills: apache,amazon,cloud,glue,aws,data