AWS Data Engineer

Viraaj HR Solutions Private Limited; Kolkata Metropolitan Area; On-site; INR 1,000,000 - 1,800,000; Full time

Benefits offered by this job

AWS certification sponsorship

Flexible work hours

Job summary

Viraaj HR Solutions Private Limited in India seeks an experienced Data Engineer to design and maintain scalable AWS data pipelines and data lakes. You will automate infrastructure with Terraform, deploy real-time streaming workflows, and ensure data quality through monitoring and testing.

You will collaborate with analytics teams to model data warehouses and enable self-service BI using Redshift, Athena, and QuickSight/Looker.

Qualifications

• Must have hands-on experience with AWS data services for pipelines and lakes.
• Strong scripting in Python and SQL for data processing and governance.
• Proficiency with infrastructure as code tools (Terraform, CloudFormation) and CI/CD.

Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions, and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging, and governance controls.
• Automate infrastructure provisioning using Terraform and CloudFormation with CI/CD pipelines.
• Implement real-time streaming workflows using Kinesis or DynamoDB Streams with downstream analytics tools.
• Ensure data quality and reliability via monitoring, alerting, and testing frameworks.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI.

Tools

AWS Glue

AWS Lambda

AWS S3

Terraform

Apache Airflow

SQL

Python

Amazon Redshift

Job description

About The Opportunity

A fast-scaling tech consultancy in the Cloud Data Engineering & Analytics space, we partner with enterprise clients across India to build modern, scalable data platforms on AWS. Our engineers design and deploy data pipelines, data lakes, and analytics architectures that turn raw data into real-time business insights—leveraging AWS-native services, IaC, and DevOps best practices to deliver speed, reliability, and security at scale.

Role & Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions, and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging (Glue Data Catalog), and governance controls.
• Automate infrastructure provisioning and deployments using Terraform, CloudFormation, and CI/CD pipelines.
• Implement real-time streaming data workflows using Kinesis, MSK, or DynamoDB Streams integrated with downstream analytics tools.
• Ensure data quality and reliability through monitoring (CloudWatch), alerting, and pipeline testing frameworks.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI (QuickSight, Looker).

Skills & Qualifications

Must-Have

• AWS Glue
• AWS Lambda
• AWS S3
• Terraform
• Apache Airflow
• SQL
• Python
• Amazon Redshift

Preferred

• Amazon Kinesis
• AWS Step Functions
• Apache Spark on EMR

Benefits & Culture Highlights

• Work on high-impact, client-facing AWS data projects with autonomy and technical ownership.
• Growth path into Lead Data Engineer or Cloud Solutions Architect roles within 18–24 months.
• Flexible work hours within on-site structure + regular upskilling and AWS certification sponsorship.

Skills: apache,amazon,cloud,glue,aws,data