AWS Data Engineer Job ID: 390293

Viraaj HR Solutions; Delhi; On-site; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

AWS certification sponsorship

Flexible work hours within on-site

Upskilling opportunities

Job summary

Viraaj HR Solutions is seeking a seasoned Data Engineer in Delhi to design and implement scalable AWS data pipelines and data lakes. You will build end-to-end ETL processes using Glue/Lambda, maintain infrastructure as code with Terraform, and orchestrate workflows with Apache Airflow.

The role emphasizes data quality, governance, and collaboration with analytics teams to enable self-serve BI on Redshift and Athena.

Qualifications

• Strong experience with AWS data services and ETL pipelines.
• Proficient in Python and SQL for data manipulation.
• Hands-on Terraform and CI/CD for infra as code.

Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions, and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging (Glue Data Catalog), and governance controls.
• Automate infrastructure provisioning and deployments using Terraform, CloudFormation, and CI/CD pipelines.
• Implement real-time streaming data workflows using Kinesis, MSK, or DynamoDB Streams integrated with downstream analytics tools.
• Ensure data quality and reliability through monitoring (CloudWatch), alerting, and pipeline testing frameworks.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI (QuickSight, Looker).

Skills

Python

SQL

Tools

AWS Glue

AWS Lambda

AWS S3

Terraform

Apache Airflow

Amazon Redshift

Job description

About the Opportunity

A fast-scaling tech consultancy in the Cloud Data Engineering & Analytics space, we partner with enterprise clients across India to build modern, scalable data platforms on AWS. Our engineers design and deploy data pipelines, data lakes, and analytics architectures that turn raw data into real-time business insights—leveraging AWS-native services, IaC, and DevOps best practices to deliver speed, reliability, and security at scale.

Role & Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions, and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging (Glue Data Catalog), and governance controls.
• Automate infrastructure provisioning and deployments using Terraform, CloudFormation, and CI/CD pipelines.
• Implement real-time streaming data workflows using Kinesis, MSK, or DynamoDB Streams integrated with downstream analytics tools.
• Ensure data quality and reliability through monitoring (CloudWatch), alerting, and pipeline testing frameworks.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI (QuickSight, Looker).

Skills & Qualifications

Must-Have

• AWS Glue
• AWS Lambda
• AWS S3
• Terraform
• Apache Airflow
• SQL
• Python
• Amazon Redshift

Preferred

• Amazon Kinesis
• AWS Step Functions
• Apache Spark on EMR

Benefits & Culture Highlights

• Work on high-impact, client-facing AWS data projects with autonomy and technical ownership.
• Growth path into Lead Data Engineer or Cloud Solutions Architect roles within 18–24 months.
• Flexible work hours within on-site structure + regular upskilling and AWS certification sponsorship.