AWS Data Engineer

Viraaj HR Solutions Private Limited; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Benefits offered by this job

AWS certification sponsorship

Technical ownership of projects

Flexible work hours

Job summary

Viraaj HR Solutions Private Limited is seeking a data engineer to design and maintain scalable AWS data pipelines and data lakes. You will implement real-time streaming, data governance, and BI-ready architectures in collaboration with analytics teams.

You will work with Glue, Lambda, S3, Terraform, and Airflow to automate infrastructure and data workflows, enabling rapid, secure insights for enterprise clients across India.

Qualifications

• Must have hands-on experience with AWS Glue, Lambda and S3 for data engineering pipelines.
• Proficient in Terraform, Airflow, and Redshift for data lake and warehouse architectures.
• Strong Python and SQL skills for data manipulation and querying.

Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging, and governance controls.
• Automate infrastructure provisioning and deployments using Terraform, CloudFormation, and CI/CD pipelines.
• Implement real-time streaming data workflows using Kinesis, MSK, or DynamoDB Streams with analytics tools.
• Ensure data quality and reliability through monitoring, alerting, and testing frameworks.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI.

Skills

SQL

Python

Tools

AWS Glue

AWS Lambda

AWS S3

Terraform

Apache Airflow

Amazon Redshift

Amazon Kinesis

AWS Step Functions

Apache Spark on EMR

Job description

About The Opportunity

A fast-scaling tech consultancy in the Cloud Data Engineering & Analytics space, we partner with enterprise clients across India to build modern, scalable data platforms on AWS. Our engineers design and deploy data pipelines, data lakes, and analytics architectures that turn raw data into real-time business insights—leveraging AWS-native services, IaC, and DevOps best practices to deliver speed, reliability, and security at scale.

Role & Responsibilities

• Design, build, and maintain scalable AWS data pipelines using Glue, Lambda, Step Functions, and EMR.
• Develop and optimize data lakes on S3 with partitioning, cataloging (Glue Data Catalog), and governance controls.
• Automate infrastructure provisioning and deployments using Terraform, CloudFormation, and CI/CD pipelines.
• Implement real-time streaming data workflows using Kinesis, MSK, or DynamoDB Streams integrated with downstream analytics tools.
• Ensure data quality and reliability through monitoring (CloudWatch), alerting, and pipeline testing frameworks.
• Collaborate with analytics teams to model data warehouses (Redshift, Athena) and enable self-service BI (QuickSight, Looker).

Skills & Qualifications

Must-Have

• AWS Glue
• AWS Lambda
• AWS S3
• Terraform
• Apache Airflow
• SQL
• Python
• Amazon Redshift

Preferred

• Amazon Kinesis
• AWS Step Functions
• Apache Spark on EMR

Benefits & Culture Highlights

• Work on high-impact, client-facing AWS data projects with autonomy and technical ownership.
• Growth path into Lead Data Engineer or Cloud Solutions Architect roles within 18–24 months.
• Flexible work hours within on-site structure + regular upskilling and AWS certification sponsorship.

Skills: apache,amazon,cloud,glue,aws,data