AWS Data Engineer

Viraaj HR Solutions Private Limited; Bengaluru; On-site; INR 1,500,000 - 3,200,000; Full time

Benefits offered by this job

Sponsorship for cloud certifications

Direct exposure to enterprise-scaleAWS

Onsite collaboration

Job summary

Viraaj HR Solutions Private Limited in Bengaluru is seeking a skilled Data Engineer to design and optimize scalable ETL/ELT pipelines on AWS. You will build data lakes on S3, implement governance, and collaborate with analytics teams to deliver ready-to-use datasets for dashboards and ML models.

You will work with AWS Glue, Lambda, Redshift, Athena, and orchestrators like MWAA or Airflow to ensure high performance and cost efficiency.

Qualifications

• Must-have AWS Glue, Amazon S3, AWS Lambda, Amazon Redshift, Amazon Athena, Python and SQL.
• ETL/ELT experience is required.
• Preferred: AWS Step Functions, AWS MWAA, Apache Airflow.

Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging (Glue Data Catalog), and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views, distribution keys, and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills

Python

SQL

ETL/ELT

Tools

AWS Glue

Amazon S3

AWS Lambda

Amazon Redshift

Amazon Athena

AWS Step Functions

AWS MWAA

Apache Airflow

Job description

About The Opportunity

A dynamic talent solutions firm operating at the intersection of cloud infrastructure and data engineering, we partner with enterprises to build scalable, secure, and high-performance data platforms on AWS. Our engineers architect, deploy, and optimize data pipelines, lakes, and warehousing solutions that power real-time analytics, machine learning, and business intelligence across industries.

Role & Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging (Glue Data Catalog), and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views, distribution keys, and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills & Qualifications

• Must-Have
• AWS Glue
• Amazon S3
• AWS Lambda
• Amazon Redshift
• Amazon Athena
• Python
• SQL
• ETL/ELT
• Preferred
• AWS Step Functions
• AWS MWAA
• Apache Airflow

Benefits & Culture Highlights

• Onsite collaborative environment with access to cloud certification sponsorships.
• Direct exposure to enterprise-scale AWS data architectures and cross-functional teams.
• Fast-paced, learning-driven culture with growth acceleration for high performers.

Skills: glue,aws,etl,athena,sql,python,cloud,amazon redshift,aws lambda