AWS Data Engineer

Viraaj HR Solutions Private Limited; Kolkata District; On-site; INR 1,800,000 - 2,400,000; Full time

Benefits offered by this job

Onsite environment

Cloud cert sponsorships

Enterprise AWS exposure

Job summary

Viraaj HR Solutions Private Limited is seeking a skilled AWS data engineer to design and optimize scalable ETL/ELT pipelines. You will build data lakes on S3, ensure governance with IAM and Glue, and orchestrate workflows with MWAA or Step Functions.

You will collaborate with analytics and ML teams to provide clean, curated datasets for dashboards and model training, working in a fast-paced, cloud-centric environment.

Qualifications

• Experience designing ETL/ELT pipelines on AWS.
• Strong knowledge of data lakes, governance and IAM.
• Hands-on with batch and real-time data ingestion and pipeline orchestration.

Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging and governance.
• Orchestrate data workflows via MWAA or Step Functions and monitor pipeline health.
• Optimize Redshift or Snowflake for performance and cost with tuning techniques.
• Implement data quality, lineage, and alerting using CloudWatch, Athena and Python scripts.
• Collaborate with analytics and ML teams to deliver clean datasets for dashboards and model training.

Skills

AWS Glue

Amazon S3

AWS Lambda

Amazon Redshift

Amazon Athena

Python

SQL

ETL/ELT

Tools

AWS Step Functions

AWS MWAA

Apache Airflow

Job description

About The Opportunity

A dynamic talent solutions firm operating at the intersection of cloud infrastructure and data engineering, we partner with enterprises to build scalable, secure, and high-performance data platforms on AWS. Our engineers architect, deploy, and optimize data pipelines, lakes, and warehousing solutions that power real-time analytics, machine learning, and business intelligence across industries.

About The Opportunity

A dynamic talent solutions firm operating at the intersection of cloud infrastructure and data engineering, we partner with enterprises to build scalable, secure, and high-performance data platforms on AWS. Our engineers architect, deploy, and optimize data pipelines, lakes, and warehousing solutions that power real-time analytics, machine learning, and business intelligence across industries.

Role & Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging (Glue Data Catalog), and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views, distribution keys, and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills & Qualifications

• Must-Have
• AWS Glue
• Amazon S3
• AWS Lambda
• Amazon Redshift
• Amazon Athena
• Python
• SQL
• ETL/ELT
• Preferred
• AWS Step Functions
• AWS MWAA
• Apache Airflow

Benefits & Culture Highlights

• Onsite collaborative environment with access to cloud certification sponsorships.
• Direct exposure to enterprise-scale AWS data architectures and cross-functional teams.
• Fast-paced, learning-driven culture with growth acceleration for high performers.

Skills: glue,aws,etl,athena,sql,python,cloud,amazon redshift,aws lambda