AWS Data Engineer

Viraaj HR Solutions Private Limited; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Cloud certification sponsorships

Exposure to enterprise-scale AWS data架

Growth-oriented culture

Job summary

Viraaj HR Solutions Private Limited is seeking an AWS-focused data engineer to design scalable ETL/ELT pipelines and manage data lakes on S3 for real-time analytics.

You will partner with analytics and ML teams to deliver curated datasets and optimize data workflows using AWS Glue, Lambda, and Step Functions, ensuring SLA compliance and governance.

Qualifications

• Proficient in designing ETL/ELT pipelines on AWS.
• Experience with data lakes on S3 and Glue Data Catalog.
• Experience with data quality, lineage, and governance on AWS.

Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging (Glue Data Catalog), and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views, distribution keys, and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills

AWS Glue

Amazon S3

AWS Lambda

Amazon Redshift

Amazon Athena

Python

SQL

ETL/ELT

AWS Step Functions

AWS MWAA

Apache Airflow

Job description

About The Opportunity

A dynamic talent solutions firm operating at the intersection of cloud infrastructure and data engineering, we partner with enterprises to build scalable, secure, and high-performance data platforms on AWS. Our engineers architect, deploy, and optimize data pipelines, lakes, and warehousing solutions that power real-time analytics, machine learning, and business intelligence across industries.

Role & Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging (Glue Data Catalog), and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views, distribution keys, and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills & Qualifications

• Must-Have
• AWS Glue
• Amazon S3
• AWS Lambda
• Amazon Redshift
• Amazon Athena
• Python
• SQL
• ETL/ELT
• Preferred
• AWS Step Functions
• AWS MWAA
• Apache Airflow

Benefits & Culture Highlights

• Onsite collaborative environment with access to cloud certification sponsorships.
• Direct exposure to enterprise-scale AWS data architectures and cross-functional teams.
• Fast-paced, learning-driven culture with growth acceleration for high performers.

Skills: glue,aws,etl,athena,sql,python,cloud,amazon redshift,aws lambda