AWS Data Engineer

Viraaj HR Solutions Private Limited; Khordha; On-site; INR 1,200,000 - 1,600,000; Full time

Benefits offered by this job

Cloud certification sponsorship

Direct exposure to enterprise-scaleAWS

Fast-paced learning culture

Job summary

Viraaj HR Solutions Private Limited seeks a data engineer to design scalable ETL/ELT pipelines on AWS, build and govern data lakes on S3, and optimize analytics via Redshift/Athena. You will collaborate with analytics and ML teams to deliver clean datasets for dashboards and model training.

The role emphasizes real-time and batch ingestion, workflow orchestration with MWAA/Step Functions, and strong Python/SQL for data manipulation.

Qualifications

• Must have hands-on experience with AWS Glue, S3, and Lambda in data engineering contexts.
• Proficient in Redshift and Athena for analytics workloads and data modeling.
• Strong Python and SQL skills for data manipulation and pipeline orchestration.
• Experience with ETL/ELT design, data quality checks, and performance optimization.
• Knowledge of AWS Step Functions, MWAA (Airflow) is preferred.

Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills

AWS Glue

Amazon S3

AWS Lambda

Amazon Redshift

Amazon Athena

Python

SQL

ETL/ELT

AWS Step Functions

AWS MWAA

Tools

Apache Airflow

Job description

About The Opportunity

A dynamic talent solutions firm operating at the intersection of cloud infrastructure and data engineering, we partner with enterprises to build scalable, secure, and high-performance data platforms on AWS. Our engineers architect, deploy, and optimize data pipelines, lakes, and warehousing solutions that power real-time analytics, machine learning, and business intelligence across industries.

Role & Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging (Glue Data Catalog), and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views, distribution keys, and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills & Qualifications

• Must-Have
• AWS Glue
• Amazon S3
• AWS Lambda
• Amazon Redshift
• Amazon Athena
• Python
• SQL
• ETL/ELT
• Preferred
• AWS Step Functions
• AWS MWAA
• Apache Airflow

Benefits & Culture Highlights

• Onsite collaborative environment with access to cloud certification sponsorships.
• Direct exposure to enterprise-scale AWS data architectures and cross-functional teams.
• Fast-paced, learning-driven culture with growth acceleration for high performers.

Skills: glue,aws,etl,athena,sql,python,cloud,amazon redshift,aws lambda