AWS Data Engineer

Viraaj HR Solutions Private Limited; Hyderabad; On-site; INR 1,200,000 - 1,600,000; Full time

Benefits offered by this job

Onsite collaborative environment

Cloud certification sponsorship

Exposure to enterprise-scale AWS data架

Job summary

Viraaj HR Solutions Private Limited in Hyderabad is seeking a data engineer to design and operate scalable ETL/ELT pipelines on AWS, with a focus on real-time and batch data processing.

You will build data lakes on S3, manage data cataloging with Glue, and optimize Redshift or Snowflake for performance and cost, while ensuring data quality and governance.

Join a fast-paced team and contribute to analytics, ML readiness, and BI dashboards, supported by a collaborative onsite culture.

Qualifications

• Experience designing ETL/ELT pipelines on AWS.
• Proficiency in Python and SQL for data workflows.
• Experience with data lakes, cataloging, and governance.
• Familiarity with AWS Glue, Lambda, S3, Redshift, Athena.

Responsibilities

• Design and implement scalable ETL/ELT pipelines on AWS.
• Build and manage data lakes on S3 with proper cataloging and governance.
• Orchestrate workflows via MWAA or Step Functions and monitor SLA compliance.
• Optimize Redshift (or Snowflake) for performance and cost-efficiency.
• Ensure data quality checks, lineage, and alerting.

Skills

ETL/ELT

Python

SQL

Cloud concepts

Tools

AWS Glue

Amazon S3

AWS Lambda

Amazon Redshift

Amazon Athena

AWS Step Functions

AWS MWAA

Apache Airflow

Job description

About The Opportunity

A dynamic talent solutions firm operating at the intersection of cloud infrastructure and data engineering, we partner with enterprises to build scalable, secure, and high-performance data platforms on AWS. Our engineers architect, deploy, and optimize data pipelines, lakes, and warehousing solutions that power real-time analytics, machine learning, and business intelligence across industries.

Role & Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, and Step Functions for batch and real-time data ingestion.
• Build and maintain data lakes on S3 with proper partitioning, cataloging (Glue Data Catalog), and governance using IAM and Lake Formation.
• Orchestrate data workflows via AWS MWAA or Step Functions, monitor pipeline health, and ensure SLA compliance.
• Optimize Redshift or Snowflake (if integrated) for performance and cost using materialized views, distribution keys, and query tuning.
• Implement data quality checks, lineage tracking, and alerting using CloudWatch, Athena, and custom Python scripts.
• Collaborate with analytics and ML teams to deliver clean, curated datasets for dashboards and model training.

Skills & Qualifications

• Must-Have
• AWS Glue
• Amazon S3
• AWS Lambda
• Amazon Redshift
• Amazon Athena
• Python
• SQL
• ETL/ELT
• Preferred
• AWS Step Functions
• AWS MWAA
• Apache Airflow

Benefits & Culture Highlights

• Onsite collaborative environment with access to cloud certification sponsorships.
• Direct exposure to enterprise-scale AWS data architectures and cross-functional teams.
• Fast-paced, learning-driven culture with growth acceleration for high performers.

Skills: glue,aws,etl,athena,sql,python,cloud,amazon redshift,aws lambda