Sr. Software Engineer - AWS Data Pipeline Job

YASH Technologies, Inc.; Bengaluru; On-site; INR 1,400,000 - 1,900,000; Full time

Job summary

YASH Technologies, Inc. is seeking an AWS Data Developer to design and build scalable data pipelines using PySpark and AWS data services. You will develop ETL processes and optimize data workflows to support business insights.

The ideal candidate has 5+ years of data engineering experience with Python, AWS Glue, Lambda, Step Functions, S3, and RDS (MySQL), plus SQL skills. You will collaborate with analysts, architects, and DevOps in a fast-growing, hyperlearning workplace.

Qualifications

• 5+ years of experience in data engineering / AWS development.
• Strong proficiency in Python.
• Hands-on experience with PySpark for large-scale data processing.
• Expertise in AWS services: Lambda, Step Functions, S3, RDS (MySQL).
• Strong knowledge of SQL and data querying.
• Familiarity with IAM roles and AWS security best practices.

Responsibilities

• Design and implement scalable data pipelines using AWS services.
• Develop ETL workflows using AWS Glue, PySpark, and Python.
• Build serverless data processing solutions using AWS Lambda.
• Orchestrate workflows using AWS Step Functions.
• Manage and optimize data storage in AWS S3.
• Work with relational databases like AWS RDS (MySQL).
• Ensure data quality, validation, and governance.
• Optimize performance and cost of data pipelines.
• Debug and troubleshoot data-related issues.
• Collaborate with cross-functional teams (Data Analysts, Architects, DevOps).

Skills

Python

PySpark

AWS Glue

AWS Lambda

AWS Step Functions

AWS S3

AWS RDS (MySQL)

SQL

IAM & AWS security

Data pipelines

Tools

Docker

Kubernetes

Job description

Location: Bangalore, KA, IN Indore, MP, IN, 452001 Indore, MP, IN IN Hyderabad, TG, IN Bangalore, KA, IN Indore, MP, IN Hyderabad, IN Hyderabad, TG, IN, 500081 Pune, IN Pune, MH, IN

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hireAWS Data Pipeline Professionals in the following areas :

Exp : 5+ Years

Job Summary

We are seeking a highly skilled AWS Data Developer with strong expertise in Python, PySpark, and AWS data services to design and build scalable data processing solutions. The ideal candidate will be responsible for developing robust ETL pipelines, optimizing data workflows, and leveraging AWS services to support business.

Key Responsibilities

• Design and implement scalable data pipelines using AWS services
• Develop ETL workflows using AWS Glue, PySpark, and Python
• Build serverless data processing solutions using AWS Lambda
• Orchestrate workflows using AWS Step Functions
• Manage and optimize data storage in AWS S3
• Work with relational databases like AWS RDS (MySQL)
• Ensure data quality, validation, and governance
• Optimize performance and cost of data pipelines
• Debug and troubleshoot data-related issues
• Collaborate with cross-functional teams (Data Analysts, Architects, DevOps)

Required Skills & Experience

• 5+ years of experience in data engineering / AWS development
• Strong proficiency in Python
• Hands-on experience with PySpark for large-scale data processing
• Expertise in AWS services:
• AWS Lambda
• AWS Step Functions
• AWS S3
• AWS RDS (MySQL)
• Strong knowledge of SQL and data querying
• Familiarity with IAM roles and AWS security best practices

Preferred Skills

• Experience with CI/CD pipelines and DevOps tools
• Familiarity with Docker / Kubernetes

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture