AWS Data Engineer

Persistent Systems; Pune District; On-site; INR 2,500,000 - 4,000,000; Full time

Benefits offered by this job

Group term life insurance

Personal accident coverage

Mediclaim hospitalisation

Flexible work hours

Long Service awards

Higher education sponsorship

Quarterly growth opportunities

Project parties

Job summary

Persistent Systems seeks an experienced AWS Data Engineer in Pune to design and build cloud-native data platforms and ETL solutions on AWS. The role focuses on scalable pipelines, event-driven architectures, and automated infrastructure using AWS Glue, Lambda, Step Functions, S3, Terraform, and CI/CD.

You will collaborate with business and data analytics teams to deliver secure, resilient data solutions that support analytics and operational workloads.

Qualifications

• 8–12 years of experience in Data Engineering and Cloud-based Data Platforms.
• Hands-on expertise in AWS Glue, AWS Lambda, AWS Step Functions, and Amazon S3.
• Proficient in Python and SQL for data processing and modeling.
• Experience with building and maintaining ETL/ELT pipelines and data integration.
• Familiarity with CI/CD pipelines and IaC tooling.

Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines on AWS.
• Implement event-driven architectures and serverless data applications.
• Automate infrastructure and CI/CD deployments using Terraform, CloudFormation, and GitHub Actions.
• Orchestrate workflows with Step Functions and Lambda.
• Ensure data quality, security, and reliability across platforms.
• Collaborate with analysts and engineers to deliver analytics-ready data.

Skills

AWS Glue

AWS Lambda

AWS Step Functions

Amazon S3

Python

SQL

Terraform

CI/CD

CloudFormation

GitHub Actions

Jenkins

Data Engineering

Event-driven

IAM

CloudWatch

CloudTrail

Education

Bachelors or Masters in CS/IT

Tools

Terraform

CloudFormation

Job description

We are seeking an experienced AWS Data Engineer with 8-12 years of experience in designing, developing, and supporting cloud-native data platforms and ETL solutions on AWS. The ideal candidate will be responsible for building scalable data pipelines, implementing event-driven architectures, automating infrastructure, and enabling reliable data integration across enterprise applications. This role requires strong expertise in AWS Glue, AWS Lambda, Step Functions, S3, Terraform, CI/CD, and Data Engineering best practices. The candidate will work closely with business analysts, data analysts, and engineering teams to build secure, resilient, and high-performing data solutions that support business-critical analytics and operational workloads.

• Location: Pune
• Experience: 8 to 12 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain robust ETL/ELT pipelines using AWS Glue.
• Define data extraction, transformation, validation, and loading processes across multiple structured and semi-structured data sources.
• Build scalable and reusable data ingestion frameworks for enterprise applications.
• Develop data transformation and enrichment workflows to support analytics and reporting requirements.
• Implement data quality checks and validation processes within data pipelines.
• Ensure data accuracy, consistency, and reliability across enterprise data platforms.
• Design and implement AWS Lambda-based solutions for data integration and application support.
• Develop serverless architectures to process and transform enterprise data efficiently.
• Build scalable event-driven applications leveraging native AWS services.
• Support application modernization initiatives through cloud-native technologies.
• Optimize cloud-based data processing for performance and cost efficiency.
• Orchestrate complex workflows using AWS Step Functions and AWS Lambda.
• Design and implement event-driven data pipelines triggered by file arrivals in Amazon S3.
• Build automated processing frameworks for batch and near real-time data workloads.
• Enable seamless integration between data sources, applications, and analytics platforms.
• Ensure fault tolerance, error handling, and operational resilience in workflow executions.
• Build and maintain CI/CD pipelines using GitHub Actions, Jenkins.
• Implement Infrastructure as Code (IaC) solutions using Terraform, AWS CloudFormation.
• Automate deployment, configuration, and operational processes.
• Support environment provisioning and infrastructure lifecycle management.
• Promote DevOps best practices for continuous integration and delivery.
• Monitor data pipelines, workflows, and cloud resources using Amazon CloudWatch, AWS CloudTrail.
• Troubleshoot system failures, bottlenecks, and performance issues.
• Implement alerting, logging, and observability best practices.
• Drive continuous improvements in platform reliability, scalability, and security.
• Support production environments and critical issue resolution.
• Work closely with Business Analysts and Data Analysts to gather requirements and define technical solutions.
• Translate business requirements into scalable data engineering designs.
• Participate in architecture discussions, solution design reviews, and project planning activities.
• Collaborate with cross-functional teams to deliver end-to-end data solutions.
• Leverage AI-assisted development tools responsibly to improve productivity and accelerate delivery.

Expertise You'll Bring:

• 8-12 years of experience in Data Engineering and Cloud-based Data Platforms.
• Strong hands-on expertise in AWS Glue
• AWS Lambda
• AWS Step Functions
• Amazon S3
• Python
• SQL
• Experience designing and implementing ETL/ELT pipelines.
• Strong understanding of data integration, transformation, and processing frameworks.
• Experience building event-driven architectures on AWS.
• Knowledge of serverless computing and cloud-native application development.
• Strong understanding of data modeling and enterprise data management practices.
• Deep understanding of AWS cloud services and architecture patterns.
• Experience with AWS Lambda
• AWS Step Functions
• Amazon S3
• CloudWatch
• CloudTrail
• IAM
• Experience implementing scalable and secure cloud-native solutions.
• Knowledge of AWS security, monitoring, and operational best practices.
• Experience with GitHub Actions, Jenkins, CI/CD Pipelines, Infrastructure Automation.
• Hands-on experience using Terraform, AWS CloudFormation.
• Knowledge of deployment automation and release management practices.
• Experience with production support and troubleshooting.
• Knowledge of logging, monitoring, and alerting frameworks.
• Expertise in identifying and resolving performance bottlenecks.
• Strong operational and system reliability mindset.
• Experience with event-driven data architectures.
• Knowledge of modern data lake and analytics platforms.
• Familiarity with AI-assisted software development tools.
• Understanding of security, governance, and compliance requirements within cloud environments.
• Strong analytical and problem-solving abilities.
• Ability to work independently with minimal supervision.
• Strong ownership, accountability, and proactive mindset.
• Excellent communication and stakeholder management skills.
• Ability to thrive in fast-paced and high-pressure environments.
• Strong collaboration skills with business and technical teams.
• Continuous learning mindset and passion for technology innovation.
• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalisation for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."