WAM-AWS-Data-Engineer-Senior

EY; Gurugram District; On-site; INR 3,000,000 - 5,500,000; Full time

Job summary

EY is seeking a Senior AWS Data Engineer to design, build, and support modern cloud-based data platforms on AWS. The role focuses on data ingestion, transformation, and analytics pipelines for financial services and wealth management domains, with a strong emphasis on scalability, data lake architectures, and governance.

The ideal candidate will have 5–8 years of data engineering experience, proficiency in Python/PySpark, and hands-on expertise with AWS Glue, S3, Athena, Airflow, and related

Qualifications

• Bachelor's degree in Computer Science or related field.
• 5–8 years of experience in data engineering.
• Hands-on with AWS Glue, S3, Athena, MWAA, Step Functions, and CloudWatch.
• Strong Python and PySpark programming skills.
• Experience building large-scale ETL/ELT pipelines.
• Knowledge of data warehousing, Iceberg tables, and data modeling.
• IaC experience with Terraform.

Responsibilities

• Design, develop, and maintain scalable data pipelines on AWS.
• Build robust ETL/ELT solutions for batch and near real-time data.
• Develop reusable PySpark frameworks and components.
• Migrate on-prem data platforms to AWS cloud.
• Implement data lakes using Medallion Architecture.
• Develop Airflow workflows and DAGs for orchestration.
• Ensure data quality, lineage, and auditability across the platform.
• Collaborate with cross-functional teams including data architects and analysts.

Skills

AWS Data Engineering

Python

PySpark

Data Modeling

ETL/ELT

SQL development

Apache Airflow

Terraform

Iceberg

Redshift

MWAA

S3

CloudWatch

Education

Bachelor's degree in Computer Science or related field

Tools

AWS Glue

Apache Airflow

Terraform

Iceberg

SQL

PySpark

Python

Redshift

S3

MWAA

Step Functions

CloudWatch

Job description

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

WAM - AWS Data Engineer:

Consulting – WAM -Technical-AWS Data Engineer: Senior

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

About Global Delivery Services

Global Delivery Services refers to EY\'s worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.

Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.

Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.

Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.

Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.

The Opportunity

Role Summary

We are seeking a highly skilled Senior AWS Data Engineer to design, develop, and support modern cloud-based data platforms on Amazon Web Services (AWS). The ideal candidate will have strong expertise in AWS data engineering technologies, Python/PySpark development, workflow orchestration, and data lake architectures, along with experience delivering scalable enterprise-grade data solutions.

The role involves building and maintaining data ingestion, transformation, and analytics pipelines supporting financial services applications, advisor platforms, reporting systems, and enterprise data initiatives. Candidates with prior experience in Wealth & Asset Management (WAM) domains will be highly preferred.

Role: AWS Data Engineer Senior

Experience: 5-8 years

Domain: Wealth Management, Asset Management, Capital Markets, Investment Banking, Financial

Your Key Responsibilities

Key Responsibilities

AWS Data Engineering & Development

• Design, develop, and maintain scalable data pipelines using AWS Glue (PySpark), Amazon S3, AWS Step Functions, and Athena.
• Build robust ETL/ELT solutions for batch and near real-time data processing.
• Develop reusable PySpark frameworks and data transformation components.
• Work closely with architects and business stakeholders to implement data platform requirements.
• Participate in migration and modernization initiatives from on-premises data platforms to AWS cloud environments.

Data Lake & Data Architecture

• Implement and support enterprise data lakes using Medallion Architecture (Bronze, Silver, Gold).
• Develop and maintain Apache Iceberg tables for efficient storage, schema evolution, and incremental processing.
• Ensure data quality, lineage, reconciliation, and auditability across the data platform.
• Contribute to data modeling and optimization efforts for analytical workloads.

Workflow Orchestration & Automation

• Develop and maintain Apache Airflow (MWAA) workflows and DAGs.
• Automate data movement, validation, monitoring, and notification processes.
• Implement retry mechanisms, dependency management, and failure handling within workflows.
• Integrate Airflow with AWS Glue, S3, Athena, and downstream applications.

AWS Cloud, Security & Infrastructure

• Implement AWS security best practices, including IAM roles, KMS encryption, and secrets management.
• Support infrastructure provisioning and deployment activities using Terraform.
• Collaborate with DevOps, infrastructure, and security teams to maintain secure and reliable cloud environments.
• Assist in configuring VPC endpoints, networking connectivity, and service integrations.

Production Support & Operational Excellence

• Monitor and troubleshoot production data pipelines and workflows.
• Perform performance tuning of AWS Glue jobs and Spark workloads.
• Implement logging, monitoring, and alerting using Amazon CloudWatch.
• Participate in incident resolution, root cause analysis, and continuous improvement initiatives.
• Ensure adherence to enterprise operational and governance standards.

Collaboration & Continuous Improvement

• Collaborate with cross-functional teams, including data architects, analysts, application teams, and business users.
• Participate in code reviews, design discussions, and technical documentation.
• Mentor junior engineers and share AWS data engineering best practices.
• Stay current with emerging AWS services and modern data engineering trends.

Preferred Domain Experience

Strong preference for candidates with experience in anyone:

• Wealth Management
• Asset Management
• Capital Markets
• Investment Banking
• Financial Services

Exposure to

• Portfolio & Investment Management
• Securities & Holdings Data
• Trade Processing
• Risk & Compliance Reporting
• Regulatory Reporting
• Market & Reference Data
• Advisor Compensation & Payout Platforms
• Client Reporting Solutions

Skills And Attributes For Success

Preferred Skills:

• AWS Data Engineering Services (Glue, EMR, Step Functions, S3, CloudWatch)
• Apache Airflow
• Redshift
• Iceberg
• DWH/ETL
• Python
• Pyspark
• Medallion Architecture
• SQL
• IaC (Devops, Terraform)
• WAM Domain Knowledge
• Github Copilot, Claude

Nice-to-Have Skills

• Experience with Oracle databases or ODI migrations.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience with data quality and metadata management tools.
• Familiarity with enterprise governance and regulatory compliance requirements.
• AWS Certification (Data Analytics, Solutions Architect, or Developer Associate).

Required Qualifications

What we look for

• Bachelor\'s degree in Computer Science, Engineering, Information Technology, or related discipline.
• 5-8 years of experience in Data Engineering with strong AWS exposure.
• Hands-on experience with AWS Glue, Amazon S3, Athena, MWAA (Apache Airflow), Step Functions, and CloudWatch.
• Strong programming skills in Python and PySpark.
• Experience building large-scale ETL/ELT data pipelines.
• Good understanding of data modelling, data warehousing, and distributed processing concepts.
• Experience working with Apache Iceberg and cloud-native data lake architectures.
• Experience using Infrastructure as Code tools such as Terraform.
• Strong SQL development and query optimization skills.
• Experience supporting production-grade data platforms and troubleshooting complex issues.
• Good understanding of AI technologies, agentic systems, and tools such as Microsoft Copilot and Claude, with the ability to leverage AI-driven capabilities for solution development and delivery.

What We Offer You

At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.