WAM- AWS-Data-Engineer-Manager
EY
An application made for this job — a tailored resume and cover letter that speak straight to the posting.
Job summary
EY in India invites an experienced AWS Data Engineer Manager/Architect to lead the design, migration, and operation of cloud-native data platforms on AWS. You will own end-to-end technical decisions, mentor engineers, and partner with infrastructure, IAM, and DB teams to deliver scalable solutions.
You’ll work across data lakes, Medallion architecture, and orchestration with MWAA, Glue, and S3, driving security, cost optimization, production readiness, and governance in complex financial
Qualifications
- Bachelor's degree in computer science or related field.
- 8–10 years of data engineering with AWS exposure.
- Hands-on experience designing and leading AWS data solutions.
- Experience migrating on-prem to AWS data platforms.
- Proficiency in Python and PySpark for data processing.
- Strong knowledge of Glue, S3, MWAA, Step Functions and related services.
- IaC experience with Terraform.
- Understanding of ETL design, data modelling and pipeline optimization.
- Ability to lead and collaborate with cross-functional teams.
Responsibilities
- Serve as the design authority for AWS data initiatives.
- Own architecture for scalable, secure AWS data platforms.
- Define engineering standards and code reviews.
- Provide hands-on guidance and design reviews.
- Lead design and support of cloud-native data pipelines.
- Migrate on-prem to AWS data platforms.
- Architect data lakes using Medallion architecture.
- Lead Airflow orchestration with MWAA.
- Ensure security, IAM, encryption, and governance.
- Collaborate with data owners and stakeholders.
Skills
Education
Tools
Job description
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.
Consulting – WAM -Technical-AWS Data Engineer Manager/Architect: Manager
At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.
Join EY and help to build a better working world.
Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.
Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.
Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.
Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.
Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.
The Lead AWS Data Engineer provides technical leadership and hands on execution for enterprise data platforms hosted on Amazon Web Services (AWS). This role leads the design, migration, modernization, and operation of cloud native data architectures supporting mission critical financial, advisor payout, mobility, and corporate analytics platforms.
The Lead AWS Data Engineer owns end to end technical decision making for AWS data platforms, including architecture, security, orchestration, and production readiness. The role requires deep expertise in AWS data services, Python and PySpark development, workflow orchestration, data lake design, infrastructure as code, and operational excellence, along with the ability to mentor engineers and partner effectively with infrastructure, IAM, and database teams.
Experience: 8-10 years
Domain: Wealth Management, Asset Management, Capital Markets, Investment Banking, Financial
- Serve as the technical lead and design authority for AWS data engineering initiatives across multiple enterprise platforms.
- Own architectural decisions related to scalability, reliability, security, and cost optimization of AWS data platforms.
- Define and enforce engineering standards, coding patterns, and operational best practices for cloud data pipelines.
- Provide hands on technical guidance, design reviews, and code reviews for data engineers.
- Lead the design, development, and support of cloud native data pipelines using Amazon S3, AWS Glue (PySpark), MWAA (Apache Airflow), and AWS Step Functions.
- Drive on premises to AWS data platform migrations, including reverse engineering of legacy ETL workflows and re implementation using AWS native services.
- Re architect legacy Oracle Data Integrator (ODI)–based ETL processes into scalable PySpark based Glue jobs.
- Optimize Spark workloads for performance, memory usage, and cost efficiency in AWS Glue environments.
- Architect and implement enterprise AWS data lakes using Medallion architecture (Bronze, Silver, Gold).
- Design and manage Apache Iceberg tables to support incremental processing, schema evolution, and efficient data lake operations.
- Establish standardized ingestion, transformation, and consumption patterns across financial, mobility, and corporate datasets.
- Ensure data quality, reconciliation, lineage, and auditability across all layers of the data platform.
- Lead orchestration strategy using MWAA (Managed Workflows for Apache Airflow).
- Design and implement Airflow DAGs in Python to orchestrate end to end workflows, including Glue jobs, validations, and downstream dependencies.
- Implement scheduling, retry logic, monitoring, and failure handling to ensure resilient and scalable pipelines.
- Integrate orchestration workflows with AWS services such as S3, Glue, Athena, Iceberg based data lakes, and downstream systems.
- Drive implementation of AWS security best practices, including IAM role design, least privilege access, encryption using AWS KMS, and secrets management.
- Lead configuration of AWS networking components such as VPC Endpoints (VPCE) to enable secure service to service communication.
- Manage infrastructure provisioning using Terraform, ensuring repeatable and auditable deployments across DEV, QA, and PROD environments.
- Coordinate with IAM, network, DevOps, and DBA teams to resolve access, firewall, and Oracle database connectivity challenges.
- Own production readiness for AWS data platforms, including configuration, secrets, access controls, and deployment planning.
- Act as the escalation point for complex production issues, performing root cause analysis and permanent fixes.
- Implement logging, metrics, and alerting using Amazon CloudWatch to meet enterprise SLAs and availability targets.
- Support parallel run and hybrid architectures during migration phases to ensure business continuity.
- Design and oversee Python based automation solutions supporting operational efficiency and compliance initiatives (e.g., file retention and document processing).
- Ensure pipeline designs meet regulatory, audit, and enterprise governance requirements, including traceability and controlled data handling.
- Partner closely with data architects, DevOps teams, infrastructure teams, and business stakeholders to deliver AWS data solutions aligned with enterprise strategy.
- Translate business and platform requirements into scalable technical designs and execution plans.
- Produce technical documentation and support knowledge transfer to enable long term platform sustainability.
- Strong preference for candidates with experience in:
- Wealth Management
- Asset Management
- Capital Markets
- Investment Banking
- Financial Services
- Exposure to:
- Portfolio & Investment Management
- Securities & Holdings Data
- Trade & Transaction Processing
- Risk & Compliance Reporting
- Market & Reference Data
- Client Reporting Platforms
- Regulatory Reporting
Preferred skills:
- AWS Data Engineering Services (Glue, EMR, Step Functions, S3, CloudWatch)
- Apache Airflow
- Iceberg
- Data Architect
- DWH/ETL
- Python
- Pyspark
- Medallion Architecture
- SQL
- IaC (Devops, Terraform)
- Data Modelling
- WAM Domain Knowledge
- Github Copilot, Claude
- Exposure to analytics or BI platforms (e.g., ThoughtSpot, Tableau).
- Exposure to Oracle databases or legacy ETL tools (e.g., ODI).
- Experience in financial services or regulated enterprise environments.
- Familiarity with CI/CD practices for data engineering workloads.
- AWS Certification (Data Analytics, Solutions Architect, or Developer Associate).
- Bachelor’s degree in computer science, Engineering, or related field (or equivalent practical experience).
- 8-10 years of experience in Data Engineering with strong AWS exposure.
- Extensive hands on experience designing and leading AWS data engineering solutions.
- Proven experience leading or owning on premises to AWS data platform migrations.
- Advanced proficiency in Python and PySpark for data processing, automation, and orchestration.
- Strong experience with AWS Glue, Amazon S3, MWAA (Airflow), Step Functions, CloudWatch, and related services.
- Experience with Infrastructure as Code, preferably Terraform.
- Strong understanding of data engineering principles including ETL design, data modelling, and pipeline optimization.
- Demonstrated experience supporting enterprise, production grade data platforms.
- Good understanding of AI technologies, agentic systems, and tools such as Microsoft Copilot and Claude, with the ability to leverage AI-driven capabilities for solution development and delivery.
At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.
To help create an equitable and inclusive experience during the recruitment process, please inform us as soon as possible about any disability-related adjustments or accommodations you may need.
As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.
From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.
In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.
Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.
“We are an equal opportunity employer and are committed to Diversity, Equity & Inclusion”.
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
