Senior Consultant - Tech Consulting - National - CNS - TC - AI and Data - Noida

EY; Dadri; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

EY Noida seeks a Senior Consultant in Tech Consulting focusing on AI and Data. You will design, build, and optimize Python-based microservices and end-to-end data pipelines for large-scale batch and streaming data, using Spark, PySpark, Airflow and Kafka. Experience with AWS EMR and relational databases is essential.

The role emphasizes data quality, scalability, and production readiness, with opportunities to influence architecture and delivery across client engagements in India.

Qualifications

• Bachelor's or equivalent degree in computer science or engineering.
• Master's degree in computer applications or related field is preferred.
• 4+ years of data engineering experience.

Responsibilities

• Design, develop and maintain Python-based microservices for data ingestion.
• Build end-to-end ETL pipelines for batch and streaming data.
• Develop data workflows with Apache Spark, Airflow and Kafka.
• Deploy data pipelines on AWS EMR and similar platforms.

Skills

Python

Apache Spark

PySpark

Apache Airflow

Kafka

PostgreSQL

ETL

AWS

Education

Bachelor of Technology in Computer Science

Master of Computer Applications

Tools

AWS EMR

Job description

Senior Consultant - Tech Consulting - National - CNS - TC - AI and Data - Noida

Location: Noida

Other locations: Primary Location Only

Requisition ID: 1758437

Requisition Id: 1758437

As a global leader in assurance, tax, transaction and advisory services, we hire and develop the most passionate people in their field to help build a better working world. This starts with a culture that believes in giving you the training, opportunities and creative freedom. At EY, we don't just focus on who you are now, but who you can become. We believe that it’s your career and ‘It’s yours to build’ which means potential here is limitless and we'll provide you with motivating and fulfilling experiences throughout your career to help you on the path to becoming your best professional self.

The opportunity

Senior Consultant - National - Tech Consulting - CNS - TC - AI and Data - Noida

National

National comprises of sector agnostic teams working across industries for a well rounded experience.

CNS - TC - AI and Data

EY Consulting is building a better working world by transforming businesses through the power of people, technology and innovation. Our client-centric approach focuses on driving long-term value for our clients by solving their most strategic problems. EY Consulting is made up of three sub-service lines: Business Consulting (including Performance Improvement and Risk Consulting), Technology Consulting and People Advisory Services.

In Tech Consulting, we are transforming businesses through the power of people, technology and innovation. It places humans@center, leverages technology@speed and enables innovation@scale.

Your key responsibilities

Technical Excellence

• Design, develop, and maintain scalable Python-based microservices for data ingestion and processing Build and optimize microservices to support end-to-end ETL pipelines for large-scale batch and streaming data Develop and manage distributed data processing workflows using Apache Spark and PySpark Create, schedule, and monitor workflows using Apache Airflow Design and deploy data pipelines on AWS EMR or similar big data platforms using Python Implement real-time data ingestion and streaming pipelines Ensure data quality, reliability, performance, and scalability of data systems Apply best practices for code quality, testing, CI/CD, and production monitoring Troubleshoot production issues and perform root-cause analysis 6–8 years of experience in Data Engineering or backend data platform roles Strong proficiency in Python with experience building production-grade microservices Hands-on expertise with Apache Spark and PySpark Experience working with AWS EMR or equivalent cloud-based big data services. (Must have knowledge on AWS eco system) Strong experience with Apache Airflow for workflow orchestration Deep understanding of ETL pipeline design and data modeling Hands-on experience with Kafka for inter-domain communication and real-time or streaming data pipelines Strong experience with PostgreSQL or similar RDBMS Experience working in Agile/Scrum environments

Skills and attributes

To qualify for the role you must have

Qualification

• Bachelor of Technology in Computer Science
• Master of Computer Applications

Experience

• Data Engineering (4+ years)

What we look for

People with the ability to work in a collaborative manner to provide services across multiple client departments while following the commercial and legal requirements. You will need a practical approach to solving issues and complex problems with the ability to deliver insightful and practical solutions. We look for people who are agile, curious, mindful, and able to sustain positive energy, while being adaptable and creative in their approach.

What we offer

Fuelled by the brilliance of our people, EY has emerged as the strongest brand and the most attractive employer in our field, with market-leading growth over competitors. Our people work side-by-side with market-leading entrepreneurs, game-changers, disruptors, and visionaries. As an organization, we are investing more time, technology, and money than ever before in skills and learning for our people. At EY, you will have a personalized Career Journey and also the chance to tap into the resources of our career frameworks to better know about your roles, skills, and opportunities.

EY is equally committed to being an inclusive employer, and we strive to achieve the right balance for our people—enabling us to deliver excellent client service while allowing our people to build their careers as well as focus on their wellbeing.