Digital FAAS Digital Senior

EY; Pune District; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

EY in Pune is seeking a Data Engineer skilled in Azure ADF, Databricks, PySpark, SQL and Power BI to build secure, scalable cloud analytics solutions for business users. You will translate stakeholder needs into robust data pipelines and collaborate across teams to deliver value quickly.

You’ll work hands-on with Spark, Delta Lake, ADLS, Synapse, and real-time data ingestion using Kafka/Spark Streaming, partnering with BI and data analytics teams.

Qualifications

• Experience architecting big data solutions with strong SQL and PySpark.
• Experience integrating ERP, applications DBs, cloud systems using Azure Data Factory and Synapse.
• Hands-on with DataBricks, Delta Lake and Unity Catalog concepts.

Responsibilities

• Implement secure, scalable cloud-based analytics solutions on Azure.
• Collaborate with stakeholders to translate requirements into data products.
• Lead 2-4 member team and mentor juniors in agile projects.
• Ingest real-time data from LIVE sources using Kafka, Spark Streaming or EventHub.

Skills

Big data

SQL

PySpark

Azure Data Factory

Azure Synapse

DataBricks

Delta Lake

Data Modelling

Azure AI Basics

NoSQL MongoDB

Kafka

Power BI

Job description

Job Description:

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

Data Engineer with experience in Azure ADF, Databricks, PySpark, SQL and Power Bi

Key Responsibilities

• Responsible for implementing secure, scalable, and highly available cloud-based solutions on Azure Cloud Analytics
• Collaborate with internal and external stakeholders to understand their business requirements and translate them into technical solutions
• Identify and implement automation opportunities to increase operational efficiency
• Conduct knowledge sharing and training sessions to educate clients and internal teams on cloud technologies
• Interact and collaborate with various teams (web Development/ MS Apps / API Development etc.) to deliver the products
• Work very closely with Data Architects/Technical Managers in agile environment to identify and understand the problem statements and develop/prototype the solutions accordingly.
• Should be able to work as Individual contributor
• Experience in leading 2-4 member team

Technical Skills

• 4-8 years of experience in architecting big data solutions with proven track record in driving business success
• Strong SQL Expertise and Hands-on experience
• Strong PySpark Expertise and Hands-on experience
• Expertise experience with integration of different Sources System (ERPs, Applications DBs, Cloud Systems and Sharepoint) using Azure Data Factory, Azure Synapse pipelines and ADLS. Strongs Hands on experience on ADF, ADLS and Synapse.
• Good Hands on Experience on DataBricks and should be able to demonstrate the usecases for DataBricks usage
• Good Understanding on Unity Catalog and Delta Lake concepts
• Understanding of data modelling concepts and should be able to demonstrate various Data Modelling mechanisms
• Exposure on Azure AI Fundamentals
• Experience with BI, and data analytics databases
• Exposure in working with NoSQL using MongoDB or similar
• Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
• Experience in real-time data ingestion from LIVE sources using Apache Kafka, Spark Streaming, EventHub and related technologies
• Exposure on PowerBi or similar reporting tools and should be able to work with PowerBi team to achieve end goal.

Soft Skills

• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
• Strong verbal and written communication skills (written and verbal formal and informal).
• Ability to multi-task under pressure and work independently with minimal supervision.
• Must be a team player and enjoy working in a cooperative and collaborative team environment.
• Adaptable to new technologies and standards.
• Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support.
• Minimum 3 years hand-on experience in one or more of the above areas.
• Minimum 4 years industry experience

EY | Building a better working world

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.