Databricks Data Engineer, Senior Associate, AI Data, Technology Consulting

EY; Kolkata District; On-site; INR 1,800,000 - 3,000,000; Full time

Benefits offered by this job

Flexible working arrangements

Continuous learning

Diverse and inclusive culture

Job summary

EY AI & Data is seeking a Data Engineer with strong experience in Databricks to design scalable data pipelines and implement high-quality data solutions across cloud environments. You will work on end-to-end data platforms, collaborating with architects, engineers, and business stakeholders to meet evolving analytics objectives.

The role requires 4+ years in data engineering, familiarity with Azure/AWS/GCP, and hands-on coding in Python/ Spark.

Qualifications

• Bachelor’s degree in CS/Engineering/Math/Statistics or related field.
• Databricks certifications and Azure data engineering certifications preferred.
• At least 4 years of experience across data and analytics SDLC.
• Experience designing data pipelines on Databricks across Azure/AWS/GCP.

Responsibilities

• Design scalable, high-performance data pipelines with resilience built-in.
• Develop and refine code for large data platforms across cloud environments.
• Deliver deployments on public clouds in secure environments.
• Collaborate with stakeholders to translate business requirements into designs.
• Stay updated with data engineering best practices and AI integration.

Skills

Databricks

Python

Spark

Data pipelines

SQL

Education

Bachelor’s degree in Computer Science, Engineering, Mathematics or Statistics

Tools

Azure

AWS

GCP

Job description

At EY, we develop you with future-focused skills and equip you with world-class experiences. We empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. We work together across our full spectrum of services and skills powered by technology and AI, so that business, people and the planet can thrive together. Were all in, are you Join EY and shape your future with confidence.

About the opportunity

EY AI & Data is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry sectors. We implement information-driven strategies, data platforms and advanced data analytics solution systems that help grow, optimize and protect client organizations. We go beyond strategy and provide end to end design, build and implementation of real-life data environments and have some of the best architects, project managers, business analysts, data scientists, big data engineers, developers and consultants in the region. We are seeking a Data Engineer with strong experience in Databricks.

Your key responsibilities

• Ability to design data pipelines with scalability, high performance and resilience in-built
• Ability to code complex requirements as part of large complex data platforms - develop, refine, and implement high quality delivery executions
• Deliver project deployments on public clouds and highly secure environments
• Integrate with data governance tools, ecosystem products across the cloud landscape
• Ability to understand the business requirements and translate into high-level and low-level designs to successfully meets the business objectives.
• Collaborate with stakeholders, presenting findings to a non-technical audience
• Bring in best practices for coding and building modular data engineering code that can be reused
• Stay current with technical and industry developments and standards to ensure effective and advanced applications of data analysis techniques and methodologies. Including AI integrations.

To qualify for the role, you must have

• Min Bachelors degree in Computer science, Mathematics, Engineering, Statistics, or a related field
• Databricks certifications, Azure certifications on data engineering
• At least 4 years of experience on various data platform solutions across data and analytics across the entire SDLC
• Atleast 2 years experience on designing and mapping requirements to technical capabilities of data pipelines on databricks across Azure, AWS or GCP cloud
• Proficiency in programming leveraging Python, Spark, Scala and other programming languages
• Understanding of end-to-end data analytics domain and insights delivery
• Excellent understanding of data modelling techniques and leading trends on data platforms including AI
• Possess strong problem-solving, analytical and strategic thinking abilities
• GCC experience will be an added advantage
• Proficiency with agile boards like JIRA, Atlassian products

Ideally, youll have Strong hands-on knowledge and project experience in technical delivery of data platform projects across any of the Databricks on Azure cloud, Google cloud, AWS cloud. Must have hands-on experience with ELT, data pipeline and orchestration tools. Experience in end-to-end technical project delivery following agile delivery methodologies Understanding of data modelling techniques and data governance tools will be an added advantage Experience in estimation, infrastructure sizing for data platform solutions

What we look for

Highly motivated individuals with excellent problem-solving skills and the ability to prioritize shifting workloads in a rapidly changing industry. An effective communicator, youll be a confident leader equipped with strong people management skills and a genuine passion to make things happen in a dynamic organization.

What working at EY offers

EY offers a competitive remuneration package where youll be rewarded for your individual and team performance. We are committed to being an inclusive employer and are happy to consider flexible working arrangements. Plus, we offer:

• Continuous learning: Youll develop the mindset and skills to navigate whatever comes next.
• Success as defined by you: Well provide the tools and flexibility, so you can make a meaningful impact, your way.
• Transformative leadership: Well give you the insights, coaching and confidence to be the leader the world needs.
• Diverse and inclusive culture: Youll be embraced for who you are and empowered to use your voice to help others find theirs.

Company description

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in .