Data Engineer (Databricks), Senior Associate, Technology Consulting

ernst & young advisory pte. ltd.; Singapore; On-site; SGD 100,000 - 150,000; Full time

Job summary

EY is seeking a Data Engineer to advance data platforms across the APAC region. You will design scalable data pipelines, implement high-quality delivery, and deploy on secure cloud environments.

The role involves transforming raw data into actionable insights using Python, Spark and Scala, with emphasis on data governance, modelling and AI techniques. You will collaborate with engineers, analysts and clients, ensuring solutions meet business requirements and align with best practices.

Qualifications

• Bachelor’s degree in Computer Science, Mathematics, Engineering, Statistics, or related field.
• Databricks certifications; AWS certifications on data engineering.
• At least 4 years of experience on data platform solutions across the SDLC.
• At least 2 years’ experience mapping requirements to data pipelines on Databricks across AWS.
• Proficiency in Python, Spark, Scala.
• Understanding of end-to-end data analytics and insights delivery.
• Strong data modelling knowledge and AI trends.
• Problem-solving, analytical and strategic thinking abilities.
• GCC experience will be an added advantage.
• Proficiency with agile boards like JIRA, Atlassian products.
• Experience in Consulting/Professional Services environment.

Responsibilities

• Design data pipelines with scalability, high performance and resilience.
• Code complex requirements for large data platforms; deliver high-quality results.
• Deploy projects on public clouds and secure environments.
• Integrate with data governance tools and cloud ecosystem products.
• Translate business requirements into high-level and low-level designs.
• Develop analytics solutions to transform raw data into meaningful insights.
• Apply data mining, data modelling, NLP and ML to extract information.
• Visualize and report findings; create dynamic data reports.
• Collaborate with stakeholders and present to non-technical audiences.
• Advise on modular, reusable data engineering code practices.
• Stay current with data analytics trends including AI integrations.

Tools

Databricks

AWS

Python

Spark

Scala

Job description

At EY, we develop you with future-focused skills and equip you with world-class experiences. We empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams.

We work together across our full spectrum of services and skills powered by technology and AI, so that business, people and the planet can thrive together.

We’re all in, are you?

Join EY and shape your future with confidence

About The Opportunity

EY AI & Data is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry sectors. We implement information-driven strategies, data platforms and advanced data analytics solution systems that help grow, optimize and protect client organizations. We go beyond strategy and provide end to end design, build and implementation of real-life data environments and have some of the best architects, project managers, business analysts, data scientists, big data engineers, developers and consultants in the region. We are seeking a Data Engineer with strong experience in Databricks.

Your Key Responsibilities

• Ability to design data pipelines with scalability, high performance and resilience in-built
• Ability to code complex requirements as part of large complex data platforms - develop, refine, and implement high quality delivery executions
• Deliver project deployments on public clouds and highly secure environments
• Integrate with data governance tools, ecosystem products across the cloud landscape
• Ability to understand the business requirements and translate into high-level and low-level designs to successfully meets the business objectives.
• Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software.
• Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets.
• Visualize, interpret, and report data findings and may create dynamic data reports as well.
• Collaborate with stakeholders, presenting findings to a non-technical audience
• Bring in best practices for coding and building modular data engineering code that can be reused
• Stay current with technical and industry developments and standards to ensure effective and advanced applications of data analysis techniques and methodologies. Including AI integrations.

To qualify for the role, you must have

• Min bachelor’s degree in computer science, Mathematics, Engineering, Statistics, or a related field
• Databricks certifications, AWS certifications on data engineering
• At least 4 years of experience on various data platform solutions across data and analytics across the entire SDLC
• At least 2 years’ experience on designing and mapping requirements to technical capabilities of data pipelines on databricks across AWS
• Proficiency in programming leveraging Python, Spark, Scala and other programming languages
• Understanding of end-to-end data analytics domain and insights delivery
• Excellent understanding of data modelling techniques and leading trends on data platforms including AI
• Possess strong problem-solving, analytical and strategic thinking abilities
• GCC experience will be an added advantage
• Proficiency with agile boards like JIRA, Atlassian products
• Experience in Consulting/Professional Services environment

Ideally, you’ll also have

• Strong hands‑on knowledge and project experience in technical delivery of data platform projects across any of the – Databricks on AWS cloud.
• Must have hands‑on experience with ELT, data pipeline and orchestration tools.
• Experience in end-to-end technical project delivery following agile delivery methodologies
• Understanding of data modelling techniques and data governance tools will be an added advantage
• Experience in estimation, infrastructure sizing for data platform solutions

What We Look For

Highly motivated individuals with excellent problem-solving skills and the ability to prioritize shifting workloads in a rapidly changing industry.

An effective communicator, you’ll be a confident leader equipped with strong people management skills and a genuine passion to make things happen in a dynamic organization.

What Working At EY Offers

EY offers a competitive remuneration package where you’ll be rewarded for your individual and team performance. We are committed to being an inclusive employer and are happy to consider flexible working arrangements. Plus, we offer:

Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.

Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.

Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.

Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.

Company Description

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

All in to shape the future with confidence.