TC - Data Engineer Databricks - Senior

Ernst & Young Advisory Services Sdn Bhd; Ernakulam; On-site; INR 12,00,000 - 18,00,000; Full time

Job summary

A global professional services firm is seeking a Senior Consultant - Data Engineer specializing in Databricks. The candidate will design and manage Databricks environments, optimize data models, and develop data pipelines. With a focus on collaboration and proactive problem-solving, the ideal applicant will have 3+ years of experience and a degree in Computer Science. This role presents excellent opportunities for growth within a dynamic team environment.

Qualifications

• 3+ years of experience with Databricks.
• Experience in building data pipelines and analytical frameworks.
• Proficient in debugging and optimizing applications.

Responsibilities

• Design and manage Databricks environments.
• Execute ETL processes for efficient data flow.
• Collaborate with global teams to deliver solutions.

Skills

Databricks expertise

Data pipeline development

Python proficiency

SQL skills

Cloud services knowledge

Data migration

Education

Degree in Computer Science or related field

Tools

ETL tools

Data warehousing tools

Job description

Select how often (in days) to receive an alert:

Select how often (in days) to receive an alert:

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

Job Description for Senior Consultant - Data Engineer (Databricks)

EY GDS – Data and Analytics (D&A) – Data Engineer (Databricks) - Senior Consultant

Your Key Responsibilities:

• Design, Implement and manage Databricks environments across various cloud platforms.
• Design and execute ETL processes, ensuring efficient data flow into cloud-based services.
• Collaborate with global teams to understand business objectives and deliver solutions.
• Optimize data models and algorithms for improved performance and scalability.

Skills and Attributes for Success:

• Demonstrated expertise in Databricks for big data solutions with 3+ years of relevant experience.
• Proven experience (3+ years) in building data pipelines, data ingestion, and analytical frameworks for various database systems.
• Proficient in data migration and processing using cloud-based services.
• Skilled in Python or PySpark for data manipulation and analysis.
• Solid understanding and practical experience with data warehousing tools.
• Knowledgeable in DevOps practices, including CI/CD for streamlined deployments.
• Expertise in SQL, including advanced procedural SQL.
• Strong problem-solving abilities with a focus on delivering high-quality technical solutions.

To Qualify for the Role, You Must Have:

• A degree in Computer Science or a related field with 3+ years of relevant industry experience.
• Primary skills: 3+ years of hands-on experience with Databricks on any major cloud platform.
• Secondary skills: Proficiency in Python and experience with at least one ETL tool.
• Prior experience in Power & Utilities, Oil & Gas, or Manufacturing domains preferred
• Experience with Agile methodologies is preferred.
• Self-motivated with a proactive approach to problem-solving.
• Ability to analyse complex technical issues and provide effective solutions.
• Commitment to software development best practices.
• Proficient in debugging and optimizing enterprise-level applications.
• Capable of translating business challenges into robust technical solutions.
• Excellent communication skills, both written and verbal.
• Experience in managing client relationships and understanding client needs.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

EY refers to the global organization, and may refer to one or more, of the member firms of Ernst & Young Global Limited, each of which is a separate legal entity. Ernst & Young Global Limited, a UK company limited by guarantee, does not provide services to clients.

Provider

Description

Enabled

SAP as service provider

• "route" is used for session stickiness
• "careerSiteCompanyId" is used to send the request to the correct data center
• "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor