TC - Data Engineer Databricks - Senior

Iris Software; Ernakulam; On-site; INR 8,00,000 - 12,00,000; Full time

Job summary

A global consulting firm is seeking a Senior Consultant - Data Engineer to design and manage Databricks environments and optimize data models. The ideal candidate should have over 3 years of experience in Databricks, proficient in Python or PySpark, and a degree in Computer Science. Excellent problem-solving and communication skills are essential. This role is based in Ernakulam, Kerala.

Qualifications

• 3+ years of hands-on experience with Databricks.
• Proficiency in Python and experience with at least one ETL tool.
• Knowledge of Agile methodologies.

Responsibilities

• Design and manage Databricks environments.
• Execute ETL processes for data flow.
• Optimize data models for performance.

Skills

Expertise in Databricks for big data solutions

Experience in building data pipelines

Proficient in Python or PySpark

Solid understanding of data warehousing tools

Knowledge of DevOps practices

Expertise in SQL

Strong problem-solving abilities

Education

Degree in Computer Science or related field

Tools

Databricks

ETL tools

Job description

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

Job Description for Senior Consultant - Data Engineer (Databricks)

EY GDS – Data and Analytics (D&A) – Data Engineer (Databricks) - Senior Consultant

Your Key Responsibilities:

• Design, Implement and manage Databricks environments across various cloud platforms.
• Design and execute ETL processes, ensuring efficient data flow into cloud-based services.
• Collaborate with global teams to understand business objectives and deliver solutions.
• Optimize data models and algorithms for improved performance and scalability.

Skills and Attributes for Success:

• Demonstrated expertise in Databricks for big data solutions with 3+ years of relevant experience.
• Proven experience (3+ years) in building data pipelines, data ingestion, and analytical frameworks for various database systems.
• Proficient in data migration and processing using cloud-based services.
• Skilled in Python or PySpark for data manipulation and analysis.
• Solid understanding and practical experience with data warehousing tools.
• Knowledgeable in DevOps practices, including CI/CD for streamlined deployments.
• Expertise in SQL, including advanced procedural SQL.
• Strong problem-solving abilities with a focus on delivering high‑quality technical solutions.

To Qualify for the Role, You Must Have:

• A degree in Computer Science or a related field with 3+ years of relevant industry experience.
• Primary skills: 3+ years of hands‑on experience with Databricks on any major cloud platform.
• Secondary skills: Proficiency in Python and experience with at least one ETL tool.
• Prior experience in Power & Utilities, Oil & Gas, or Manufacturing domains preferred.
• Databricks Data Engineer certification is preferred.
• Experience with Agile methodologies is preferred.
• Self‑motivated with a proactive approach to problem‑solving.
• Ability to analyse complex technical issues and provide effective solutions.
• Commitment to software development best practices.
• Proficient in debugging and optimizing enterprise‑level applications.
• Capable of translating business challenges into robust technical solutions.
• Excellent communication skills, both written and verbal.
• Experience in managing client relationships and understanding client needs.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi‑disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.