Senior Consultant

Emids Technologies; Bengaluru; Hybrid; INR 2.500.000 - 4.500.000; Vollzeit

Zusammenfassung

Emids Technologies in Bengaluru seeks an experienced Associate Architect / Architect Data Engineering to lead data engineering initiatives. The role demands 7+ years of hands-on experience with Databricks, PySpark, AWS, and Airflow, plus Python and SQL.

You will lead data engineers, define best practices, review code, and drive scalable data pipelines while partnering with cross-functional stakeholders to translate business needs into robust platforms.

Qualifikationen

• 7+ years of experience in Data Engineering / Data Platform / Big Data technologies.
• Strong hands-on experience with Databricks, PySpark, AWS and Airflow with Python and SQL.
• Proven experience in technical leadership, mentoring, or leading data engineering teams.

Aufgaben

• Provide technical leadership and mentorship to a team of data engineers.
• Define and implement best practices, coding standards, and development methodologies.
• Conduct code reviews and guide improvements in code quality and scalability.
• Drive technical decisions and resolve complex data engineering challenges.
• Identify risks and define mitigation strategies.
• Design, develop, and maintain scalable, reliable data pipelines.
• Build data engineering solutions using Databricks, AWS, PySpark, Python and SQL.
• Design and implement data architecture, data models, ETL/ELT frameworks.

Kenntnisse

Leadership

Architecture knowledge

Problem solving

Stakeholder management

Mentoring

Tools

Databricks

PySpark

AWS

Airflow

Python

SQL

Jobbeschreibung

We are looking for an experienced Associate Architect / Architect Data Engineering to provide hands‑on technical leadership for our data engineering initiatives. The ideal candidate should have 7+ years of experience in data engineering, with strong expertise in Databricks, PySpark, AWS, and Airflow with Python and SQL experience.

The Tech Lead will be responsible for leading a team of data engineers, designing scalable and high-performance data solutions, establishing engineering best practices, and partnering with cross-functional stakeholders to translate business requirements into robust data platforms and pipelines.

This role requires a combination of strong technical expertise, architecture knowledge, team leadership, problem-solving ability, and stakeholder management skills.

Role & responsibilities

• Provide technical leadership and mentorship to a team of data engineers.
• Define and implement best practices, coding standards, development methodologies, and engineering guidelines.
• Conduct code reviews and provide technical guidance to improve code quality, scalability, and maintainability.
• Drive technical decisions and resolve complex data engineering challenges.
• Identify technical risks and define appropriate mitigation strategies.
• Design, develop, and maintain scalable, reliable, and high-performance data pipelines.
• Build data engineering solutions using Databricks, AWS Cloud Services, PySpark, Python and SQL.
• Design and implement data architecture, data models, ETL/ELT frameworks, and data processing solutions.

Preferred candidate profile

• 7+ years of overall experience in Data Engineering / Data Platform / Big Data technologies.
• Strong hands‑on experience with Databricks, PySpark, AWS and Airflow with Python and SQL.
• Proven experience in technical leadership, mentoring, or leading data engineering teams.
• Strong experience designing and implementing enterprise-scale data pipelines and data platforms.
• Experience working with large-scale data processing and distributed computing environments.
• Strong understanding of data architecture, data modeling, ETL/ELT, and data integration.
• Experience working with cross-functional teams and senior technology/business stakeholders.
• Strong analytical, problem-solving, and troubleshooting capabilities.