Data Engineering Lead

Heineken; Hyderabad; On-site; INR 4,000,000 - 6,500,000; Full time

Job summary

Heineken is seeking a Data Engineering Lead to head the data engineering team in Hyderabad, focusing on in-house data foundation and data pipelines. You will collaborate with Product Owners and DataOps teams to translate business needs into scalable architecture while delivering hands-on coding and governance.

The role requires 10+ years in IT with 7–8 years in data engineering, 3–4 years in team/stakeholder management, and strong skills in Python, PySpark, SQL, and Azure data services,

Qualifications

• Min 10 years of IT exp including min 7-8 yrs of Data Engineering exp.
• Min 3-4 years of experience in Team Management and Stakeholder Management.
• Strong experience in Azure cloud data services & technologies.
• Expert coding skills in Python, PySpark and SQL.
• Logging and Monitoring using Azure / Databricks services.

Responsibilities

• Lead a team of experienced team members of Data Engineers in designing, developing, and delivering scalable, reliable, and high performing software solution.
• Lead the design, development, and maintenance of scalable data pipelines and ETL processes. Monitor and optimize data infrastructure performance, identifying and resolving bottlenecks and issues.
• Lead the team from a technical standpoint, and drive operational excellence, including code reviews, design reviews, testing, and deployment processes.
• Be an individual contributor (~60%) engineering the software products/solutions, jointly with the team and ensure that the team adheres to coding standards, best practices, and architectural guidelines, oversee team spirit and team performance, guide and mentor team members.
• Oversee the implementation of the technical architecture, solve immediate technical challenges.
• Implement good practices, coding standards and modern architecture for DataOps; be a “go-to-person for technical decisions and problem-solving within the team and Ensure that the execution of DataOps is in place in the team's daily work, Inspire, advise, and drive the selection of development approach, coordinate software development and address technical debt in the team.
• Hire, onboard, mentor, and develop top engineering talents, fostering a culture of learning, collaboration, and continuous improvement.
• Lead technical discussions with other teams/departments and oversees state-of-art quality of the stack,.May be involved in cross-functional discussions, representing the domain in broader technical discussions across domains
• Responsible for designing and improving processes that enhance efficiency and quality communication with Engineering Manager, Product Owner, Business Analyst and Scrum Master to align on project. / sprint goals, timeline and resource allocation

Skills

Data Engineering

Team Leadership

Stakeholder Management

Python

PySpark

SQL

Azure cloud data services

Tools

Azure Databricks

Azure Data Factory

Job description

As the Data Engineering Lead, you will be a leader of the data engineering team

working on in-house products in for Data Foundation Collaborating closely with Product Owner(s), Product Architect(s) and other DataOps teams you will need to understand the business needs, helping Product Architect(s) to convert those needs into solution architecture specifications and services in line with overall engineering standards and roadmaps. You will be driving excellence in engineering practices to deliver high-quality solutions throughout the software development lifecycle in our IT landscape. This role involves hands-on development work.

This role will directly report to Engineering Manager

Required skills & Experience

• Min 10 years of IT expereince is required including min 7-8 yrs of Data Engineering expereince.
• Min 3-4 years of experience in Team Management and Stakeholder Management.
• Strong experience in Azure cloud data services & technologies
• Expert coding skillsin Python, Pyspark and SQL
• Logging and Monitoring using Azure / Databricks services

Responsibilities

• Lead a team of experienced team members of Data Engineers in designing, developing, and delivering scalable, reliable, and high performing software solution
• Lead the design, development, and maintenance of scalable data pipelines and ETL processes. Monitor and optimize data infrastructure performance, identifying and resolving bottlenecks and issues
• Lead the team from a technical standpoint, and drive operational excellence, including code reviews, design reviews, testing, and deployment processes.
• Be an individual contributor (~60%) engineering the software products/solutions, jointly with the team and ensure that the team adheres to coding standards, best practices, and architectural guidelines, oversee team spirit and team performance, guide and mentor team members.
• Oversee the implementation of the technical architecture, solve immediate technical challenges.
• Implement good practices, coding standards and modern architecture for DataOps; be a “go-to-person for technical decisions and problem-solving within the team and Ensure that the execution of DataOps is in place in the team's daily work, Inspire, advise, and drive the selection of development approach, coordinate software development and address technical debt in the team.
• Hire, onboard, mentor, and develop top engineering talents, fostering a culture of learning, collaboration, and continuous improvement.
• Lead technical discussions with other teams/departments and oversees state-of-art quality of the stack,.May be involved in cross-functional discussions, representing the domain in broader technical discussions across domains
• Responsible for designing and improving processes that enhance efficiency and quality communication with Engineering Manager, Product Owner, Business Analyst and Scrum Master to align on project. / sprint goals, timeline and resource allocation