Senior Data Engineer

Heineken; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Heineken is seeking a skilled Data Engineer to join the Data Foundation team in Hyderabad, India. The role involves hands-on development of in-house data products, collaborating with Data Engineering Leads and other DataOps teams, and reporting to the Data Engineering Lead.

You will design scalable data pipelines, implement ETL processes, and ensure robust data infrastructure. Strong Python, PySpark, SQL, and Azure Databricks expertise are required.

Qualifications

• Expert in Python, PySpark and SQL.
• Experience with logging and monitoring in Azure / Databricks services.
• Strong experience with Azure cloud data services & technologies.

Responsibilities

• Design, develop, and deliver scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, testing, and deployment processes.
• Ensure adherence to coding standards and architectural guidelines.
• Inspire and drive the selection of development approaches.
• Participate in technical discussions with other teams.

Skills

Python

PySpark

SQL

Azure Databricks

Tools

Jira

Azure CLI

Databricks

Job description

You will be a part of the data engineering team and working on in-house products in for Data Foundation Collaborating closely with Data Engineering Leads and managers and other DataOps teams. This role involves hands-on development work and will directly report to Data Engineering Lead.

Must haveskills:

• Expert in Python, Pyspark and SQL
• Logging and Monitoring using Azure / Databricks services
• Strong experience in Azure cloud data services & technologies

Nice to have:

• Microsoft EntraID
• GCP & AWS cloud services knowledge
• Databricks online table
• Jira
• Shell scripting / Azure CLI knowledge

Your responsibilities will include:

• Experience in designing, developing, and delivering scalable, reliable, and high-performing software solutions.
• Design, development, and maintenance of scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, design reviews, testing, and deployment processes.
• Ensure adherence to coding standards, best practices, and architectural guidelines.
• Inspire, advise, and drive the selection of development approaches.
• Participate in technical discussions with other teams/departments.
• Communicate with the Engineering Manager, Product Owner, Business Analyst, and Scrum Master to align on project/sprint goals, timelines, and resource allocation.

You are a good match if you have:

• Min 5-7+ years of working experience in the field of Data Engineering or Software Engineering.
• Hands-on experience and in-depth knowledge of the technologies listed as mandatory in the Technology Stack section.
• Strong understanding and implementation of software development principles, coding standards, and modern architecture.
• Experience working on diverse projects with varying technologies, products, and systems.
• Strong problem-solving skills and the ability to make critical technical decisions.
• Ability to guide and mentor other team members.
• Strong stakeholder engagement and influencing skills.
• Pragmatic and collaborative team player.
• Experience with Databricks, data pipelines, and CI/CD.
• Proficiency in Python, SQL, and big data technologies in cloud environments.
• Pragmatic and collaborative team player.