Data Engineer

The HEINEKEN Company; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Jira

Databricks access

Job summary

You will be part of the data engineering team and work on in‑house products for Data Foundation, collaborating closely with Data Engineering Leads and managers and other DataOps teams. This role involves hands-on development work and will report directly to the Data Engineering Lead.

You are a good match if you have 5+ years in Data/Software Engineering, strong expertise in Python, SQL, PySpark, and Azure cloud data services, and a track record of building scalable data pipelines in cloud

Qualifications

• Expert in Python, Pyspark and SQL.
• Logging and Monitoring using Azure / Databricks services.
• Strong experience in Azure cloud data services & technologies.

Responsibilities

• Experience in designing, developing, and delivering scalable, reliable, and high‑performing software solutions.
• Design, development, and maintenance of scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, design reviews, testing, and deployment processes.
• Ensure adherence to coding standards, best practices, and architectural guidelines.
• Inspire, advise, and drive the selection of development approaches.
• Participate in technical discussions with other teams/departments.
• Communicate with the Engineering Manager, Product Owner, Business Analyst, and Scrum Master to align on project/sprint goals, timelines, and resource allocation.

Skills

Python

PySpark

SQL

Azure

Databricks

CI/CD

Shell scripting

Azure CLI

GCP & AWS

Tools

Jira

Databricks

Job description

You will be a part of the data engineering team and working on in-house products in for Data Foundation Collaborating closely with Data Engineering Leads and managers and other DataOps teams. This role involves hands‑on development work and will directly report to Data Engineering Lead.

Must have skills:

• Expert in Python, Pyspark and SQL
• Logging and Monitoring using Azure / Databricks services
• Strong experience in Azure cloud data services & technologies

Nice to have:

• Microsoft EntraID
• GCP & AWS cloud services knowledge
• Databricks online table
• Jira
• Shell scripting / Azure CLI knowledge

Your responsibilities will include:

• Experience in designing, developing, and delivering scalable, reliable, and high‑performing software solutions.
• Design, development, and maintenance of scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, design reviews, testing, and deployment processes.
• Ensure adherence to coding standards, best practices, and architectural guidelines.
• Inspire, advise, and drive the selection of development approaches.
• Participate in technical discussions with other teams/departments.
• Communicate with the Engineering Manager, Product Owner, Business Analyst, and Scrum Master to align on project/sprint goals, timelines, and resource allocation.

You are a good match if you have:

• 5+ years of working experience in the field of Data Engineering or Software Engineering.
• Hands‑on experience and in‑depth knowledge of the technologies listed as mandatory in the Technology Stack section.
• Strong understanding and implementation of software development principles, coding standards, and modern architecture.
• Experience working on diverse projects with varying technologies, products, and systems.
• Strong problem‑solving skills and the ability to make critical technical decisions.
• Ability to guide and mentor other team members.
• Strong stakeholder engagement and influencing skills.
• Pragmatic and collaborative team player.
• Experience with Databricks, data pipelines, and CI/CD.
• Proficiency in Python, SQL, and big data technologies in cloud environments.
• Pragmatic and collaborative team player.