Data Engineer

The HEINEKEN Company; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

The HEINEKEN Company is seeking a data engineer to join our data foundation team in Hyderabad, India. You will work on in-house data foundation products, collaborating with Data Engineering Leads and other DataOps teams to design, build, and optimize scalable data pipelines.

Ideal candidates have 5+ years in data or software engineering, strong Python/SQL/Pyspark skills, and hands-on experience with Azure Databricks and cloud data services.

Qualifications

• 5+ years of experience in Data Engineering or Software Engineering.
• Hands-on experience with Python, SQL, and big data technologies in cloud environments.
• Experience designing, developing, and maintaining scalable data pipelines and ETL processes.
• Strong understanding of software development principles and modern architecture.

Responsibilities

• Experience in designing, developing, and delivering scalable, reliable, and high-performing software solutions.
• Design, development, and maintenance of scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, design reviews, testing, and deployment processes.
• Ensure adherence to coding standards, best practices, and architectural guidelines.
• Inspire, advise, and drive the selection of development approaches.
• Participate in technical discussions with other teams/departments.
• Communicate with the Engineering Manager, Product Owner, Business Analyst, and Scrum Master to align on project/sprint goals, timelines, and resource allocation.

Skills

Python

Pyspark

SQL

Azure

Databricks

Azure CLI

Jira

Tools

Databricks

Azure CLI

Jira

Job description

You will be a part of the data engineering team and working on in-house products in for Data Foundation Collaborating closely with Data Engineering Leads and managers and other DataOps teams. This role involves hands-on development work and will directly report to Data Engineering Lead.

Must have skills:

• Expert in Python, Pyspark and SQL
• Logging and Monitoring using Azure / Databricks services
• Strong experience in Azure cloud data services & technologies

Nice to have:

• Microsoft EntraID
• GCP & AWS cloud services knowledge
• Databricks online table
• Jira
• Shell scripting / Azure CLI knowledge

Your responsibilities will include:

• Experience in designing, developing, and delivering scalable, reliable, and high-performing software solutions.
• Design, development, and maintenance of scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, design reviews, testing, and deployment processes.
• Ensure adherence to coding standards, best practices, and architectural guidelines.
• Inspire, advise, and drive the selection of development approaches.
• Participate in technical discussions with other teams/departments.
• Communicate with the Engineering Manager, Product Owner, Business Analyst, and Scrum Master to align on project/sprint goals, timelines, and resource allocation.

You are a good match if you have:

• 5+ years of working experience in the field of Data Engineering or Software Engineering.
• Hands-on experience and in-depth knowledge of the technologies listed as mandatory in the Technology Stack section.
• Strong understanding and implementation of software development principles, coding standards, and modern architecture.
• Experience working on diverse projects with varying technologies, products, and systems.
• Strong problem-solving skills and the ability to make critical technical decisions.
• Ability to guide and mentor other team members.
• Strong stakeholder engagement and influencing skills.
• Pragmatic and collaborative team player.
• Experience with Databricks, data pipelines, and CI/CD.
• Proficiency in Python, SQL, and big data technologies in cloud environments.
• Pragmatic and collaborative team player.