Manager - Data Engineering

Tesco Bengaluru; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Market-competitive salary

Performance bonus

Health and wellness programs

Financial wellbeing initiatives

Job summary

A leading retail firm in India is looking for a Manager - Data Engineering to build solutions for workforce management in retail. This role involves designing and maintaining big data pipelines, optimizing processes, and leading a skilled team. The ideal candidate has over 7 years of experience in data engineering with strong proficiency in Spark, Scala, and Hadoop, as well as effective problem-solving skills. The position offers a competitive salary and comprehensive benefits tailored to support work-life balance.

Qualifications

• 7+ years of experience in building and maintaining big data platforms.
• Proficiency in creating data pipelines with Spark, Scala, and Hadoop.
• Strong knowledge of ETL processes and data governance.

Responsibilities

• Design and implement scalable data processing pipelines.
• Develop and maintain ETL processes for big data.
• Optimize Spark jobs for performance.

Skills

Linux/Unix/Shell

Spark/Scala

Python

Hadoop

ETL Processes

Data Modeling

Problem-solving skills

Tools

Oozie/Airflow

Job description

Join to apply for the Manager - Data Engineering role at Tesco Bengaluru

About the role

Build solutions for real-world problems in workforce management for retail. You will work with a team of highly skilled developers and product managers throughout the entire software development lifecycle of the products we own. In this role, you will be responsible for designing, building, and maintaining our big data pipelines. Your primary focus will be on developing data pipelines using available technologies.

You will be responsible for:

• Following our Business Code of Conduct and acting with integrity and due diligence, with specific risk responsibilities.
• Representing Talent Acquisition in forums/seminars related to process, compliance, and audit.
• Performing miscellaneous duties as required by management.
• Driving CI culture, implementing CI projects, and fostering innovation within the team.
• Designing and implementing scalable and reliable data processing pipelines using Spark/Scala/Python and Hadoop ecosystem.
• Developing and maintaining ETL processes to load data into our big data platform.
• Optimizing Spark jobs and queries to improve performance and reduce processing time.
• Working with product teams to communicate and translate needs into technical requirements.
• Designing and developing monitoring tools and processes to ensure data quality and availability.
• Collaborating with other teams to integrate data processing pipelines into larger systems.
• Delivering high-quality code and solutions, bringing solutions into production.
• Performing code reviews to optimize technical performance of data pipelines.
• Continuously seeking ways to evolve and improve our technology, processes, and practices.
• Leading discussions on system design and architecture.
• Managing and coaching individuals, providing regular feedback and career development support aligned with business goals.
• Allocating and overseeing team workload effectively, ensuring timely and high-quality outputs.
• Defining and streamlining team workflows, ensuring adherence to SLAs and data governance practices.
• Monitoring and reporting key performance indicators (KPIs) to drive continuous improvement in delivery efficiency and system uptime.
• Overseeing resource allocation and prioritization, aligning team capacity with project and business demands.

Skills & Experience

• 7+ years of experience in building and maintaining big data platforms and data engineering.
• Proficiency in Linux/Unix/Shell environments, Spark/Scala, Python, Hadoop ecosystem, ETL processes, and data modeling.
• Strong knowledge of distributed computing principles and big data technologies like Hadoop, Spark, Kafka, streaming, etc.
• Experience with ETL processes, data quality, and data governance.
• Problem-solving and troubleshooting skills.
• Working knowledge of Oozie/Airflow, unittesting, and shell scripting.
• Ability to work independently and as part of a fast-paced team.

You will need:

Refer to responsibilities above.

What's in it for you?

At Tesco, we are committed to providing the best for you. Our colleagues enjoy a market-competitive reward package, including salary, performance bonus, leave, health and wellness programs, financial wellbeing initiatives, and more. We support a healthy work-life balance and offer various benefits to ensure your well-being and development.

About Us

Tesco in Bengaluru is a multi-disciplinary team serving our customers, communities, and planet. Our goal is to create a sustainable competitive advantage through standardization, cost savings, technological agility, and empowering our colleagues. Established in 2004, Tesco Bengaluru supports millions of customers worldwide and over 330,000 colleagues.

Tesco Business Solutions

Founded in 2017, Tesco Business Solutions in Bengaluru supports the Tesco Group globally with innovative, scalable, and value-driven solutions, supported by over 4,400 skilled colleagues across multiple locations.