Data Engineer

Advance Auto Parts; Hyderabad; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Advance Auto Parts in Hyderabad, India is seeking a Data Engineer to help migrate and modernize data platforms, building cloud-based pipelines on AWS and GCP, and ensuring data security and governance.

You will mentor a team, develop real-time and batch data processing, collaborate with data science and product teams, and define SLAs for data products as part of a broader digital transformation.

Qualifications

• 4-9 years of Data Engineering and Application development experience.
• Graduate degree in Computer Science or a related field.
• Proficiency in Python, Java, DS & Algo, Spark, SQL, Scala, Snowflake, BigQuery.
• 4-9 years of AWS/GCP and Cloud technologies.
• Hands-on experience building large, scaled data pipelines in cloud environments.
• Experience with CI/CD pipeline management in DevOps.
• Understanding of data governance, security and compliance best practices.
• Experience in Agile development environment.
• Prior experience migrating applications to the cloud.
• Knowledge of Terraform or IaC for cloud resource management.
• Familiarity with Kafka, Event Hubs or other real-time data streaming solutions.
• Familiarity with Palantir Foundry; certification with AWS/GCP is a plus.

Responsibilities

• Migrate and modernize data platforms to Google Cloud-based solutions.
• Architect and maintain cloud-based data infrastructure using AWS or GCP.
• Ensure data security and governance with compliance to industry standards.
• Develop and promote best practices for data modeling, processing and analytics.
• Mentor and guide a team of data engineers.
• Manage and scale data pipelines from multiple data sources for new product launches.
• Develop automation and monitoring frameworks for KPIs and pipeline performance.
• Collaborate with data science and product teams on PoC discussions.
• Define SLAs for data products and production processes.
• Research and apply state-of-the-art data & Platform engineering methodologies.
• Create technical documentation and reusable libraries.
• Lead development of scalable data architectures.
• Develop real-time and batch data processing solutions.

Skills

Python

Java

DS & Algo

Spark

SQL

Scala

Snowflake

BigQuery

Education

Bachelor's degree in Computer Science

Tools

Terraform

Palantir Foundry

Kafka

Event Hubs

CI/CD

Job description

Job Description

Job Title : Data Engineer

Location : Hyderabad, India

WHO WE ARE

Come join our Technology Team and start reimagining the future of the automotive aftermarket. We are a highly motivated tech-focused organization, excited to be amid dynamic innovation and transformational change. Driven by Advance’s top-down commitment to empowering our team members, we are focused on delighting our Customers with Care and Speed, through delivery of world class technology solutions and products.

We value and cultivate our culture by seeking to always be collaborative, intellectually curious, fun, open, and diverse. You will be a key member of a growing and passionate group focused on collaborating across business and technology resources to drive forward key programs and projects building enterprise capabilities across Advance Auto Parts.

THE OPPORTUNITY:

Join the AAP team and start reimagining the future of automotive retail. Disrupt the way consumers buy auto parts and take on the industry’s biggest challengers to execute on AAP’s top-down commitment to digital expansion.

As a member of the Advance Auto Parts team, you will have an opportunity to disrupt a $150B auto parts industry to bring better and faster solutions to customers. You will be part of a team helping the company live its mission of "Advancing a World in Motion". The role is part of amerit-based organization with a culture of professional growth and development, and emphasis on the latest tools, platforms and technologies.

Responsibilities:

• Help in the migration and modernization of data platforms, moving applications and pipelines to Google Cloud-based solutions.

• Architect and maintain cloud-based data infrastructure leveraging AWS or GCP services.

• Ensure data security and governance, enforcing compliance with industry standards and regulations.

• Develop and promote best practices for data modeling, processing, and analytics.

• Mentor and guide a team of data engineers, fostering a culture of innovation and technical excellence.

• Manage and scale data pipelines from internal and external data sources to support new product launches and ensure high data quality.

• Develop automation and monitoring frameworks to capture key metrics and operational KPIs for pipeline performance.

• Collaborate with internal teams, including data science and product teams, to drive solutioning and proof-of-concept (PoC) discussions.

• Develop and optimize procedures to transition data into production. Define and manage SLAs for data products and operational processes.

• Research and apply state-of-the-art methodologies in data and Platform engineering.

• Create and maintain technical documentation for sharing knowledge.

• Develop reusable packages and libraries to enhance development efficiency.

• Lead and drive the development and optimization of scalable data architectures and pipelines.

• Develop real-time and batch data processing solutions, integrating structured and unstructured data sources.

Required Qualification:

• We are looking for a candidate with 4-9 years of experience in Data Engineering and Application development.

• They must have a graduate degree in Computer Science or a related field of study.

• They must have experience with programming languages such as Python, Java & DS&Algo, Spark, SQL, Scala, Snowflake, Big Query.

• 4-9 years of AWS/GCP and Cloud technologies. Experience in data platform engineering, with a focus on cloud transformation and modernization.

• Hands-on experience building large, scaled data pipelines in cloud environments and handling of data in PBs.

• Experience with CI/CD pipeline management in DevOps.

• Experience with Understanding of data governance, security, and compliance best practices.

• Experience working in an Agile development environment.

• Prior experience in migrating applications from legacy platforms to the cloud.

• Knowledge of Terraform or Infrastructure-as-Code (IaC) for cloud resource management.

• Familiarity with Kafka, Event Hubs, or other real-time data streaming solutions.

• Familiarity with Palantir Foundry is good to have Certification with Cloud Technologies (AWS/GCP) is good to have