Data Engineer

AAP Global Capability Center LLP (380); India; Remote; INR 1,200,000 - 2,400,000; Full time

Job summary

Advance Auto Parts, Inc. seeks a Data Engineer in Hyderabad, India to help migrate and modernize data platforms, moving applications and pipelines to Google Cloud-based solutions.

You will architect and maintain cloud data infrastructure using AWS or GCP services and ensure data security and governance. Collaborate with data science and product teams to drive analytics, develop real-time and batch processing, and mentor a team of engineers.

Qualifications

• 4–9 years of Data Engineering and application development experience.
• Graduate degree in Computer Science or related field.
• Proficiency in Python, Java, Spark, SQL, and data modeling.
• Experience with AWS/GCP cloud platforms and building large-scale pipelines.
• Familiarity with CI/CD, IaC, data governance, and Agile methods.
• Knowledge of Kafka or similar real-time data streaming.

Responsibilities

• Migrate and modernize data platforms to Google Cloud-based solutions.
• Architect and maintain cloud-based data infrastructure using AWS or GCP.
• Ensure data security and governance in line with regulations.
• Develop best practices for data modeling, processing, analytics.
• Mentor data engineers and scale data pipelines for new products.
• Collaborate with data science and product teams on PoCs.
• Develop automated monitoring for pipeline performance.
• Document technical knowledge and create reusable libraries.

Skills

Python

Java

Spark

SQL

Cloud (AWS/GCP)

Data pipelines

Big Data

Education

Bachelor's degree in CS or related field

Tools

AWS

GCP

Kafka

Palantir Foundry

Terraform

Snowflake

BigQuery

Job description

Job Description

Job Title : Data Engineer Location : Hyderabad, India

WHO WE ARE

Come join our Technology Team and start reimagining the future of the automotive aftermarket. We are a highly motivated tech-focused organization, excited to be amid dynamic innovation and transformational change. Driven by Advance’s top-down commitment to empowering our team members, we are focused on delighting our Customers with Care and Speed, through delivery of world class technology solutions and products. We value and cultivate our culture by seeking to always be collaborative, intellectually curious, fun, open, and diverse. You will be a key member of a growing and passionate group focused on collaborating across business and technology resources to drive forward key programs and projects building enterprise capabilities across Advance Auto Parts.

THE OPPORTUNITY

Join the AAP team and start reimagining the future of automotive retail. Disrupt the way consumers buy auto parts and take on the industry’s biggest challengers to execute on AAP's top-down commitment to digital expansion. As a member of the Advance Auto Parts team, you will have an opportunity to disrupt a $150B auto parts industry to bring better and faster solutions to customers. You will be part of a team helping the company live its mission of “Advancing a World in Motion”. The role is part of a merit-based organization with a culture of professional growth and development, and emphasis on the latest tools, platforms and technologies.

Responsibilities

• Help in the migration and modernization of data platforms, moving applications and pipelines to Google Cloud-based solutions.
• Architect and maintain cloud-based data infrastructure leveraging AWS or GCP services.
• Ensure data security and governance, enforcing compliance with industry standards and regulations.
• Develop and promote best practices for data modeling, processing, and analytics.
• Mentor and guide a team of data engineers, fostering a culture of innovation and technical excellence.
• Manage and scale data pipelines from internal and external data sources to support new product launches and ensure high data quality.
• Develop automation and monitoring frameworks to capture key metrics and operational KPIs for pipeline performance.
• Collaborate with internal teams, including data science and product teams, to drive solutioning and proof-of-concept (PoC) discussions.
• Develop and optimize procedures to transition data into production.
• Define and manage SLAs for data products and operational processes.
• Research and apply state-of-the-art methodologies in data and Platform engineering.
• Create and maintain technical documentation for sharing knowledge.
• Develop reusable packages and libraries to enhance development efficiency.
• Lead and drive the development and optimization of scalable data architectures and pipelines.
• Develop real-time and batch data processing solutions, integrating structured and unstructured data sources.

Required Qualification

• We are looking for a candidate with 4-9 years of experience in Data Engineering and Application development.
• They must have a graduate degree in Computer Science or a related field of study.
• They must have experience with programming languages such as Python, Java & DS&Algo, Spark, SQL, Scala, Snowflake, Big Query.
• 4-9 years of AWS/GCP and Cloud technologies.
• Experience in data platform engineering, with a focus on cloud transformation and modernization.
• Hands-on experience building large, scaled data pipelines in cloud environments and handling of data in PBs.
• Experience with CI/CD pipeline management in DevOps.
• Experience with Understanding of data governance, security, and compliance best practices.
• Experience working in an Agile development environment.
• Prior experience in migrating applications from legacy platforms to the cloud.
• Knowledge of Terraform or Infrastructure-as-Code (IaC) for cloud resource management.
• Familiarity with Kafka, Event Hubs, or other real-time data streaming solutions.
• Familiarity with Palantir Foundry is good to have.
• Certification with Cloud Technologies (AWS/GCP) is good to have.

Advance Auto Parts, Inc. is a leading automotive aftermarket parts provider that serves both professional installers and do-it-yourself customers.

As of October 5, 2024, Advance operated 4,781 stores primarily within the United States, with additional locations in Canada, Puerto Rico and the U.S. Virgin Islands.

The company also served 1,125 independently owned Carquest branded stores across these locations in addition to Mexico and various Caribbean islands.

Additional information about Advance, including employment opportunities, customer services and online shopping for parts, accessories and other offerings can be found at www.AdvanceAutoParts.com.