GCP Lead Data Engineer

Tredence Inc.; Bengaluru; Hybrid; INR 1,500,000 - 2,300,000; Full time

Job summary

Tredence Inc. is seeking a GCP Lead Data Engineer in Bengaluru to design and implement scalable data pipelines on Google Cloud, leveraging Composer, BigQuery, Dataflow, and more. You will collaborate with cross-functional teams to deliver robust analytics solutions for retail and AI-driven transformations.

Lead the architecture, mentor junior engineers, and drive DevOps practices for CI/CD and monitoring, ensuring cost-effective, secure data platforms.

Qualifications

• 8–12 years of experience in data engineering or architecture roles.
• Hands-on expertise in GCP technologies (Composer, BigQuery, Bigtable, Dataflow, Dataproc, Datastore).
• Proficiency in Python and SQL for data processing.
• Experience with DevOps, CI/CD, and infrastructure-as-code on GCP.
• BE/BTech in CS or IT.
• Strong data modeling, ETL/ELT, and cloud architecture skills.

Responsibilities

• Design, develop, and deploy scalable data engineering solutions on GCP.
• Architect end-to-end pipelines using BigQuery, Dataflow, Dataproc, and Datastore.
• Collaborate with data scientists, analysts, and software engineers.
• Implement DevOps practices for CI/CD and monitoring of pipelines.
• Optimize queries and data storage for cost-efficiency.
• Develop reusable components and templates.
• Provide technical leadership and mentor junior engineers.
• Stay current with emerging technologies to improve architectures.

Skills

GCP

Python

SQL

CI/CD

DevOps

IaC

Cloud Architecture

ETL/ELT

Data Modeling

Education

BE/BTech

Tools

BigQuery

Bigtable

Dataflow

Dataproc

Datastore

Composer

Job description

Job Overview: As a GCP lead DE at Tredence, you will lead the design and implementation of scalable data engineering solutions for the retail industry, leveraging Google Cloud Platform technologies. Success in this role means delivering robust, efficient, and secure data pipelines that enable actionable business insights. You will collaborate closely with cross-functional teams to ensure last-mile adoption of analytics and drive measurable business outcomes. This position plays a crucial role in reinforcing Tredence’s leadership in practical AI and data-driven transformations.

Role: GCP Lead Data Engineer

Experience: 8- 12 years

Work Mode - Hybrid

Availability to join - Max 30 days

What will your role look like?

• - Design, develop, and deploy scalable data engineering solutions on Google Cloud Platform, focusing on GCP Composer for orchestration.
• - Architect end-to-end data pipelines using services such as BigQuery, Bigtable, Dataflow, Dataproc, and Datastore to handle large-scale retail datasets.
• - Collaborate with data scientists, analysts, and software engineers to translate business requirements into technical solutions.
• - Implement DevOps best practices for continuous integration, delivery, and monitoring of data pipelines on GCP.
• - Optimize query performance and manage data storage strategies to ensure efficiency and cost-effectiveness.
• - Develop reusable components, frameworks, and templates to accelerate data engineering projects.
• - Provide technical leadership and mentor junior engineers to build a strong, knowledgeable team.
• - Stay current with emerging technologies and industry trends to continually improve solution architectures.

You will need:

• - Demonstrate 8-12 years of experience in data engineering or architecture roles, preferably within the retail industry.
• - Possess strong hands-on expertise in Google Cloud Platform technologies, including Composer, BigQuery, Bigtable, Dataflow, Dataproc, and Datastore.
• - Proficient in Python and SQL for data processing, transformation, and querying tasks.
• - Apply experience with DevOps principles, including CI/CD pipelines and infrastructure-as-code on GCP.
• - Hold a BE/BTech degree in Computer Science, Information Technology, or related fields.
• - Exhibit excellent problem-solving skills and a strong understanding of data modeling, ETL/ELT processes, and cloud architecture.

Good to Have Skills:

• - Have experience with additional programming languages such as Java or Scala.
• - Familiarity with containerization and orchestration tools like Kubernetes or Docker on GCP.
• - Understand data security and governance best practices in cloud environments.
• - Possess certifications related to Google Cloud Platform, such as Google Professional Data Engineer or Google Cloud Architect.
• - Experience working in Agile teams and using collaboration tools such as Jira and Confluence.