GCP Data Engineer Lead

Heptarc Talent Acquisition; Bengaluru; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Heptarc Talent Acquisition is seeking a GCP Data Engineer Lead based in Bengaluru, India, with 5+ years of experience in data engineering focused on cloud-based solutions. The ideal candidate will have extensive experience with Google Cloud Platform and a proven track record in designing and building scalable data pipelines. Strong skills in SQL, Python, and data modeling are essential. This contract role involves implementing ETL processes and working in a fast-paced environment.

Qualifications

• 5+ years of experience in data engineering, 7 to 15 years preferred.
• Proficiency in SQL and experience with database design.
• Strong programming skills in Python or Java.

Responsibilities

• Design and build scalable data pipelines and architectures.
• Implement ETL processes to ingest data into GCP warehouses.
• Use GCP services like Dataflow and Pub/Sub for data pipelines.

Skills

SQL

Python

Java

Data modeling

Data warehousing

Big data processing frameworks

Data visualization tools

Machine learning workflows

Job description

Job Description

5+ years of experience in data engineering with a focus on cloud-based solutions. Desired experience is 7 to 15 years.

Location: Pune • Job Type: Contract • Category: GCP Data Engineer Lead

Responsibilities

• Extensive experience with Google Cloud Platform (GCP) and its data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.
• Proven track record of designing and building scalable data pipelines and architectures.
• Experience with ETL tools and processes.
• Design, develop, and maintain robust and scalable data pipelines using GCP services such as Dataflow, Pub/Sub, Cloud Functions, and Cloud Composer.
• Implement ETL (Extract, Transform, Load) processes to ingest data from various sources into GCP data warehouses like BigQuery.

Technical Skills

• Proficiency in SQL and experience with database design and optimization.
• Strong programming skills in Python, Java, or other relevant languages.
• Experience with data modeling, data warehousing, and big data processing frameworks.
• Familiarity with data visualization tools (e.g., Looker, Data Studio) is a plus.
• Knowledge of machine learning workflows and tools is an advantage.

Soft Skills

• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work in a fast-paced environment and manage multiple tasks concurrently.
• Leadership skills and experience mentoring junior engineers.