Data Architect- GCP

Tredence; India; Hybrid; INR 700,000 - 1,300,000; Full time

Job summary

Tredence is seeking a GCP Architect to design and implement robust data architectures across a spectrum of Indian locations including Bangalore, Hyderabad, Chennai, Pune, Kolkata and Gurgaon. You will lead data engineering efforts on GCP, build scalable ETL pipelines, and guide teams in best practices for big data processing.

The role demands strong expertise in data warehousing, distributed computing, and GCP tooling, along with mentoring junior staff and collaborating with cross-functional

Qualifications

• 8+ years of experience in data engineering or analytics.
• Hands-on expertise with GCP data services and cloud-based ETL pipelines.
• Strong understanding of data warehousing and data modeling.

Responsibilities

• Select and integrate Big Data tools and frameworks to meet requirements.
• Develop and maintain data pipelines with ETL processes and monitor performance.
• Translate complex requirements into detailed designs and architectures.
• Investigate alternative data storing/processing solutions for efficiency.
• Mentor junior staff through training and code reviews.

Skills

Data warehousing

Data modeling

Distributed computing

GCP data engineering

Stream processing

Big data querying tools

Spark

Linux

ETL techniques

Kafka

Lambda Architecture

Education

Bachelor's degree in Computer Science or related field

Tools

Airflow

Cloud Composer

Data Fusion

Data Flow

Data Proc

BigQuery

Pig

Hive

Impala

Storm

Spark-Streaming

Hadoop

MapReduce

Kafka

RabbitMQ

Flume

Apache NiFi

DBT

Job description

Role: GCP Architect

Exp Level: 8+ Years

Work Location : Bangalore, Hyderabad, Chennai, Pune, Kolkata, Gurgaon

Primary Roles and Responsibilities

• Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
• Develop and maintain data pipelines implementing ETL process, monitoring performance and advising any necessary infrastructure changes
• Translate complex technical and functional requirements into detailed designs
• Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented
• Serve as a mentor to junior staff by conducting technical training sessions and reviewing project outputs

Skills and Qualifications

• Strong understanding of data warehousing and data modeling techniques.
• Proficient understanding of distributed computing principles - Hadoop v2, MapReduce, HDFS
• Strong data engineering skills on GCP cloud platforms Airflow, Cloud Composer, Data Fusion, Data Flow, Data Proc, Big Query
• Experience with building stream-processing systems, using solutions such as Storm or Spark- Streaming
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with Spark, SQL, and Linux.
• Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT.
• Experience with various messaging systems, such as Kafka or RabbitMQ.
• Good understanding of Lambda Architecture, along with its advantages and drawbacks