GCP Data Engineer

Live Connections Placements Pvt. Ltd.; Bengaluru; Sur place; INR 1 200 000 - 2 200 000; Plein temps

Résumé du poste

Live Connections Placements Pvt. Ltd. is seeking an experienced GCP Data Engineer to join our MNC client across Hyderabad, Bangalore and Gurgaon.

The role demands 5-22 years of hands-on experience with GCP data services, building large-scale pipelines, and implementing CI/CD practices. You will design, develop and optimize batch and streaming data solutions on Google Cloud, working across distributed systems and data warehouses.

Qualifications

• 5+ years of hands-on experience with GCP data services.
• Experience designing production-grade data pipelines.
• Strong understanding of distributed systems and cloud data architecture.
• Proficient programming and debugging skills in multiple languages.
• Experience with large-scale datasets and production environments.

Responsabilités

• Design, build and support distributed systems and large-scale data processing solutions in production.
• Develop and optimize batch and real-time streaming pipelines on Google Cloud.
• Implement data ingestion, transformation and processing workflows using BigQuery, Dataflow and Pub/Sub.
• Orchestrate data workflows using Cloud Composer / Apache Airflow.
• Build reliable, scalable and high-performance data solutions.
• Implement automation and CI/CD best practices using Jenkins, GitHub and Spinnaker.
• Write clean, maintainable and efficient code using Python, SQL or other relevant programming languages.
• Support enterprise analytics requirements using data warehouses, data lakes and operational data stores.

Connaissances

Distributed systems

Batch and streaming data pipeline

Python

SQL

Java

Scala

Go

Outils

BigQuery

Dataflow

Cloud Storage

Pub/Sub

Cloud Composer / Apache Airflow

Jenkins

GitHub

Spinnaker

Data warehouses

Data lakes

Operational data stores

Description du poste

We are looking for experienced GCP Data Engineers for our MNC client across Hyderabad, Bangalore and Gurgaon.

Experience: 5-22 Years

Job Locations: Hyderabad | Bangalore | Gurgaon

Interview Mode: Face-to-Face (F2F)

Notice Period: Immediate to 30 Days

Key Skills Required

• BigQuery, Dataflow, Cloud Storage and Pub/Sub
• Cloud Composer / Apache Airflow
• Batch and streaming data pipeline development
• Programming and scripting using Python, SQL, Java, Scala or Go
• CI/CD and automation tools: Jenkins, GitHub and Spinnaker
• Distributed systems and large-scale data processing
• Data warehouses, data lakes and operational data stores

Job Responsibilities

• Design, build and support distributed systems and large-scale data processing solutions in production.
• Develop and optimize batch and real-time streaming pipelines on Google Cloud.
• Implement data ingestion, transformation and processing workflows using BigQuery, Dataflow and Pub/Sub.
• Orchestrate data workflows using Cloud Composer / Apache Airflow.
• Build reliable, scalable and high-performance data solutions.
• Implement automation and CI/CD best practices using Jenkins, GitHub and Spinnaker.
• Write clean, maintainable and efficient code using Python, SQL or other relevant programming languages.
• Support enterprise analytics requirements using data warehouses, data lakes and operational data stores.

Candidate Requirements

• Strong hands-on experience with GCP data engineering services.
• Proven experience designing and supporting production-grade data pipelines.
• Good understanding of distributed systems, data processing and cloud-based data architecture.
• Strong programming, debugging and problem-solving skills.
• Experience working with large-scale datasets and production environments.