Lead Data Engineer - GCP

Mployee.me

Hyderabad

Sur place

INR 4 000 000 - 7 000 000

Plein temps

Il y a 10 jours

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

Blend is seeking a Senior GCP Data Engineer in Hyderabad to design, build, and maintain scalable data pipelines on Google Cloud Platform.

You will leverage Python, SQL, and GCP data services to deliver robust data processing, data modeling, and governance across large datasets, collaborating with cross-functional teams in an agile environment.

Qualifications

  • 6+ years of experience in data engineering and scalable data solutions.
  • Strong hands-on experience with Google Cloud Platform (GCP).
  • Proficiency in Python programming.
  • Strong SQL skills including complex queries and optimization.
  • Experience building ETL/ELT data pipelines on cloud platforms.
  • Hands-on with GCP services: BigQuery, Cloud Storage, Cloud Composer/Airflow, Dataflow, Pub/Sub, Dataproc.
  • Experience with Apache Spark / PySpark is preferred.

Responsabilités

  • Design and develop scalable data pipelines using GCP services.
  • Develop data processing and transformations with Python and SQL.
  • Build and optimize ETL/ELT pipelines for large datasets.
  • Collaborate with business and tech teams to define data requirements.
  • Perform data modeling, validation and performance optimization.
  • Monitor, troubleshoot, and ensure data quality, security, and governance.

Connaissances

Data engineering experience
GCP
Python
SQL
ETL/ELT pipelines
Git & CI/CD
Apache Spark / PySpark
Data warehousing & modeling

Outils

BigQuery
Cloud Storage
Cloud Composer / Airflow
Dataflow
Pub/Sub
Dataproc
Apache Spark / PySpark

Description du poste

Job Description

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

We are looking for a Senior GCP Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP). The ideal candidate should have strong hands-on expertise in Python, SQL, data pipelines, and GCP data services.

Key Responsibilities
  • Design and develop scalable and reliable data pipelines using GCP services.
  • Develop data processing and transformation solutions using Python and SQL.
  • Build and optimize ETL/ELT pipelines for large-volume datasets.
  • Work with business and technical teams to understand data requirements and deliver robust solutions.
  • Perform data modeling, data validation, and performance optimization.
  • Monitor and troubleshoot data pipelines and resolve production issues.
  • Implement data quality, security, and governance best practices.
  • Participate in code reviews and contribute to technical design and architecture discussions.
Qualifications
  • 6+ years of experience in Data Engineering.
  • Strong hands-on experience with Google Cloud Platform (GCP).
  • Strong programming experience in Python.
  • Strong expertise in SQL, including complex queries, joins, CTEs, window functions, and query optimization.
  • Experience developing ETL/ELT data pipelines.
  • Hands-on experience with one or more GCP services such as:
    • BigQuery
    • Cloud Storage (GCS)
    • Cloud Composer / Airflow
    • Dataflow
    • Pub/Sub
    • Dataproc
  • Experience with Apache Spark / PySpark is preferred.
  • Good understanding of data warehousing, data modeling, and distributed data processing.
  • Experience with Git and CI/CD practices.
Nice to Have
  • Experience with Terraform or Infrastructure as Code.
  • Exposure to GCP Dataform.
  • Experience with real-time/streaming data pipelines.
  • Knowledge of cloud security and IAM.
  • Experience working in Agile environments.
Additional Information

All your information will be kept confidential according to EEO guidelines.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Lead Data Engineer - GCP
Lead Data Engineer - GCP

Blend360 • Hyderabad

Sur place
INR 4 000 000 - 6 500 000
Lead Engineer – GCP Data Engineer
Lead Engineer – GCP Data Engineer

Prodapt • Chennai

Sur place
INR 1 200 000 - 2 400 000
DT - Lead Engineer
DT - Lead Engineer

Prodapt Solutions • Chennai

Sur place
INR 1 200 000 - 2 400 000
Senior Data Engineer
Senior Data Engineer

Blend360 • Hyderabad

Sur place
INR 350 000 - 550 000
GCP Data Engineer
GCP Data Engineer

Questhiring • Gurugram District

Sur place
INR 1 400 000 - 2 200 000
Data Engineer - GCP
Data Engineer - GCP

People Consultancy Services (PCS) • Inde

Sur place
INR 1 500 000 - 2 500 000
Senior Snowflake Engineer
Senior Snowflake Engineer

Blend360 • Hyderabad

Sur place
INR 1 500 000 - 2 700 000
DT - Senior Software Engineer
DT - Senior Software Engineer

Prodapt Solutions • Chennai

Sur place
INR 1 200 000 - 1 800 000
Senior Data Engineer (10–12 Years' Experience Required)
Senior Data Engineer (10–12 Years' Experience Required)

General Mills • Mumbai

Sur place
INR 4 500 000 - 7 000 000
GCP Data Engineer
GCP Data Engineer

Tata Consultancy Services Limited • Zone 1 Tiruvottiyur

Sur place
INR 2 500 000 - 3 800 000