Gcp Data Engineer

Tekskills Inc.; Hyderabad; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Tekskills Inc. is seeking an experienced GCP Data Engineer with strong PySpark expertise to design, build, and optimize scalable data platforms and pipelines on Google Cloud Platform.

You will design and implement scalable data pipelines on GCP, build batch and real-time ingestion frameworks with PySpark and Spark, and develop ETL/ELT workflows using BigQuery, Dataproc and Cloud Composer.

Qualifications

• Hands-on experience with GCP data services and architectures.
• Strong PySpark expertise for designing scalable data pipelines.
• Experience with real-time and batch data processing workflows.

Responsibilities

• Design and implement scalable data pipelines on Google Cloud Platform (GCP).
• Build and manage batch and real-time data ingestion frameworks using PySpark and Spark.
• Develop and optimize ETL/ELT workflows using GCP services (BigQuery, Dataproc, Cloud Composer).
• Work with GCP storage and processing services including BigQuery, Dataproc, and Cloud Composer.

Skills

PySpark

Real-time processing

Batch processing

Tools

BigQuery

Dataproc

Cloud Composer

Spark

Job description

• We are looking for an experienced GCP Data Engineer with strong PySpark expertise to design, build, and optimize scalable data platforms and pipelines on Google Cloud Platform (GCP).
• The ideal candidate should have hands-on experience in GCP data services, real-time and batch processing, orchestration frameworks, and enterprise-grade data engineering solutions.

Responsibilities

• Design and implement scalable data pipelines on Google Cloud Platform (GCP).
• Build and manage batch and real-time data ingestion frameworks using PySpark and Spark.
• Develop and optimize ETL/ELT workflows using GCP services.
• Work with GCP storage and processing services including BigQuery, Dataproc, and Cloud Composer.