Gcp Data Engineer

Tekskills; Mumbai; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tekskills is seeking a Data Engineer to develop and optimize ETL/ELT pipelines for large datasets with heavy BigQuery usage. You will leverage GCP services for processing and storage, and work across teams to deliver scalable data solutions.

Responsibilities include performance tuning, debugging production issues, ensuring data quality, and collaborating with cross-functional teams. The role requires strong SQL/PLSQL, Python, and CI/CD experience, with an emphasis on independent contribution.

Qualifications

• Proficiency in SQL and PL/SQL for data querying and manipulation.
• Python for data processing and automation.
• Hands-on experience with GCP services: BigQuery, Cloud Storage, Cloud Logging, Dataproc, Pub/Sub.
• Experience with GitHub and CI/CD pipelines for automation and deployment.
• Strong analytical and debugging skills to resolve data and pipeline issues.
• Ability to work independently as an individual contributor.
• Knowledge of data modeling and data warehousing concepts.

Responsibilities

• Develop, implement, and optimize ETL/ELT pipelines for large datasets.
• Work with BigQuery for data processing, querying, and optimization.
• Use Cloud Storage, Cloud Logging, Dataproc, and Pub/Sub for ingestion and storage.
• Tune performance and test the ELT platform for scalability.
• Debug issues, perform root cause analysis, and resolve production incidents.
• Ensure data quality, accuracy, and integrity across pipelines.
• Collaborate with cross-functional teams to define technical requirements.
• Work independently on assigned tasks as an IC.

Skills

SQL

PL/SQL

Python

Data modeling

Database design

Data warehousing concepts

Analytical skills

Debugging skills

Independent contributor

ELT concepts

Tools

BigQuery

Cloud Storage

Cloud Logging

Dataproc

Pub/Sub

GitHub

CI/CD pipelines

Job description

Role & responsibilities

• Develop, implement, and optimize ETL/ELT pipelines for processing large datasets efficiently.
• Work extensively with BigQuery for data processing, querying, and optimization.
• Utilize Cloud Storage, Cloud Logging, Dataproc, and Pub/Sub for data ingestion, storage, and event-driven processing.
• Perform performance tuning and testing of the ELT platform to ensure high efficiency and scalability.
• Debug technical issues, perform root cause analysis, and provide solutions for production incidents.
• Ensure data quality, accuracy, and integrity across data pipelines.
• Collaborate with cross-functional teams to define technical requirements and deliver solutions.
• Work independently on assigned tasks while maintaining high levels of productivity and efficiency.

Skills Required:

• Proficiency in SQL and PL/SQL for querying and manipulating data.
• Experience in Python for data processing and automation.
• Hands-on experience with Google Cloud Platform (GCP), particularly:
  • BigQuery (must-have)
  • Cloud Storage
  • Cloud Logging
  • Dataproc
  • Pub/Sub
• Experience with GitHub and CI/CD pipelines for automation and deployment.
• Performance tuning and performance testing of ELT processes.
• Strong analytical and debugging skills to resolve data and pipeline issues efficiently.
• Self-motivated and able to work independently as an individual contributor.
• Good understanding of data modeling, database design, and data warehousing concepts.

Preferred candidate profile