Gcp Data Engineer

Tekskills; Hyderabad; On-site; INR 1,500,000 - 3,000,000; Full time

Job summary

Tekskills is seeking a hands-on GCP Data Engineer to implement and manage data ingestion using our Origin Data Product (ODP) framework. You will configure pipelines, handle data loading, and debug issues to ensure reliable ingestion operations.

In collaboration with the core development team, you will optimize ETL workflows, monitor daily runs, and contribute improvements to the in-house framework using GCS, BigQuery, Composer, Data Fusion, and Dataproc.

Qualifications

• 5+ years of experience as a Data Engineer or similar role.
• Hands-on experience with GCS, BigQuery, Composer, Data Fusion, Dataproc.
• Proficiency in Python for scripting, debugging, and automation.
• Experience with Terraform (Infrastructure as Code).
• Working knowledge of Git.
• Strong understanding of data ingestion and ETL workflows.
• Ability to independently debug runtime data issues.
• Strong analytical and problem-solving skills.

Responsibilities

• Configure and execute data ingestion pipelines using a reusable GCP-based framework.
• Work with GCS, BigQuery, Composer, Data Fusion, Dataproc for ETL/ELT operations
• Manage parameters, job configurations, and ingestion metadata
• Debug and resolve data, parameter, and job execution issues
• Monitor daily job runs and ensure SLAs are met
• Escalate framework-related defects to the core development team when required
• Collaborate with cross-functional teams for delivery
• Use Git for version control
• Maintain deployment and infrastructure configurations using Terraform
• Suggest process and framework improvements
• Contribute to minor framework enhancements where applicable

Skills

Data ingestion

ETL

Python scripting

Problem solving

Analytical thinking

Tools

GCS

BigQuery

Composer

Data Fusion

Dataproc

Terraform

Git

Job description

Role Overview:

We are looking for a hands-on GCP Data Engineer to work on implementing and managing data ingestion using our in-house Origin Data Product (ODP) framework. The role involves pipeline configuration, data loading, debugging issues, and ensuring smooth ingestion operations. Candidates who understand the framework well are encouraged to suggest improvements and contribute to enhancements in collaboration with the core development team.

Key Responsibilities:

• Configure and execute data ingestion pipelines using a reusable GCP-based framework
• Work with GCS, BigQuery, Composer, Data Fusion, Dataproc for ETL/ELT operations
• Manage parameters, job configurations, and ingestion metadata
• Debug and resolve data, parameter, and job execution issues
• Monitor daily job runs and ensure SLAs are met
• Escalate framework-related defects to the core development team when required
• Collaborate with cross-functional teams for delivery
• Use Git for version control
• Maintain deployment and infrastructure configurations using Terraform
• (Nice-to-have) Work with TWSd or similar scheduling/monitoring tools
• Suggest process and framework improvements
• Contribute to minor framework enhancements where applicable

Required Skills & Experience:

• 5+ years of experience as a Data Engineer or similar role
• Strong hands-on experience with GCS, BigQuery, Composer, Data Fusion, Dataproc
• Proficiency in Python for scripting, debugging, and automation
• Experience with Terraform (Infrastructure as Code)
• Working knowledge of Git
• Strong understanding of data ingestion and ETL workflows
• Ability to independently debug runtime data issues
• Strong analytical and problem-solving skills