Gcp Data Engineer

Tekskills; Bulandshahr; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tekskills is seeking a hands-on GCP Data Engineer to implement and manage data ingestion using our Origin Data Product (ODP) framework. You will configure pipelines, load data, debug issues, and ensure smooth ingestion operations in collaboration with the core development team.

The role requires 5+ years of data engineering experience with GCS, BigQuery, Composer, Data Fusion, and Dataproc, plus Python scripting and Terraform knowledge.

Qualifications

• 5+ years of experience as a Data Engineer or similar role.
• Strong hands-on experience with GCS, BigQuery, Composer, Data Fusion and Dataproc.
• Proficiency in Python for scripting, debugging and automation.
• Experience with Terraform (Infrastructure as Code).
• Working knowledge of Git.
• Strong understanding of data ingestion and ETL workflows.
• Ability to independently debug runtime data issues.
• Strong analytical and problem-solving skills.

Responsibilities

• Configure and execute data ingestion pipelines using a reusable GCP-based framework.
• Work with GCS, BigQuery, Composer, Data Fusion, Dataproc for ETL/ELT operations.
• Manage parameters, job configurations, and ingestion metadata.
• Debug and resolve data, parameter, and job execution issues.
• Monitor daily job runs and ensure SLAs are met.
• Escalate framework-related defects to the core development team when required.
• Collaborate with cross-functional teams for delivery.
• Use Git for version control.
• Maintain deployment and infrastructure configurations using Terraform.
• (Nice-to-have) Work with TWSd or similar scheduling/monitoring tools.
• Suggest process and framework improvements.
• Contribute to minor framework enhancements where applicable.

Skills

Python scripting

Analytical thinking

Problem solving

Debugging

Independent work

Tools

GCS

BigQuery

Composer

Data Fusion

Dataproc

Terraform

Git

Job description

Role Overview:

We are looking for a hands-on GCP Data Engineer to work on implementing and managing data ingestion using our in-house Origin Data Product (ODP) framework. The role involves pipeline configuration, data loading, debugging issues, and ensuring smooth ingestion operations. Candidates who understand the framework well are encouraged to suggest improvements and contribute to enhancements in collaboration with the core development team.

Key Responsibilities:

• Configure and execute data ingestion pipelines using a reusable GCP-based framework
• Work with GCS, BigQuery, Composer, Data Fusion, Dataproc for ETL/ELT operations
• Manage parameters, job configurations, and ingestion metadata
• Debug and resolve data, parameter, and job execution issues
• Monitor daily job runs and ensure SLAs are met
• Escalate framework-related defects to the core development team when required
• Collaborate with cross-functional teams for delivery
• Use Git for version control
• Maintain deployment and infrastructure configurations using Terraform
• (Nice-to-have) Work with TWSd or similar scheduling/monitoring tools
• Suggest process and framework improvements
• Contribute to minor framework enhancements where applicable

Required Skills & Experience:

• 5+ years of experience as a Data Engineer or similar role
• Strong hands-on experience with GCS, BigQuery, Composer, Data Fusion, Dataproc
• Proficiency in Python for scripting, debugging, and automation
• Experience with Terraform (Infrastructure as Code)
• Working knowledge of Git
• Strong understanding of data ingestion and ETL workflows
• Ability to independently debug runtime data issues
• Strong analytical and problem-solving skills