Senior GCP Data Engineer

abacus-consulting-3; Lahore; On-site; PKR 1,800,000 - 2,600,000; Full time

Job summary

Abacus Consulting in Lahore, Pakistan, seeks a Senior GCP Data Engineer to design, develop and optimize cloud-based data solutions on Google Cloud Platform. You will build scalable data pipelines and manage IaC with Terraform or Packer.

The role requires hands-on work with BigQuery, Dataflow, and Kubernetes, collaborating with Data Engineers and DevOps to ensure secure, reliable operations.

Qualifications

• 5+ years of GCP data engineering and architecture experience.
• Expertise with Terraform or Packer for IaC.
• Hands-on with BigQuery, Dataflow, Pub/Sub, and Kubernetes.
• Proficient in Python, Bash, or Go scripting and CI/CD workflows.
• Knowledge of IAM, security best practices, and cloud networking.

Responsibilities

• Design, deploy, and maintain scalable data infra on GCP using Terraform or Packer.
• Build and optimize ETL/ELT pipelines with BigQuery, Dataflow, and Cloud Composer.
• Automate provisioning and deployments via Terraform, Packer, and CI/CD pipelines.
• Implement cloud security, access management, and compliance requirements.
• Ensure system reliability through monitoring and troubleshooting.
• Collaborate with Data Engineers, DevOps, and cross-functional teams.

Skills

GCP Data Eng

Terraform

Packer

BigQuery

Dataflow

Cloud Composer

Kubernetes (GKE)

Python

Bash

Go

CI/CD

Git

IAM Security

Tools

BigQuery

Dataflow

Cloud Composer

Cloud Storage

Pub/Sub

Kubernetes (GKE)

Terraform

Packer

CI/CD Tools

Git

IAM Policies

Job description

We are looking for a highly skilled SeniorGCP Data Engineer with expertise in Terraform Or Packer to design, develop, and optimize cloud-based data solutions. The ideal candidate will have hands-on experience managing infrastructure as code (IaC), automating deployments, and implementing scalable data solutions on Google Cloud Platform (GCP).

Key Responsibilities

• Design, deploy, and maintain scalable data infrastructure on GCP using Terraform Or Packer.
• Build and optimize ETLELT pipelines using GCP services like BigQuery, Dataflow, and Cloud Composer.
• Automate infrastructure provisioning, deployments, and updates using Terraform, Packer, and CICD tools.
• Implement best practices for cloud security, access management, and compliance requirements.
• Ensure system reliability and efficiency through proactive monitoring and troubleshooting.
• Work closely with Data Engineers, DevOps, and cross-functional teams to optimize cloud and data solutions.

Required Skills & Experience

• 5+ years of experience in GCP cloud architecture, data engineering, and automation.
• Expertise in Terraform Or Packer for infrastructure automation and image management.
• Hands-on experience with BigQuery, Dataflow, Cloud Storage, PubSub, and Kubernetes (GKE).
• Strong scripting skills in Python, Bash, or Go for automation.
• Experience with CICD pipelines, Git, and Terraform modules.
• Knowledge of IAM policies, security best practices, and cloud networking.

Good to Have

• Google Cloud Certifications (Professional Data Engineer or Cloud Architect).
• Experience with additional IaC tools like Ansible or Pulumi.
• Background in Machine Learning pipelines (TensorFlow, Vertex AI) is a plus.