GCP Data Engineer

Persistent; Hyderabad; On-site; INR 1,500,000 - 2,300,000; Full time

Benefits offered by this job

Competitive salary and benefitspackage

Growth opportunities with educationand

Cutting-edge technologies

Flexible work hours

Job summary

Persistent in Hyderabad/Bengaluru seeks an experienced GCP Data Engineer to drive the Teradata to BigQuery migration, designing scalable pipelines and secure data movement within the GCP ecosystem.

The role requires 5–10 years in data engineering with strong Python/SQL skills, plus hands-on BigQuery, Cloud Composer, Pub/Sub, and Cloud Functions experience. Banking/FS domain exposure is a plus.

Qualifications

• Bachelor's degree or equivalent in CS/IT/Engineering or related field.
• 5–10 years of data engineering, data warehousing, or cloud platform engineering.
• Minimum 3+ years hands-on GCP experience.
• Experience with BigQuery and data migration projects from Teradata.
• Strong Python programming and SQL optimization.
• Experience with Cloud Composer, Pub/Sub, and Cloud Functions.
• Knowledge of data modeling, ETL/ELT patterns, and governance.
• Experience in banking/FS regulatory data preferred.

Responsibilities

• Design batch and event-driven pipelines on GCP.
• Build enterprise data warehouses and marts with BigQuery.
• Lead Teradata to BigQuery migration including schema conversion and validation.
• Develop workflows with Cloud Composer (Airflow).
• Implement event-driven architectures using Pub/Sub and Cloud Functions.
• Ingest data from multiple sources into Cloud Storage and BigQuery.
• Tune BigQuery with partitioning, clustering, materialized views.
• Develop Python utilities for automation and monitoring.
• Manage GCP resources with IAM and security best practices.
• Ensure security, governance, audit, and regulatory compliance.
• Support production deployments and post-migration stabilization.

Skills

Analytical thinking

Troubleshooting

Communication skills

Stakeholder management

Agile delivery

Education

Bachelor's degree in Computer Science / IT / Engineering / MCA / BCA

Tools

BigQuery

Cloud Composer

Pub/Sub

Cloud Functions

Cloud Storage

IAM

Job description

About Position

We are seeking an experienced GCP Data Engineer to support the migration of a large-scale wholesale banking data mart from on-premises Teradata to Google BigQuery. The ideal candidate will possess strong expertise in Google Cloud Platform, BigQuery, Python, and cloud-native data engineering practices. You will be responsible for designing scalable data pipelines, optimizing data models, enabling secure and compliant data migration, and delivering high-performance analytics solutions within the GCP ecosystem.

• Role: GCP Data Engineer - BigQuery Migration
• Location: Hyderabad, Bengaluru
• Experience: 5 to 10 Years
• Job Type: Full-Time Employment

What You'll Do

• Design and develop batch and event-driven data pipelines on Google Cloud Platform.
• Build scalable enterprise data warehouses and data marts using BigQuery.
• Lead migration activities from Teradata to BigQuery, including schema conversion, SQL transformation, and validation.
• Develop and maintain workflow orchestration solutions using Cloud Composer (Apache Airflow).
• Implement event-driven architectures using Pub/Sub and Cloud Functions.
• Develop data ingestion frameworks to load data from multiple enterprise source systems into Cloud Storage and BigQuery.
• Optimize BigQuery workloads through partitioning, clustering, materialized views, and query tuning.
• Design and implement data models that support analytics, reporting, and regulatory requirements.
• Develop Python-based utilities and frameworks for automation, data transformation, monitoring, and reconciliation.
• Manage and secure GCP resources using IAM roles, service accounts, and security best practices.
• Implement operational monitoring, logging, alerting, and troubleshooting processes.
• Collaborate with analytics, reporting, business, and technology teams to understand data requirements and deliver solutions.
• Ensure compliance with enterprise security, governance, audit, and regulatory standards.
• Support production deployments, post-migration stabilization, and platform optimization initiatives.

Expertise You'll Bring

• Bachelor's Degree in Computer Science, Information Technology, Engineering, MCA, BCA, or related discipline.
• 5 to 10 years of experience in Data Engineering, Data Warehousing, or Cloud Platform Engineering.
• Minimum 3+ years of hands-on experience working with Google Cloud Platform (GCP).
• Proven experience building enterprise data platforms using BigQuery.
• Strong hands-on programming experience in Python.
• Strong SQL expertise with experience in complex query development and optimization.
• Experience building and supporting data pipelines using Cloud Composer (Apache Airflow).
• Experience implementing event-driven architectures using Pub/Sub and Cloud Functions.
• Hands-on experience with Cloud Storage, IAM, Service Accounts, and other core GCP services.
• Experience in data migration projects involving Teradata, on-premises platforms, or legacy data warehouses.
• Strong knowledge of data warehousing, dimensional modeling, ETL/ELT frameworks, and data integration concepts.
• Experience implementing cost governance, chargeback reporting, and cloud operational monitoring solutions.
• Understanding of data lineage, metadata management, and data quality frameworks.
• Experience working with Banking, Financial Services, Risk Management, or Regulatory Reporting environments.
• Strong analytical, troubleshooting, and problem-solving capabilities.
• Experience working within Agile delivery environments.
• Excellent communication and stakeholder management skills.

Benefits

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service…