GCP Data EngineerIntermediate

InfoVision Inc.; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

InfoVision Inc. seeks a skilled GCP Data Engineer in India to join a growing data team across Chennai, Hyderabad, Bangalore or Pune.

You will design and maintain scalable data pipelines on Google Cloud Platform using BigQuery, Dataflow, Pub/Sub, Cloud Storage and Dataproc. You should have strong Python and SQL skills for ETL/ELT, plus practical experience with data lakehouse patterns, governance, and CI/CD tooling (Terraform, Airflow/Cloud Composer).

Qualifications

• 3–7 years of experience in data engineering or related field
• Hands-on experience with GCP services listed above
• Strong Python and SQL skills for ETL/ELT pipelines
• Experience with data lakehouse architectures and governance

Responsibilities

• Design, develop, and optimize end-to-end data pipelines on GCP using BigQuery, Dataflow, Cloud Composer, and Pub/Sub
• Integrate multi-cloud data sources across GCP and AWS environments
• Utilize Claude AI and generative AI tools to automate data catalog creation and SQL generation
• Write and maintain Python scripts for data ingestion, transformation, and orchestration
• Develop complex SQL queries and stored procedures in BigQuery to support BI and reporting
• Collaborate with data architects, analysts, and ML engineers to ensure data quality and freshness
• Monitor and troubleshoot data pipelines using GCP observability tools and implement preventive measures
• Participate in code reviews and mentor junior team members

Skills

Python

SQL

GCP

CI/CD

Git

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Dataproc

Terraform

Airflow

Cloud Composer

Cloud Logging

Cloud Monitoring

Job description

• We are seeking a skilled GCP Data Engineer with 3 to 7 years of experience to join our growing data engineering team in Chennai/Hyderabad/Bangalore/Pune, focused on building and maintaining scalable cloud-based data pipelines and infrastructure on Google Cloud Platform.
• The ideal candidate will have hands-on expertise in GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Dataproc
• Proficiency in leveraging Claude AI and other LLM-based tools for intelligent data transformation, automation of data workflows, and natural language query generation is highly desirable.
• Strong programming skills in Python are required for developing ETL/ELT pipelines, data ingestion scripts, and custom data transformation logic across batch and streaming workloads.
• Solid command of SQL is essential for writing complex queries, optimizing data models in BigQuery, and supporting analytics and reporting teams with structured data access layers.
• Candidates must have experience designing and implementing data lakehouse architectures, dimensional data models, and governance frameworks that ensure data quality, lineage, and security compliance.
• Experience working in agile development environments with CI/CD pipelines, version control using Git, and infrastructure-as-code tools such as Terraform for GCP resource provisioning is expected.
• Familiarity with data orchestration platforms such as Apache Airflow or Cloud Composer and monitoring tools like Cloud Logging and Cloud Monitoring will be considered a strong advantage.

Roles & Responsibilities

• Design, develop, and optimize end-to-end data pipelines on GCP using BigQuery, Dataflow, Cloud Composer, and Pub/Sub to support real-time and batch data processing requirements.
• Integrate multi-cloud data sources across GCP and AWS(nice to have) environments, ensuring seamless data movement, transformation, and availability for downstream analytics and machine learning teams.
• Utilize Claude AI and generative AI tools to automate data catalog creation, generate SQL queries from natural language inputs, and enhance the efficiency of data operations workflows.
• Write and maintain high-quality Python scripts for data ingestion, transformation, and pipeline orchestration, ensuring code is modular, well-documented, and production-ready.
• Develop and maintain complex SQL queries and stored procedures in BigQuery to support business intelligence dashboards, ad hoc analysis, and scheduled reporting pipelines.
• Collaborate with data architects, analysts, and ML engineers to translate business requirements into robust data models and ensure data accuracy, freshness, and consistency across the platform.
• Monitor and troubleshoot data pipeline failures, performance bottlenecks, and data quality issues using GCP-native observability tools and proactively implement preventive measures.
• Participate in code reviews, contribute to data engineering best practices, and mentor junior team members to uphold high engineering standards across the data platform.