GCP Data Engineer

Weekday AI (YC W21); India; On-site; INR 600,000 - 2,600,000; Full time

Job summary

Weekday AI (YC W21) in India is seeking an experienced GCP Data Engineer to design, build, and scale data platforms and pipelines for analytics and BI. The role requires 6+ years of hands-on experience with Google Cloud, BigQuery, Dataflow/Beam, Cloud Composer, Airflow, Python, and SQL.

You will collaborate with data architects, analysts, and engineers to deliver reliable, scalable cloud-native data solutions, emphasizing data quality, governance, and cost efficiency.

Qualifications

• 6+ years of professional experience in data engineering or related field.
• Hands-on experience with GCP data services and BigQuery for large-scale workloads.
• Experience with batch and streaming data processing using Dataflow/Beam.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Google Cloud Platform.
• Build batch and streaming data pipelines using Dataflow and Apache Beam.
• Develop and optimize analytical solutions using Google BigQuery.
• Design ETL/ELT processes for structured and semi-structured data.
• Develop reusable data processing frameworks using Python.
• Write complex and optimized SQL queries for transformation and validation.
• Build and manage workflow orchestration using Cloud Composer and Apache Airflow.
• Design DAGs, scheduling mechanisms, dependencies, retries, alerts, and error-handling workflows.
• Develop scalable data warehouse and data modelling solutions to support reporting and analytics.
• Design fact tables, dimension tables, data marts, schemas, and analytical data structures.
• Integrate data from databases, APIs, files, applications, and other sources.
• Implement data validation, quality checks, monitoring, governance, and security practices.
• Collaborate with Data Architects, Data Scientists, BI Developers, Software Engineers, and business stakeholders.
• Support deployment and automation using Git, CI/CD, and modern cloud development practices.
• Maintain technical documentation covering pipelines, data models, workflows, dependencies, and operational procedures.
• Contribute to migration and modernization of legacy data platforms into GCP-based architectures.

Skills

Google Cloud

BigQuery

Dataflow

Apache Beam

Cloud Composer

Airflow

Python

SQL

Data warehousing

Data modelling

Education

Bachelors or Masters in CS/IT/Engineering/Data Science

Tools

Git

CI/CD

Terraform

Dataproc

Cloud Storage

Job description

Job Description:

This role is for one of the Weekdays clients

Salary range: Rs 600000 - Rs 2600000 (ie INR 6-26 LPA)

Experience: 6+ yrs

Location: India

Job Type: Full-time

We are looking for an experiencedGCP Data Engineerwith strong expertise inGoogle Cloud, BigQuery, Dataflow, Apache Beam, Cloud Composer, Airflow, Python, SQL, data warehousing, and data modelling.

The role involves designing, developing, and maintaining scalable data platforms and pipelines that support analytics, reporting, business intelligence, and data-driven applications. The ideal candidate will have strong hands-on experience working with large datasets, cloud-native data engineering services, batch and streaming pipelines, and modern data warehouse architectures.

You will work closely with data architects, analysts, software engineers, and business stakeholders to transform complex data requirements into reliable, scalable, and high-performance data solutions.

Key Responsibilities

• Design, develop, and maintain scalabledata pipelines on Google Cloud Platform (GCP).
• Build batch and streaming data pipelines usingDataflow and Apache Beam.
• Develop and optimize analytical solutions usingGoogle BigQuery.
• Design and implement ETL/ELT processes for structured and semi-structured data.
• Develop reusable data processing frameworks usingPython.
• Write complex and optimizedSQL queriesfor data transformation, analysis, and validation.
• Build and manage workflow orchestration usingCloud Composer and Apache Airflow.
• Design DAGs, scheduling mechanisms, dependencies, retries, alerts, and error-handling workflows.
• Develop scalabledata warehouse and data modellingsolutions to support reporting and analytics.
• Design fact tables, dimension tables, data marts, schemas, and analytical data structures.
• Integrate data from databases, APIs, files, applications, and other enterprise data sources.
• Implement data validation, quality checks, reconciliation, and monitoring across pipelines.
• Optimize BigQuery queries, Dataflow jobs, data models, and pipeline performance.
• Identify opportunities to improve scalability, reliability, maintainability, and cloud cost efficiency.
• Troubleshoot pipeline failures, data quality issues, performance bottlenecks, and production incidents.
• Implement appropriate data security, access controls, governance, and privacy practices.
• Collaborate with Data Architects, Data Scientists, BI Developers, Software Engineers, and business stakeholders.
• Support deployment and automation using Git, CI/CD, and modern cloud development practices.
• Maintain technical documentation covering pipelines, data models, workflows, dependencies, and operational procedures.
• Contribute to migration and modernization of legacy data platforms intoGCP-based cloud data architectures.

What Makes You a Great Fit

• 6+ years of professional experiencein data engineering, data platform development, or a related field.
• Strong hands-on expertise inGCP / Google Clouddata engineering services.
• Proven experience withBigQueryfor large-scale analytical workloads.
• Strong experience withDataflow and Apache Beamfor batch and streaming data processing.
• Hands-on experience withCloud Composer and Apache Airflowfor workflow orchestration.
• Strong programming skills inPythonand advancedSQL.
• Strong understanding ofdata warehousing, data modelling, ETL/ELT, and analytical data architectures.
• Experience designing dimensional models, fact and dimension tables, data marts, and scalable schemas.
• Good understanding of batch and real-time data processing architectures.
• Experience working with large datasets and optimizing data processing and query performance.
• Strong knowledge of data quality, validation, monitoring, governance, and security practices.
• Experience with Git, CI/CD, automation, and production deployment workflows.
• Familiarity with other GCP services such asCloud Storage, Pub/Sub, Dataproc, Cloud Functions, or Cloud Runis an advantage.
• Experience with Terraform or Infrastructure-as-Code is beneficial.
• Strong troubleshooting, analytical, and problem-solving abilities.
• Excellent communication and collaboration skills across technical and business teams.
• Ability to independently own complex data engineering initiatives from design through production.
• Bachelors or Masters degree inComputer Science, Information Technology, Engineering, Data Science, or a related disciplineis preferred.