Gcp Data Engineer

Alike Thoughts; Pune District; On-site; INR 3,000,000 - 5,000,000; Full time

Job summary

Alike Thoughts is seeking an experienced Google Cloud Data Engineer in Pune, India to design, develop and maintain scalable cloud-based data platforms and ETL/ELT pipelines using Google Cloud Platform technologies.

You will design end-to-end data pipelines, optimize BigQuery performance, implement CI/CD, and collaborate with architects, analysts and business stakeholders to ensure data quality and security.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering or related field.
• 5 years of data engineering experience with 3 years on Google Cloud Platform.
• Strong Python and SQL skills.
• Hands-on experience with BigQuery, Cloud Storage, Dataflow, Cloud Composer, Dataform, Cloud Functions, Pub/Sub, Cloud Scheduler.
• Experience with Git, Jira, and Agile/Scrum.

Responsibilities

• Design and implement scalable data pipelines using Python and GCP services (BigQuery, Cloud Storage, Dataflow, Dataflow, Cloud Composer).
• Develop batch and streaming data ingestion frameworks.
• Build dimensional data models and optimize BigQuery performance and cost.
• Implement CI/CD, source control, testing, monitoring and data quality.
• Collaborate with architects, analysts and business stakeholders.
• Troubleshoot production issues and perform performance tuning.
• Implement security, IAM governance and metadata management.

Skills

BigQuery

Python

SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Git

Airflow

Dataflow

Cloud Functions

Dataform

Pub/Sub

Job description

Role & responsibilities

We are seeking an experienced Google Cloud Data Engineer to design develop and maintain scalable cloudbased data platforms and ETLELT pipelines using Google Cloud Platform technologies

Key Responsibilities

• Design and implement scalable data pipelines using Python BigQuery Cloud Storage Dataflow Cloud Functions Cloud Composer Airflow and Dataform
• Develop batch and streaming data ingestion frameworks
• Build dimensional data models and optimize BigQuery performance and cost
• Implement CICD source control GitBitbucket testing monitoring and data quality
• Collaborate with architects analysts and business stakeholders
• Troubleshoot production issues and perform performance tuning
• Implement security IAM governance and metadata management

Required Qualifications

• Bachelors degree in Computer Science Information Systems Engineering or related field
• 5 years of data engineering experience with 3 years on Google Cloud Platform
• Strong Python and SQL skills
• Handson experience with BigQuery Cloud Storage Dataflow Cloud Composer Dataform Cloud Functions Cloud PubSub Cloud Scheduler
• Experience with Git Jira AgileScrum
• Knowledge of data warehousing dimensional modeling CICD and cloud security

Skills

Mandatory Skills :GCP BigQuery, Python

Preferred candidate profile