Data Engineer

Quess IT Solutions; Pune District; Hybrid; INR 900,000 - 1,200,000; Full time

Job summary

Quess IT Solutions in Pune seeks a GCP Data Engineer with 2-3 years of experience to develop scalable data pipelines and cloud-based data solutions using GCP services. The role emphasizes hands-on work with Python, SQL/PLSQL, BigQuery, Data Fusion, and Cloud Storage, across ETL/ELT processes.

You will collaborate with cross-functional teams, implement reliable data ingestion and transformation workflows, and ensure best practices for security and performance in a large data environment.

Qualifications

• 2-3 years of experience in Data Engineering / Cloud Data Engineering.
• Hands-on experience with Google Cloud Platform (GCP).
• Strong programming experience in Python.
• Hands-on experience with BigQuery.
• Experience with GCP Data Fusion and data pipeline development.
• Strong knowledge of SQL and PL/SQL.
• Experience with Google Cloud Storage (GCS).
• Experience with one or more of: Cloud Functions, Cloud Run, App Engine.
• Understanding of ETL/ELT and data integration concepts.
• Good understanding of relational and NoSQL databases.
• Experience working with large datasets.

Responsibilities

• Develop and maintain data engineering solutions on GCP.
• Write, optimize, and debug SQL/PLSQL queries for data processing and analytics.
• Develop data pipelines using BigQuery, Data Fusion, and Cloud Storage.
• Use Python for data processing, automation, and integration.
• Work with Cloud Functions, Cloud Run, and/or App Engine.
• Develop data ingestion, transformation, and integration workflows.
• Process and transform structured and semi-structured data.
• Troubleshoot data pipelines and cloud-based applications.
• Monitor pipeline performance and assist with performance optimization.
• Follow best practices around scalability, security, reliability, and maintainability.
• Write unit tests and technical documentation.
• Participate in code reviews and technical discussions.
• Work with SQL and NoSQL databases as required.
• Collaborate with data engineers and cross-functional teams.

Skills

GCP

Python

BigQuery

Data Fusion

SQL/PLSQL

Cloud Storage

ETL/ELT

NoSQL databases

Cloud Functions

Cloud Run

App Engine

CI/CD/DevOps basics

Education

Bachelors in CS/IT or equivalent

Tools

BigQuery

Data Fusion

Cloud Storage

Cloud Functions

Cloud Run

App Engine

Job description

Role Overview -

We are looking for a GCP Data Engineer with 2-3 years of experience in data engineering and cloud-based development. The ideal candidate should have hands‑on experience with Python, SQL/PLSQL, Google Cloud Platform (GCP), BigQuery, Data Fusion, and Cloud Storage.

The role involves developing and maintaining scalable data pipelines and cloud-based data solutions while working with large datasets and modern GCP services.

Key Responsibilities -

• Develop and maintain data engineering solutions on GCP.
• Write, optimize, and debug SQL/PLSQL queries for data processing and analytics.
• Develop data pipelines using BigQuery, Data Fusion, and Cloud Storage.
• Use Python for data processing, automation, and integration.
• Work with Cloud Functions, Cloud Run, and/or App Engine.
• Develop data ingestion, transformation, and integration workflows.
• Process and transform structured and semi-structured data.
• Troubleshoot data pipelines and cloud-based applications.
• Monitor pipeline performance and assist with performance optimization.
• Follow best practices around scalability, security, reliability, and maintainability.
• Write unit tests and technical documentation.
• Participate in code reviews and technical discussions.
• Work with SQL and NoSQL databases as required.
• Collaborate with data engineers and cross-functional teams.

Required Skills -

• 2-3 years of experience in Data Engineering / Cloud Data Engineering.
• Hands‑on experience with Google Cloud Platform (GCP).
• Strong programming experience in Python.
• Hands‑on experience with BigQuery.
• Experience with GCP Data Fusion and data pipeline development.
• Strong knowledge of SQL and PL/SQL.
• Experience with Google Cloud Storage (GCS).
• Experience with one or more of:
• Google Cloud Functions
• Cloud Run
• App Engine
• Understanding of ETL/ELT and data integration concepts.
• Good understanding of relational and NoSQL databases.
• Experience working with large datasets.
• Strong troubleshooting and problem‑solving skills.

Good to Have -

• Knowledge of GCP IAM, security, monitoring, and logging.
• Exposure to CI/CD and DevOps practices.
• Understanding of BigQuery performance tuning and cost optimization.
• Basic knowledge of data warehouse architecture and dimensional modelling.
• Knowledge of Agile/Scrum methodologies.