Gcp Data Engineer

Talent Corner Hr Services; India; Hybrid; INR 1,400,000 - 2,200,000; Full time

Job summary

Talent Corner Hr Services is seeking a Senior Data Engineer to design and maintain scalable data pipelines using Python and SQL. You will optimize complex queries, work with cloud platforms, and ensure data quality for analytics and decision-making.

The role supports ETL/ELT processes in a hybrid setup (3 days WFO). Strong communication and problem-solving skills are essential, with willingness to stay bench-ready for quick deployment.

Qualifications

• Strong hands-on SQL and Python skills with data engineering experience.
• Experience with cloud platforms (GCP/AWS/Azure) is required.
• Knowledge of ETL/ELT, data pipelines, data quality, and validation.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and SQL.
• Develop and optimize complex SQL queries for data extraction and analysis.
• Work with cloud platforms to build cloud-based data solutions.
• Develop, monitor, and maintain ETL/ELT pipelines and ensure data quality.
• Troubleshoot issues and optimize performance and scalability.
• Collaborate with teams to understand requirements and deliver data solutions.
• Maintain technical documentation and follow data security best practices.
• Take ownership of tasks and provide timely updates on progress.
• Nice to have: Databricks/PySpark and Apache Airflow experience.

Skills

SQL

Python

Data engineering

Cloud platforms

GCP experience

Databricks/PySpark

Apache Airflow

Data quality

Problem-solving

Communication

Tools

Databricks

PySpark

Apache Airflow

Job description

Role & Responsibilities

• Design, develop, and maintain scalable data pipelines and data engineering solutions using Python and SQL.
• Develop and optimize complex SQL queries for data extraction, transformation, validation, and analysis.
• Use Python for data processing, automation, transformation, and pipeline development.
• Work with GCP or other cloud platforms to build and support cloud-based data solutions.
• Develop, monitor, troubleshoot, and maintain reliable ETL/ELT data pipelines.
• Perform data validation and ensure data quality, accuracy, consistency, and completeness.
• Troubleshoot data pipeline and production issues and identify appropriate technical solutions.
• Optimize data processing and query performance to improve efficiency and scalability.
• Collaborate with technical teams, stakeholders, and other developers to understand requirements and deliver effective data solutions.
• Maintain proper technical documentation for data pipelines, processes, and solutions.
• Follow best practices for data security, reliability, scalability, and maintainability.
• Take ownership of assigned tasks and provide timely updates on development and production activities.
• Nice to have: Work with Databricks/PySpark and Apache Airflow for data processing and workflow orchestration.

Preferred Candidate Profile

• 6+ years of relevant experience in Data Engineering, Data Development, or a closely related field.
• Strong hands-on experience with SQL and Python is mandatory.
• Good understanding of data engineering concepts, ETL/ELT processes, data pipelines, and data transformation.
• Experience with any major cloud platform such as GCP, AWS, or Azure; GCP experience is preferred.
• Candidates with hands-on experience in GCP services, particularly BigQuery, will be strongly preferred.
• Knowledge of Databricks, PySpark, or Apache Airflow will be an added advantage.
• Strong analytical and problem-solving skills with good attention to detail.
• Good understanding of data quality, validation, troubleshooting, and performance optimization.
• Excellent communication skills and the ability to confidently explain technical concepts and previous project experience.
• Should be comfortable working in a hybrid model with 3 days of Work From Office per week.

Candidate must be currently on bench and available for quick deployment.

Only bench resources should be considered; do not submit market/notice-period candidates.

UAN and LinkedIn profile are mandatory for the client screening process.

Candidates should be willing to work from Bangalore, Hyderabad, Chennai, Gurgaon, or Pune.