GCP Data Engineer_Chennai_5+ yrs_walkin_19 sep

Tata Consultancy Services; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services in Chennai seeks a GCP Data Engineer responsible for designing, developing, and maintaining data solutions on Google Cloud Platform. You will build robust data pipelines, optimize architectures, and ensure data quality and security across cloud projects.

Collaborate with data scientists and analysts to deliver scalable analytics solutions. Key duties include ETL design with BigQuery, Dataflow, Dataproc and Pub/Sub, data modeling, and cost-effective workflow

Qualifications

• Bachelor’s or Master’s degree in Computer Science, IT, Engineering, or related field.
• Proven experience with GCP data services like BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage.
• Strong SQL and Python; experience with Apache Beam or Spark for data processing.
• Experience in data modeling, ETL development, and data warehousing concepts.
• Familiarity with cloud security best practices and data governance.

Responsibilities

• Design, develop, and deploy data pipelines and ETL processes using GCP services such as BigQuery, Dataflow, Dataproc, and Pub/Sub.
• Implement data modeling, data integration, and data warehousing solutions to support analytics and BI.
• Optimize and monitor data workflows for performance, reliability, and cost-effectiveness.
• Collaborate with cross-functional teams to define data requirements and deliver end-to-end solutions.
• Ensure data security, privacy, and compliance with relevant policies and standards.
• Troubleshoot and resolve issues related to data processing and cloud infrastructure.

Skills

GCP services

SQL

Python

Apache Beam

Spark

ETL development

Data warehousing

Data modeling

Cloud security

Education

Bachelor's/Master's in CS/IT/Engineering

Tools

BigQuery

Dataflow

Dataproc

Pub/Sub

Cloud Storage

Apache Spark

Job description

The GCP Data Engineer is responsible for designing, developing, and maintaining data solutions on the Google Cloud Platform (GCP). This role involves building robust data pipelines, optimizing data architectures, and ensuring data quality and security across various cloud-based projects. The ideal candidate will collaborate with data scientists, analysts, and other stakeholders to deliver scalable and efficient data solutions.

Key Responsibilities

• Design, develop, and deploy data pipelines and ETL processes using GCP services such as BigQuery, Dataflow, Dataproc, and Pub/Sub.
• Implement data modeling, data integration, and data warehousing solutions to support analytics and business intelligence initiatives.
• Optimize and monitor data workflows for performance, reliability, and cost-effectiveness.
• Collaborate with cross-functional teams to define data requirements and deliver end-to-end solutions.
• Ensure data security, privacy, and compliance with relevant policies and standards.
• Troubleshoot and resolve issues related to data processing and cloud infrastructure.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
• Proven experience working with GCP data services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, etc.).
• Strong proficiency in SQL, Python, and data processing frameworks such as Apache Beam or Spark.
• Experience with data modeling, ETL development, and data warehousing concepts.
• Familiarity with cloud security best practices and data governance.
• Excellent problem-solving skills and the ability to work independently or as part of a team.
• GCP Professional Data Engineer certification is a plus.

Preferred Skills

• Knowledge of additional cloud platforms (AWS, Azure) is advantageous.
• Experience with CI/CD pipelines and infrastructure automation tools.
• Strong communication skills and a collaborative mindset.