Gcp Data Engineer-Bangalore-Immediate joiner

Tata Elxsi, Inc.; Bengaluru; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Tata Elxsi, Inc. is seeking a Data Engineer to design, build, and optimize data pipelines in a Google Cloud Platform environment. You will ensure data reliability, scalability, and quality to support analytics and operations.

You will work with BigQuery, Dataform, Terraform, and Git, collaborating with data analysts, scientists, and engineers to deliver robust data solutions and maintain best practices in data governance and observability.

Qualifications

• 3–5 years of professional experience as a Data Engineer or similar data-focused role.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

Responsibilities

• Design, build, and maintain robust and scalable data pipelines and infrastructure in a GCP environment.
• Use GCP services such as BigQuery, Cloud Storage, Dataform, Cloud Run Functions and Workflows.
• Implement and manage infrastructure as code using Terraform.
• Optimize data warehouses and pipelines via partitioning, clustering, and best practices.
• Monitor and maintain health of data infrastructure for high reliability.
• Troubleshoot data-related issues ensuring data quality and consistency.
• Collaborate with data analysts, data scientists, and engineers to meet data requirements.
• Maintain version control with Git and manage API integrations for ingestion/delivery.
• Document technical solutions and data workflows.

Skills

GCP

BigQuery

Data pipelines

Data quality

Analytical skills

Communication

Collaboration

Cloud architecture

APIs

Tools

Terraform

Git

Dataform

Cloud Run Functions

Workflows

CI/CD pipelines

Job description

Key Responsibilities and Accountabilities:

We are seeking a skilled Data Engineer with 35 years of experience to join our team. He/she will be responsible for designing, building, and optimizing data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. His/her work will ensure data reliability, scalability, and quality, supporting the organizations analytics and operational needs.

• Design, develop, and maintain robust and scalable data pipelines using GCP services, including BigQuery, Cloud Storage, Dataform, Cloud Run Functions and Workflows.
• Implement and manage infrastructure as code using Terraform for automated provisioning and management of data infrastructure.
• Optimize performance of data warehouses and pipelines through partitioning, clustering, and other best practices to ensure efficient data processing and query performance.
• Monitor and maintain the health of the data infrastructure, proactively identifying and resolving issues to ensure high data reliability and uptime.
• Troubleshoot and resolve data-related issues, ensuring data quality and consistency across systems.
• Collaborate with data analysts, data scientists, and other engineers to understand data requirements and deliver high quality data solutions.
• Ensure data reliability, scalability, and quality through robust validation, testing, and monitoring processes.
• Manage version control and code collaboration using Git.
• Develop and maintain API integrations for data ingestion and delivery.
• Document technical solutions and maintain up-to-date records of data workflows and infrastructure.

3. Key qualifications

• 3–5 years of professional experience as a Data Engineer or in a similar data-focused role.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

3. Preferred skills

• Experience with CI/CD pipelines for data engineering workflows.
• Familiarity with data governance and obser