Gcp Data Engineer

Tata Elxsi, Inc.; Hyderabad, Chennai, Bengaluru; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

Tata Elxsi, Inc. in Hyderabad is seeking a Data Engineer with 3–5 years of experience to design, build, and optimize data pipelines in a GCP environment. You will ensure data reliability and quality while collaborating with data analysts and data scientists to deliver robust solutions.

The role emphasizes infrastructure as code (Terraform), CI/CD for data workflows, and strong problem-solving and communication skills in a collaborative team setting.

Qualifications

• 3-5 years of professional experience as a Data Engineer or in a similar data-focused role.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

Responsibilities

• Design, build, and maintain robust and scalable data pipelines using GCP services (BigQuery, Cloud Storage, Dataform, Cloud Run Functions, Workflows).
• Implement and manage infrastructure as code using Terraform for automated provisioning and management of data infrastructure.
• Optimize performance of data warehouses and pipelines through partitioning, clustering, and best practices to ensure efficient data processing and query performance.
• Monitor and maintain the health of the data infrastructure to ensure high data reliability and uptime.
• Troubleshoot and resolve data-related issues to ensure data quality and consistency across systems.
• Collaborate with data analysts, data scientists, and other engineers to understand data requirements and deliver high quality data solutions.
• Ensure data reliability, scalability, and quality through robust validation, testing, and monitoring processes.
• Manage version control and code collaboration using Git.
• Develop and maintain API integrations for data ingestion and delivery.
• Document technical solutions and maintain up-to-date records of data workflows and infrastructure.

Skills

Strong analytical & problem-solving

Excellent communication & teamwork

Tools

BigQuery

Cloud Storage

Dataform

Cloud Run Functions

Workflows

Terraform

Git

Job description

Key Responsibilities and Accountabilities:

We are seeking a skilled Data Engineer with 35 years of experience to join our team. He/she will be responsible for designing,

building, and optimizing data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. His/her work will ensure data

reliability, scalability, and quality, supporting the organization's analytics and operational needs.

• Design, develop, and maintain robust and scalable data pipelines using GCP services, including BigQuery, Cloud Storage, Dataform, Cloud Run Functions and Workflows.

• Implement and manage infrastructure as code using Terraform for automated provisioning and management of data infrastructure.

• Optimize performance of data warehouses and pipelines through partitioning, clustering, and other best practices to ensure efficient data processing and query performance.

• Monitor and maintain the health of the data infrastructure, proactively identifying and resolving issues to ensure high data reliability and uptime.

• Troubleshoot and resolve data-related issues, ensuring data quality and consistency across systems.
• Collaborate with data analysts, data scientists, and other engineers to understand data requirements and deliver high quality data solutions.

• Ensure data reliability, scalability, and quality through robust validation, testing, and monitoring processes.
• Manage version control and code collaboration using Git.
• Develop and maintain API integrations for data ingestion and delivery.
• Document technical solutions and maintain up-to-date records of data workflows and infrastructure.

3. Key qualifications

• 3-5 years of professional experience as a Data Engineer or in a similar data-focused role.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

3. Preferred skills

• Experience with CI/CD pipelines for data engineering workflows.
• Familiarity with data governance and obser