Data Engineer with Python and GCP

Zoho; Chennai District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Zoho is seeking a data engineer to design, build, and maintain ETL/ELT pipelines using Python and Google Cloud Platform. You will implement data ingestion from APIs, databases, and files, ensuring validation, monitoring, and secure operations.

The role emphasizes CI/CD and DevOps practices, with governance and incident troubleshooting on production pipelines. The candidate will work with Dataflow, Composer, BigQuery, and Cloud Storage to ensure scalable data architecture and reliable data

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Python & GCP.
• Build and manage pipelines with Dataflow, Composer, BigQuery, Cloud Storage.
• Implement data ingestion from APIs, DBs, files.
• Ensure data validation, monitoring, and error handling.
• Apply CI/CD & DevOps practices for data engineering.
• Troubleshoot production issues & ensure governance/security compliance.
• Document pipelines, architecture, and operational processes.

Skills

Python

CI/CD

DevOps

Data governance

Monitoring

Tools

Dataflow

BigQuery

Cloud Storage

APIs

Job description

• Design, develop, and maintain ETL/ELT pipelines using Python & GCP.
• Build/manage pipelines with Dataflow, Composer, BigQuery, Cloud Storage.
• Implement data ingestion from APIs, DBs, files.
• Ensure data validation, monitoring, and error handling.
• Apply CI/CD & DevOps practices for data engineering.
• Troubleshoot production issues & ensure governance/security compliance.
• Document pipelines, architecture, and operational processes.