GCP Data Platform Engineer — Production-Grade Pipelines

Innodata Inc.; United States; Remote; USD 60,000 - 110,000; Full time

Job summary

Innodata is seeking a hands-on GCP / Data Platform Engineer to support, maintain, and enhance large-scale production data platforms on Google Cloud. The role emphasizes reliability, production support, troubleshooting, and continuous improvements over greenfield development.

Ideal candidates have 3–7+ years in data/cloud/platform engineering with strong Python/SQL, BigQuery/Cloud Spanner experience, and proficiency in Dataflow, Pub/Sub, Airflow, and IAM. Collaboration across teams is essential.

Qualifications

• 3-7+ years of experience in Data Engineering, Cloud Engineering, Platform Engineering, or a related role.
• Strong hands-on experience building, supporting, or maintaining production workloads on Google Cloud Platform (GCP).
• Strong experience with BigQuery and Cloud Spanner.
• Hands-on experience with Dataflow, Pub/Sub, batch/streaming data pipelines, and Cloud Composer / Apache Airflow.
• Strong Python and SQL skills.
• Good understanding of GCP IAM, service accounts, permissions, monitoring, logging, alerting, and production operations.
• Experience troubleshooting complex production environments and performing root-cause analysis.
• Understanding of data ingestion, transformation, orchestration, data quality, performance optimization, and reliability.
• Ability to quickly understand existing systems, codebases, pipelines, configurations, and client-specific tools and workflows.
• Strong communication and collaboration skills across engineering and business teams.

Responsibilities

• Support and maintain production GCP data platforms, pipelines, and workflows across batch and streaming workloads.
• Troubleshoot DAG failures, dependencies, scheduling issues, retries, and data-latency or SLA issues in Airflow.
• Optimize Airflow DAGs and orchestration for reliability and performance.
• Troubleshoot pipeline failures, data latency, performance degradation, and infra-related issues.
• Work with Cloud Spanner, BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Monitoring, IAM, and related GCP services.
• Monitor platform health and proactively improve reliability, scalability, and efficiency.
• Collaborate with Data Engineering, BI/Analytics, and Infra teams on issues and enhancements.
• Create and maintain technical documentation, runbooks, troubleshooting guides, and platform procedures.

Skills

Python

SQL

GCP Experience

Problem-solving

Communication

Tools

BigQuery

Cloud Spanner

Dataflow

Pub/Sub

Airflow

Terraform

Vertex AI

Job description

Innodata is seeking a hands-on GCP / Data Platform Engineer to support, maintain, and enhance large-scale production data platforms on Google Cloud. The role emphasizes reliability, production support, troubleshooting, and continuous improvements over greenfield development.

Ideal candidates have 3–7+ years in data/cloud/platform engineering with strong Python/SQL, BigQuery/Cloud Spanner experience, and proficiency in Dataflow, Pub/Sub, Airflow, and IAM. Collaboration across teams is essential.