GCP Data Platform Engineer - Production Reliability

Innodata; Ridgefield Park (NJ); On-site; USD 60,000 - 110,000; Full time

Job summary

Innodata in the United States is seeking a hands-on GCP / Data Platform Engineer to support, maintain, and enhance large-scale production data platforms on Google Cloud. The role emphasizes platform reliability, production support, and continuous improvement rather than greenfield development.

The ideal candidate can diagnose issues across data pipelines, optimize Airflow workflows, and work with BigQuery, Cloud Spanner, Dataflow, Pub/Sub, and related GCP services.

Qualifications

• 3-7+ years of experience in Data Engineering, Cloud Engineering, Platform Engineering, or a related role.
• Strong hands-on experience building, supporting, or maintaining production workloads on Google Cloud Platform (GCP).
• Strong experience with BigQuery and Cloud Spanner.
• Hands-on experience with Dataflow, Pub/Sub, batch/streaming data pipelines, and Cloud Composer / Apache Airflow.
• Strong Python and SQL skills.
• Good understanding of GCP IAM, service accounts, permissions, monitoring, logging, alerting, and production operations.
• Experience troubleshooting complex production environments and performing root-cause analysis.
• Understanding of data ingestion, transformation, orchestration, data quality, performance optimization, and reliability.

Responsibilities

• Support and maintain production GCP data platforms, pipelines, and workflows across batch and streaming workloads.
• Troubleshoot DAG failures, dependencies, scheduling issues, retries, and data-latency or SLA issues in Cloud Composer / Airflow.
• Optimize Airflow DAGs and orchestration workflows for reliability and performance.
• Resolve pipeline failures, data latency, performance degradation, configuration problems, and infra-related issues.
• Work with Cloud Spanner, BigQuery, Dataflow, Pub/Sub, Cloud Storage, IAM, Monitoring and Logging.
• Monitor platform health and proactively improve reliability, scalability, and efficiency.
• Improve data refresh times, throughput, and query performance in pipelines and workloads.
• Assist with platform upgrades while maintaining production stability and compliance.
• Perform root-cause analysis for recurring production issues and implement fixes.
• Support IAM, access controls, monitoring, alerting, logging, and operational governance.
• Collaborate with client and cross-functional Data Engineering, BI/Analytics, Application Engineering, Infrastructure, and Platform teams on issues and enhancements.
• Adapt to client-specific engineering, security, compliance, review, and operational processes.
• Review architectures and suggest incremental improvements without destabilizing production systems.
• Create and maintain technical documentation, runbooks, and troubleshooting guides.

Skills

GCP

BigQuery

Python

SQL

Airflow

Data pipelines

GKE

Terraform

Tools

Cloud Composer

Vertex AI

GKE

Terraform

Job description

Innodata in the United States is seeking a hands-on GCP / Data Platform Engineer to support, maintain, and enhance large-scale production data platforms on Google Cloud. The role emphasizes platform reliability, production support, and continuous improvement rather than greenfield development.

The ideal candidate can diagnose issues across data pipelines, optimize Airflow workflows, and work with BigQuery, Cloud Spanner, Dataflow, Pub/Sub, and related GCP services.