Gcp Data Engineer

Innodata India; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

Innodata India is seeking a GCP Data Engineer to design and implement data-driven solutions on Google Cloud Platform. You will build ETL pipelines using SQL and Python, ingest data from ERP, procurement, logistics, and facilities systems, and optimize data lakes and warehouses.

You will partner with supply chain and AI/ML teams to enable RAG ingestion and other AI workflows. Join a team focused on data governance, performance optimization, and scalable BI solutions, with responsibilities

Qualifications

• Strong hands-on expertise with GCP services including BigQuery, Dataflow, Pub/Sub, and Looker/BI.
• Proficiency in SQL and Python for data engineering and scripting.
• Experience building ETL/ELT pipelines for structured and unstructured data.
• Knowledge of data warehouse and data lake architectures.
• Familiarity with AI/ML pipelines and vector databases is a plus.

Responsibilities

• Design and implement data-driven solutions on GCP (BigQuery, Dataflow, Pub/Sub, Looker).
• Build ETL scripts using SQL and Python to extract, clean, and transform data.
• Develop pipelines for ingestion, transformation, and loading into data lakes and warehouses.
• Extend end-to-end data and BI solutions across extraction to visualization.
• Collaborate with supply chain and AI/ML teams for pipelines supporting AI solutions.
• Ensure data governance, lineage, and compliance across datasets.
• Continuously optimize query performance and pipeline reliability.

Skills

SQL

Python

ETL pipelines

Data governance

AI/ML pipelines

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Looker/BI

Job description

Role- GCP Data Engineer

Responsibilities:

• Design and implement data-driven solutions on GCP including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Looker/BI.
• Build ETL scripts using SQL and Python to extract, clean, and transform structured and unstructured data from ERP, procurement, logistics, and facility management systems.
• Develop and optimize data pipelines for ingestion, transformation, and loading into enterprise data lakes and warehouses.
• Build and extend end-to-end data and BI solutions, spanning extraction, storage, transformation, and visualization layers.
• Partner with supply chain, real estate, and AI/ML teams to provide pipelines for AI solutions (e.g., RAG ingestion, Copilot integration, multi-agent workflows).
• Ensure data governance, lineage, and compliance across supply chain datasets.
• Continuously optimize query performance, ETL processes, and pipeline reliability.

Skills Required :

• Strong hands-on expertise with GCP services: BigQuery, Dataflow, Pub/Sub, Cloud Storage, Looker/BI (or similar).
• Advanced proficiency in SQL (complex queries, optimization) and Python (data engineering, scripting, APIs).
• Experience building ETL/ELT pipelines operating on structured and unstructured data sources.
• Knowledge of enterprise data warehouse and data lake architectures.
• Exposure to data pipelines for AI/ML (vector DB ingestion, embeddings, RAG pipelines, copilots, agents).
• Familiarity with supply chain or data center operations data is a strong plus.