Data Engineer

Innodata Inc.; Patna; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Innodata Inc. is seeking a GCP Data Engineer to design and build scalable data warehouses, lakes, and ETL pipelines on Google Cloud Platform. The role focuses on enabling AI/ML use cases, RAG, copilots, and agentic AI for predictive analytics and automation.

The candidate will implement data governance and optimize pipelines for reliability across ERP, procurement, logistics, and facility management datasets, collaborating with cross-functional teams.

Qualifications

• 5-8 years of data engineering experience on cloud platforms.
• Experience designing and building data warehouses and data lakes.
• Strong SQL and Python programming skills.

Responsibilities

• Design and implement data-driven solutions on GCP using BigQuery, Dataflow, Pub/Sub, and Looker/BI.
• Build ETL scripts to extract, clean, and transform data from ERP, procurement, logistics, and facilities systems.
• Develop and optimize pipelines for ingestion, transformation, and loading into data lakes and warehouses.
• Create end-to-end data and BI solutions from extraction to visualization.
• Collaborate with supply chain, real estate, and AI/ML teams for AI-enabled pipelines.
• Ensure data governance, lineage, and compliance across datasets.
• Continuously optimize query performance and pipeline reliability.

Skills

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Looker/BI

SQL

Python

ETL/ELT pipelines

Data warehousing

AI/ML pipelines

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Looker

Job description

Experience: 5-8 years

Work Mode: Remote

About Role :

We are seeking a GCP Data Engineer to design and build enterprise data warehouses, data lakes, and pipelines that power data-driven decision-making for data center supply chain and real estate operations. This role is responsible for creating scalable, secure, and optimized ETL infrastructure on Google Cloud Platform (GCP), while enabling advanced AI/ML use cases such as RAG, copilots, and agentic AI for predictive analytics and workflow automation.

Responsibilities:

• Design and implement data-driven solutions on GCP including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Looker/BI.
• Build ETL scripts using SQL and Python to extract, clean, and transform structured and unstructured data from ERP, procurement, logistics, and facility management systems.
• Develop and optimize data pipelines for ingestion, transformation, and loading into enterprise data lakes and warehouses.
• Build and extend end-to-end data and BI solutions, spanning extraction, storage, transformation, and visualization layers.
• Partner with supply chain, real estate, and AI/ML teams to provide pipelines for AI solutions (e.g., RAG ingestion, Copilot integration, multi-agent workflows).
• Ensure data governance, lineage, and compliance across supply chain datasets.
• Continuously optimize query performance, ETL processes, and pipeline reliability.

Skills Required:

• Strong hands-on expertise with GCP services: BigQuery, Dataflow, Pub/Sub, Cloud Storage, Looker/BI (or similar).
• Advanced proficiency in SQL (complex queries, optimization) and Python (data engineering, scripting, APIs).
• Experience building ETL/ELT pipelines operating on structured and unstructured data sources.
• Knowledge of enterprise data warehouse and data lake architectures.
• Exposure to data pipelines for AI/ML (vector DB ingestion, embeddings, RAG pipelines, copilots, agents).