Lead Data Engineer

Aqilea; Bengaluru; Hybrid; INR 4,000,000 - 7,000,000; Full time

Job summary

Aqilea in Bengaluru (Hybrid) is seeking a Lead Data Engineer to join the Emerging Technology team and build the next generation of AI-powered supply chain products. You will lead data product engineering, pipelines, and ML enablement for the Inventory Flow Assistant (IFA) on Google Cloud, BigQuery and dbt.

The role requires deep technical expertise in cloud data platforms, big data processing, and scalable architectures, with hands-on delivery and coaching of other engineers.

Qualifications

• 7+ years of data engineering experience.
• 3+ years working in Google Cloud environments.
• Deep expertise in BigQuery.
• Strong hands-on experience with dbt.
• Expert SQL skills.
• Strong Python development capabilities.
• Experience designing enterprise-scale data products.
• Experience building and maintaining end-to-end ETL/ELT pipelines.
• Experience working with machine learning and analytical platforms.
• Proven ability to handle very large datasets (billions of records).
• Experience designing highly scalable distributed systems.
• Strong Git, CI/CD and DevOps practices.

Responsibilities

• Design and build enterprise-grade data products on Google Cloud Platform.
• Identify, assess and integrate data entities from existing BigQuery-based data products.
• Design scalable data models, semantic layers and business-ready schemas.
• Build and maintain dbt-based transformation frameworks.
• Deliver high-quality curated datasets optimized for analytical and operational use cases.
• Develop end-to-end ingestion, transformation and serving pipelines.
• Implement batch and near real-time processing patterns.
• Build delta-based ingestion mechanisms to detect source changes and process updates continuously.
• Ensure pipeline reliability, observability and operational excellence.
• Build data products serving Machine Learning models.
• Develop data foundations supporting AI agents and intelligent automation workflows.
• Ensure training, inference and feedback-loop data availability.
• Partner closely with Data Scientists and ML Engineers.
• Design solutions capable of processing billions of records across distributed systems.
• Optimize BigQuery workloads for performance and cost efficiency.
• Implement partitioning, clustering and workload management strategies.
• Design for high throughput, resiliency and scalability.
• Supply Chain, Inventory or Logistics domain experience is a plus.
• Retail data platforms experience is beneficial.
• AI/ML product development experience is valued.
• Semantic modelling and data product thinking is desirable.

Skills

BigQuery

dbt

Python

SQL

GCP

ETL/ELT

Data Modeling

Data Warehousing

CI/CD

DevOps

Git

AI Agents

Education

Bachelor's in CS/Engineering

Tools

dbt

GCP

BigQuery

Dataflow

Cloud Composer

Job description

Company Description

Aqilea is an IT and engineering consulting partner that helps companies get more out of their technology and operations. With teams in Stockholm and Bangalore, we work closely with our clients to build solutions that fit their needs - from software development, AI and infrastructure engineering to industrial automation and embedded systems.

Company Description

Aqilea is an IT and engineering consulting partner that helps companies get more out of their technology and operations. With teams in Stockholm and Bangalore, we work closely with our clients to build solutions that fit their needs - from software development, AI and infrastructure engineering to industrial automation and embedded systems.

We combine strong technical expertise with a practical, business-focused approach to help organizations modernize, improve security, and scale with confidence. Above all, we focus on long-term partnerships built on trust, quality, and real results.

With us, you have great opportunities to take real steps in your career and the opportunity to take great responsibility.

Role : Lead Data Engineer

Exp Range : 8 to 12 years

Work Location : Bangalore(Hybrid)

Notice : Immediate Joiners

Lead Data Engineer - Inventory Flow Assistant (Google Cloud / BigQuery / dbt)

About The Role

We are looking for a highly experienced, hands-on Lead Data Engineer to join the Emerging Technology team and help build the next generation of AI-powered supply chain products.

You will be a key technical contributor in the development of the Inventory Flow Assistant (IFA), an enterprise-scale data and AI platform designed to improve inventory visibility, inventory health monitoring, decision intelligence and AI-driven recommendations across the supply chain.

This is a senior individual contributor role requiring deep technical expertise in Google Cloud, BigQuery, dbt, modern data architecture and large-scale data processing. You will be expected to design, build and own production-grade data products that serve machine learning models, AI agents and other business applications.

The ideal candidate combines strong architecture thinking with extensive hands-on development experience and can independently deliver complex solutions while coaching other engineers.

Key Responsibilities

Data Product Engineering

• Design and build enterprise-grade data products on Google Cloud Platform.
• Identify, assess and integrate data entities from existing BigQuery-based data products.
• Design scalable data models, semantic layers and business-ready schemas.
• Build and maintain dbt-based transformation frameworks.
• Deliver high-quality curated datasets optimized for analytical and operational use cases.

Data Pipeline Development

• Develop end-to-end ingestion, transformation and serving pipelines.
• Implement batch and near real-time processing patterns.
• Build delta-based ingestion mechanisms to detect source changes and process updates continuously.
• Ensure pipeline reliability, observability and operational excellence.

AI & Machine Learning Enablement

• Build data products serving Machine Learning models.
• Develop data foundations supporting AI agents and intelligent automation workflows.
• Ensure training, inference and feedback-loop data availability.
• Partner closely with Data Scientists and ML Engineers.

Scalability & Performance

• Design solutions capable of processing billions of records across distributed systems.
• Optimize BigQuery workloads for performance and cost efficiency.
• Implement partitioning, clustering and workload management strategies.
• Design for high throughput, resiliency and scalability.

Required Experience

Must Have

• 7+ years of data engineering experience.
• 3+ years working in Google Cloud environments.
• Deep expertise in BigQuery.
• Strong hands-on experience with dbt.
• Expert SQL skills.
• Strong Python development capabilities.
• Experience designing enterprise-scale data products.
• Experience building and maintaining end-to‑to‑end ETL/ELT pipelines.
• Experience working with machine learning and analytical platforms.
• Proven ability to handle very large datasets (billions of records).
• Experience designing highly scalable distributed systems.
• Strong Git, CI/CD and DevOps practices.

Technical Skills

Google Cloud

• BigQuery
• Cloud Storage
• Dataflow
• Pub/Sub
• Cloud Composer
• Cloud Run
• Vertex AI (preferred)
• IAM & Security

Data Engineering

• dbt
• SQL (expert level)
• Python
• Data Modeling
• Data Warehousing
• ETL / ELT
• Data Quality Frameworks

Large Scale Data

• Streaming architectures
• Event-driven systems
• Incremental processing
• Delta ingestion patterns
• Partitioning and clustering strategies
• Performance optimization

Preferred Domain Experience

• Supply Chain, Inventory or Logistics domain experience.
• Retail data platforms.
• AI/ML product development.
• Semantic modelling and data product thinking.

Experience supporting AI Agents or Retrieval-Augmented Generation (RAG) solutions.