Senior Data Engineer / Leader

Sprouts.ai; India; Hybrid; INR 2,000,000 - 4,000,000; Full time

Job summary

Sprouts.ai is building an AI-native GTM intelligence platform for enterprise revenue teams, based in India with hybrid work options. We seek a data engineer who can own data as a product, build reliable pipelines over hundreds of millions of records, and apply AI to clean and process data at scale.

You will work with Python, PySpark, Iceberg, Nessie, Trino, Airflow, and more to deliver high-quality, queryable data.

Qualifications

• Five+ years of producing data pipelines in production.
• Strong distributed processing and SQL/data modeling capabilities.
• Experience with CDC or incremental data pipelines.
• Ability to keep large-scale data accurate, fresh, and performant.
• Ability to read unfamiliar code and deliver without hand-holding.
• Excellent engineering judgment and communication.
• Experience applying AI/LLMs to data cleaning or processing is a plus.

Responsibilities

• Own data as a product, from vendor feeds to clean platform data.
• Build and run scalable pipelines turning vendor feeds into clean, queryable records.
• Apply AI to process, classify, and enrich data at scale cost-effectively.
• Use AI to normalize, deduplicate, and resolve identity across sources.
• Implement data quality checks and observability to prove correctness.

Skills

Data pipelines

Distributed processing (Spark)

SQL & data modeling

CDC / incremental pipelines

Code reading / ship without hand-hold

Communication

AI-native data processing

Tools

Python

PySpark

Apache Iceberg

Project Nessie

Trino

Airflow

Elasticsearch

Postgres

S3

Kubernetes

Job description

Location: Bangalore / Chandigarh (Hybrid). Remote possible for the right person.

Type: Full-Time

Reports to: Chief Architect

About us

We are building an AI-native GTM intelligence platform for enterprise revenue teams. Our data is the product. We hold 45M+ companies and hundreds of millions of contacts, built from many vendor feeds and served into search and AI features.

Data quality is our highest priority. Every AI feature we ship is only as good as the data underneath it. So the data engineer is a central role here, not a supporting one.

The role

We are looking for a strong data engineer who can do two things well.

First, the traditional craft. Build reliable pipelines that keep large-scale data correct and fresh. This is a must. Everything else sits on top of it.

Second, the new craft. Use AI to process and clean data at a scale and quality that rules and scripts alone cannot reach.

You will own data as a product, from raw vendor feeds to the clean records the whole platform runs on.

What you’ll own

• Data as a product. Own the quality, freshness, and correctness of the data you ship. Treat the teams and features that consume it as your customers. Care that the data is right, not just that the job ran.


• Pipelines at scale. Build and run incremental pipelines that turn messy vendor feeds into clean, trustworthy, queryable data across hundreds of millions of records.


• AI for data processing. Use LLMs and smaller models to parse, classify, extract, and enrich data at scale, and do it cost-effectively.


• AI for data cleaning. Use AI to normalize, deduplicate, and resolve identity, and to catch bad data that rules miss. Match and merge the same company or person across many vendors into one record, and resolve conflicts between sources.


• Correctness you can prove. Build the checks, gates, and observability that catch bad data before it reaches a customer. Be able to show the data is right.


• An AI-native way of working. Use AI tools every day to design, build, and ship faster.

What we’re looking for

The foundation (must have):

• 5+ years building production data pipelines.


• Strong distributed data processing (Spark or similar) and strong SQL and data modeling.


• Experience with incremental or CDC pipelines, not just full batch reloads.


• The ability to keep large-scale data correct, fresh, and performant.


• You read unfamiliar code and ship without hand-holding.


• Good engineering judgment and clear communication.


• What sets you apart (AI-native):


• You use AI tools daily in your own engineering work.


• You have used AI, LLMs, or ML to process, clean, or resolve data, or you are excited to. Not just to write code, but on the data itself.


• You think about data as a product, with consumers, contracts, and quality that is measured.


• You separate “the pipeline succeeded” from “the data is correct,” and you care about the second one.

Our stack (context, not a checklist):

Python, PySpark, Apache Iceberg, Project Nessie, Trino, Airflow, Elasticsearch, Postgres, S3, Kubernetes. You do not need all of it. We care more about how you think and what you can build than which exact tools you have used.

Nice to have

• Entity resolution, identity graphs, or record matching at scale.


• Applying LLMs or smaller, self-hosted models to data at scale, cost-effectively.


• A lakehouse table format (Iceberg, Delta, or Hudi) and branching (write-audit-publish).


• Vector databases, embeddings pipelines, or Elasticsearch.


• Data-quality frameworks, pipeline gates, and observability.


• Data is the core of the product, not a side system.


• You will help build an AI-native data platform, not just maintain pipelines.


• Hard, real problems: incremental loads at scale, entity resolution, and AI-driven cleaning across hundreds of millions of records.


• High ownership and direct impact on what ships.