Senior Data Engineer

Sprouts Inc.

Bengaluru, Chandigarh

Hybrid

INR 1,200,000 - 1,800,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sprouts Inc. is building an AI-native GTM intelligence platform and seeks a data engineer to own data as a product and to scale pipelines across hundreds of millions of records.

You will build reliable pipelines, apply AI to parse, classify, and enrich data, and implement checks and observability to prove data quality before it's used by downstream features.

Qualifications

  • 5+ years building production data pipelines.
  • Strong distributed data processing (Spark or similar) and strong SQL and data modeling.
  • Experience with incremental or CDC pipelines, not just full batch reloads.
  • The ability to keep large-scale data correct, fresh, and performant.
  • You read unfamiliar code and ship without hand-holding.
  • Good engineering judgment and clear communication.

Responsibilities

  • Own data as a product, from raw vendor feeds to the clean records the platform runs on.
  • Build and run incremental pipelines that turn messy feeds into clean, trustworthy data across hundreds of millions of records.
  • Use AI to parse, classify, extract, and enrich data at scale, cost-effectively.
  • Use AI to normalize and deduplicate data and resolve identity across sources.
  • Build the checks, gates, and observability that catch bad data before it reaches customers.

Skills

Production data pipelines
Distributed data processing
SQL & data modeling
Incremental / CDC pipelines
Code comprehension
Engineering judgment & communication
AI-native data tools usage

Tools

Python
PySpark
Apache Iceberg
Project Nessie
Trino
Airflow
Elasticsearch
PostgreSQL
S3
Kubernetes

Job description

About us

We are building an AI-native GTM intelligence platform for enterprise revenue teams. Our data is the product. We hold 45M+ companies and hundreds of millions of contacts, built from many vendor feeds and served into search and AI features.

Data quality is our highest priority. Every AI feature we ship is only as good as the data underneath it. So the data engineer is a central role here, not a supporting one.

The role

We are looking for a strong data engineer who can do two things well.

First, the traditional craft. Build reliable pipelines that keep large-scale data correct and fresh. This is a must. Everything else sits on top of it.

Second, the new craft. Use AI to process and clean data at a scale and quality that rules and scripts alone cannot reach.

You will own data as a product, from raw vendor feeds to the clean records the whole platform runs on.

What you'll own
  • Data as a product. Own the quality, freshness, and correctness of the data you ship. Treat the teams and features that consume it as your customers. Care that the data is right, not just that the job ran.
  • Pipelines at scale. Build and run incremental pipelines that turn messy vendor feeds into clean, trustworthy, queryable data across hundreds of millions of records.
  • AI for data processing. Use LLMs and smaller models to parse, classify, extract, and enrich data at scale, and do it cost-effectively.
  • AI for data cleaning. Use AI to normalize, deduplicate, and resolve identity, and to catch bad data that rules miss. Match and merge the same company or person across many vendors into one record, and resolve conflicts between sources.
  • Correctness you can prove. Build the checks, gates, and observability that catch bad data before it reaches a customer. Be able to show the data is right.
  • An AI-native way of working. Use AI tools every day to design, build, and ship faster.
What we're looking for

The foundation (must have):

  • 5+ years building production data pipelines.
  • Strong distributed data processing (Spark or similar) and strong SQL and data modeling.
  • Experience with incremental or CDC pipelines, not just full batch reloads.
  • The ability to keep large-scale data correct, fresh, and performant.
  • You read unfamiliar code and ship without hand-holding.
  • Good engineering judgment and clear communication.

What sets you apart (AI-native):

  • You use AI tools daily in your own engineering work.
  • You have used AI, LLMs, or ML to process, clean, or resolve data, or you are excited to. Not just to write code, but on the data itself.
  • You think about data as a product, with consumers, contracts, and quality that is measured.
  • You separate "the pipeline succeeded" from "the data is correct," and you care about the second one.
Nice to have
  • Entity resolution, identity graphs, or record matching at scale.
  • Applying LLMs or smaller, self-hosted models to data at scale, cost-effectively.
  • A lakehouse table format (Iceberg, Delta, or Hudi) and branching (write-audit-publish).
  • Vector databases, embeddings pipelines, or Elasticsearch.
  • Data-quality frameworks, pipeline gates, and observability.

Our stack (context, not a checklist): Python, PySpark, Apache Iceberg, Project Nessie, Trino, Airflow, Elasticsearch, Postgres, S3, Kubernetes. You do not need all of it. We care more about how you think and what you can build than which exact tools you have used.

Why join us
  • Data is the core of the product, not a side system.
  • You will help build an AI-native data platform, not just maintain pipelines.
  • Hard, real problems: incremental loads at scale, entity resolution, and AI-driven cleaning across hundreds of millions of records.
  • High ownership and direct impact on what ships.
  • A small, strong team and a fast pace.
  • You report to and learn directly from the Chief Architect.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Lifesight • Karnataka

Hybrid
INR 2,500,000 - 4,500,000
Senior Data Engineer – ETL, Databricks and Data Platforms
Senior Data Engineer – ETL, Databricks and Data Platforms

SvaaN Global Tech PVT LTD • Chennai

On-site
INR 1,400,000 - 2,100,000
Data Engineer
Data Engineer

Questhiring • Gurugram District

On-site
INR 1,400,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Backbase • Hyderabad

On-site
INR 4,000,000 - 7,000,000
Senior Staff Data Engineer
Senior Staff Data Engineer

MeeruAI • Hyderabad

Remote
INR 4,000,000 - 7,000,000
Data Engineer
Data Engineer

Altimate AI • Bengaluru

On-site
INR 1,200,000 - 1,700,000
Senior Staff Data Engineer
Senior Staff Data Engineer

Meeru AI Inc • Hyderabad

Remote
INR 3,500,000 - 6,000,000
Remote work
Flexible engagement
Senior Data Engineer
Senior Data Engineer

Lifesight • Bengaluru

On-site
INR 2,800,000 - 4,200,000
Data Engineer
Data Engineer

Altimate.ai • Bengaluru

On-site
INR 1,500,000 - 2,300,000
Senior Staff Data Engineer
Senior Staff Data Engineer

MeeruAI Inc. • Hyderabad

Remote
INR 13,170,000 - 18,815,000
Remote work
Flexible engagement