Founding Data Engineer

Applied Retention

Mumbai

On-site

INR 1,500,000 - 2,200,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Applied Retention is seeking an experienced engineer to design, build, and operate production data pipelines and batch processing systems in Mumbai. The role emphasizes ingestion, transformation, reconciliation, and serving of large datasets with an emphasis on reliability and auditability.

You will own multi-tenant data isolation, backfill/replay mechanisms, and resilient integrations with vendors. Strong SQL, Python backend skills, and TDD are essential for delivering scalable data solutions

Qualifications

  • 4-7 years of experience building and operating production systems.
  • Hands-on experience owning production data pipelines, including data ingestion, transformation, reconciliation, and serving.
  • Strong proficiency in SQL, including multi-step transformations, window functions, statistical aggregates, and incremental computation.
  • Experience transforming raw event or order data into cohort, retention, and funnel metrics.
  • Production-level experience with Python backend development, with the ability to maintain clean separation between business logic and framework-specific components.
  • Strong understanding of test-driven development, particularly for batch processing jobs and data reconciliation workflows.
  • Experience troubleshooting production issues involving queue backlogs, webhook failures, and data reconciliation.
  • Strong written communication skills and experience working in documentation-driven environments.
  • Ability to independently manage deliverables, make technical decisions, and take ownership of outcomes with minimal supervision.

Responsibilities

  • Design, develop, and maintain third-party data ingestion pipelines, including webhook integrations and source-data reconciliation.
  • Build and optimise batch processing workflows to handle large datasets within scheduled processing windows.
  • Implement multi-tenant data isolation to ensure reliability and prevent cross-tenant performance issues.
  • Design and maintain data backfill and replay mechanisms to support data recovery and reprocessing.
  • Maintain append-only, auditable records to ensure automated decisions are traceable and reconstructable.
  • Build and manage resilient vendor API integrations using circuit breakers, retry mechanisms, and reconciliation processes.
  • Implement and maintain operational infrastructure, including alerting, data partitioning, and idempotent job processing.

Skills

PostgreSQL
SQL
Python
Data pipelines
Batch processing
Data reconciliation
Test-driven development
Documentation

Tools

Kafka
Django

Job description

Responsibilities:

  • Design, develop, and maintain third-party data ingestion pipelines, including webhook integrations and source-data reconciliation.
  • Build and optimise batch processing workflows to handle large datasets within scheduled processing windows.
  • Implement multi-tenant data isolation to ensure reliability and prevent cross-tenant performance issues.
  • Design and maintain data backfill and replay mechanisms to support data recovery and reprocessing.
  • Maintain append-only, auditable records to ensure automated decisions are traceable and reconstructable.
  • Build and manage resilient vendor API integrations using circuit breakers, retry mechanisms, and reconciliation processes.
  • Implement and maintain operational infrastructure, including alerting, data partitioning, and idempotent job processing.

Requirements:

  • Around 4-7 years of experience building and operating production systems, with strong expertise in PostgreSQL, including schema design, query optimisation, and large-scale batch processing.
  • Hands-on experience owning production data pipelines, including data ingestion, transformation, reconciliation, and serving.
  • Strong proficiency in SQL, including multi-step transformations, window functions, statistical aggregates, and incremental computation.
  • Experience transforming raw event or order data into cohort, retention, and funnel metrics.
  • Production-level experience with Python backend development, with the ability to maintain clean separation between business logic and framework-specific components.
  • Strong understanding of test-driven development, particularly for batch processing jobs and data reconciliation workflows.
  • Experience troubleshooting production issues involving queue backlogs, webhook failures, and data reconciliation.
  • Strong written communication skills and experience working in documentation-driven environments.
  • Ability to independently manage deliverables, make technical decisions, and take ownership of outcomes with minimal supervision.

Nice to Have:

  • Hands-on experience with Django in production environments.
  • Experience working with e-commerce platforms.
  • Familiarity with streaming and event-driven architectures, including Kafka or similar technologies.
  • Knowledge of probabilistic and approximate data structures such as HyperLogLog, Bloom Filters, and t-digest.
  • Experience developing server-rendered web applications.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Data Engineer
Founding Data Engineer

SkillYT • India

On-site
INR 2,400,000 - 3,600,000
Data Engineer
Data Engineer

Sutherland • Chennai

Remote
INR 600,000 - 1,200,000
Python Engineer
Python Engineer

Experiture Global • Kolkata

On-site
INR 1,200,000 - 1,800,000
Data Enginner
Data Enginner

Garg Ventures Pvt Ltd • Delhi

On-site
INR 1,200,000 - 2,100,000
Senior Data Engineer
Senior Data Engineer

ShimentoX Technologies • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Data Engineer
Data Engineer

Valuenode Private Limited • India

Remote
INR 1,200,000 - 1,800,000
Backend Data Eng (SQL, Python, PostgreSQL, ETL, Java, Rest API, Spring
Backend Data Eng (SQL, Python, PostgreSQL, ETL, Java, Rest API, Spring

Mastek • Chennai

On-site
INR 900,000 - 1,300,000
Data Engineer
Data Engineer

Bacancy Technology Inc • Ahmedabad District

On-site
INR 1,500,000 - 3,000,000
Senior Data Engineer
Senior Data Engineer

PradeepIt Global Consulting Pvt Ltd. • Bengaluru

On-site
INR 800,000 - 1,200,000
Database Lead - PostgreSQL
Database Lead - PostgreSQL

Experion • Ernakulam, Thiruvananthapuram

On-site
INR 1,200,000 - 2,400,000