Senior Data Platform Engineer

Kots; Bengaluru; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Kots Bengaluru is seeking a Senior Data Platform Engineer to design and build a pluggable connector framework that unifies relational, NoSQL, and object storage under a single API layer. You will own metadata, schema discovery, and access control across diverse data sources.

This is a deep systems role requiring experience in end-to-end platform design, multi-tenant architectures, and reliable, scalable infrastructure using AWS, Docker, and modern tooling.

Qualifications

• This is a senior, systems-heavy role with ownership of platform infrastructure.
• Deep database and data platform capabilities across heterogeneous sources.
• Strong Python coding and API design skills are required.

Responsibilities

• Design and build a pluggable connector framework for multiple data sources.
• Build unified REST/GraphQL APIs for databases and storage systems.
• Implement schema discovery, metadata management, and query abstraction layers.
• Create connectors for relational DBs (PostgreSQL, MySQL), NoSQL (MongoDB, DynamoDB), and object storage (S3).
• Design authentication, authorization, and access control across connectors.
• Improve performance, scalability, and reliability of data access.
• Implement logging, monitoring, retries, and failure handling.
• Ensure secure handling of credentials and multi-tenant isolation.
• Collaborate with frontend/platform teams for low-code use cases.
• Develop SDKs and developer tooling for the platform.

Skills

Backend engineering

Systems design

Python

API design (REST/GraphQL)

Multi-tenant architectures

Data schema discovery

Metadata management

Event-driven / async processing

AWS

Docker

Tools

AWS

Docker

Kubernetes

Job description

About the Role

Wearebuildingagenericdataplatformthatconnectstomanydifferentdatabasesandstoragesystemsandexposesthemthroughasingle,unifiedAPIlayersimilarinspirittoSupabase,butdesignedtoworkacrossheterogeneousdatasources.WearelookingforaSeniorDataPlatformEngineertodesignandbuildtheconnector-basedarchitectureattheheartofit.Youwillownthepluggableconnectorframeworkthatbringsrelationaldatabases,NoSQLsystems,andobjectstorageintooneconsistent,developer friendlyplatformincludingtheAPIlayer,schemadiscovery,accesscontrol,multi-tenantisolation,andtheSDKsotherteamsbuildon.Thisisadeepsystems-designroleforsomeonewhohasbuiltplatforminfrastructurebefore,notonlyapplicationfeatures.

What Youll Do

• Design and build a pluggable connector framework for multiple data sources.
• Build unified REST / GraphQL APIs for interacting with different databases and storage systems.
• Implement schema discovery, metadata management, and query-abstraction layers.
• Build connectors for relational databases (PostgreSQL, MySQL), NoSQL systems (MongoDB, DynamoDB), and object storage (S3, CDN-based storage such as Bunny).
• Design and implement authentication, authorization, and access control across connectors.
• Optimise the performance, scalability, and reliability of data access.
• Implement logging, monitoring, retries, and failure handling.
• Ensure secure handling of credentials and strong multi-tenant isolation.
• Collaborate with frontend and platform teams to enable low-code and internal-tools use cases.
• Build reusable SDKs and developer tooling for consuming the platform.

What Were Looking For

This is a senior, systems-heavy role. We want someone who has designed and shipped platform or infrastructure software not only application features on top of a single database.

• 7+ years of backend / platform engineering experience, including systems you designed and owned end to end.
• Deep database expertise — PostgreSQL and MySQL, advanced SQL, query optimisation, indexing, and performance tuning.
• Hands-on experience with NoSQL systems (MongoDB and DynamoDB).
• Strong backend development in Python, and strong API design (REST and/or GraphQL).
• Experience designing multi-tenant systems and connector / plugin-based architectures.
• Data abstraction across heterogeneous systems, plus schema discovery and metadata management.
• Experience with event-driven and async processing.
• AWS (RDS, S3, Lambda, ECS) and Docker, with a track record of building for reliability — logging, monitoring, retries, and failure handling.

This Role Is Not a Fit If

• You have only built application features on top of one database, with no platform or infrastructure design experience.
• You rely on ORMs and cannot reason about SQL, query plans, or performance at a low level.
• You have worked only with relational databases — no NoSQL or object storage.
• You have never designed for multi-tenancy, or thought hard about credential security and isolation.
• You have not worked with AWS.

Nice to Have

• Experience with platforms like Hasura or Appwrite.
• Change Data Capture (CDC) and real-time data systems.
• Object storage and CDN integrations.
• Exposure to internal tools / low-code platforms.
• A history of building SDKs or developer platforms.
• Kubernetes; monitoring with CloudWatch, Datadog, or similar.