Data Platform Engineer IV

The Standard India; Bengaluru; Hybrid; INR 1,800,000 - 2,400,000; Full time

Benefits offered by this job

Incentive bonus

Paid time off

Learning and career growth

Job summary

The Standard India is seeking a Data Platform Engineer IV to design and build the enterprise data foundation on our Data & AI Platform. You’ll own Neo4j graph data design, ontology, and integration across Lakebase and MCP gateways, with governance and security in mind.

This role sits on our Data & AI Platform team, backed by Azure Databricks, Neo4j, Confluent Kafka, Kong, and model deployments behind a governed gateway.

Qualifications

• 4+ years of data engineering experience building production pipelines.
• Strong PySpark and SQL skills and solid Python fundamentals.
• Hands-on Databricks experience: Delta Lake, jobs/workflows and Unity Catalog familiarity.
• Kafka/Confluent experience including consuming event streams into analytical stores.
• Experience with pipeline orchestration tools (Airflow, Delta Live Tables, Azure Data Factory or equivalent).
• Experience processing unstructured data (documents, text) in pipelines.
• Working knowledge of graph or vector data stores (Neo4j, Databricks Vector Search, Azure AI Search), including backups and monitoring.

Responsibilities

• Design and build graph data models in Neo4j: schema design, semantic relationships, ontology-aware modeling and governed graph access patterns.
• Build cross-system entity resolution and reference/mapping so the same real-world entity is recognized across source systems.
• Engineer the vector and retrieval layer: embeddings, chunking strategy, semantic search, hybrid retrieval and retrieval quality validation.
• Implement GraphRAG patterns grounding agents and AI products in governed enterprise context.
• Build and operate pipelines that keep graph and vector stores synchronized with governed data on Databricks.
• Define governed access patterns for context retrieval with security engineering.
• Evaluate enterprise memory technologies and drive recommendations with the Platform Architect.
• Set standards for graph and retrieval engineering and mentor junior Data Platform Engineers.

Skills

PySpark

SQL

Python

Databricks

Neo4j

Graph data modeling

Kafka/Confluent

CI/CD for data pipelines

Education

B.Tech / B.E. in Computer Science / Information Systems

Tools

Delta Lake

Lakeflow

Delta Live Tables

Airflow

Databricks

Grafana/Datadog observability

Job description

The next part of your journey is right around the corner — with StanCorp Global Services

A genuine desire to make a difference in the lives of others is the foundation for everything we do. With a customer-first mindset and an intentional focus on building strong teams across the nation, we’ve been able to uphold our legacy of financial stability while investing in new, innovative technologies that support the needs of our customers. Our high-performance culture, focused on operational excellence, thrives thanks to remarkable people united by compassion and a customer-first commitment. Are you ready to make a difference?

Job Summary

The Standard is seeking a Data Platform Engineer IV to build the context foundations of our Data & AI Platform: graph and ontology-oriented data engineering with Neo4j, plus vector, retrieval and unstructured data engineering.

In this role, you will build the enterprise memory that grounds our AI systems in governed knowledge — graph schema design, semantic relationships, governed graph access patterns, embeddings, chunking strategy, semantic search and retrieval quality validation, including backup/restore and disaster recovery drills. Your initial assignment makes you the primary owner for Lakebase, Neo4j, ontology and graph data design on the Enterprise Memory task force, with supporting work on Neo4j MCP integrations for the MCP Gateway task force.

This role sits on The Standard's Data & AI Platform team, which owns the enterprise's shared data and AI foundation — governed once and consumed by many — built on Azure Databricks, Neo4j, Confluent Kafka, Kong, and Anthropic and OpenAI models behind a governed gateway.

• Ability to work on-site in Bengaluru, India is a requirement of the role. *

Mode of Working

This role follows a hybrid work model, with a primary base in Bengaluru. While on-site presence is essential for key engagements, flexibility is offered for remote work based on business needs and team alignment.

Key Responsibilities

• Design and build graph data models in Neo4j: schema design, semantic relationships, ontology-aware modeling and governed graph access patterns.
• Build cross-system entity resolution and reference/mapping so the same real-world entity is recognized across source systems.
• Engineer the vector and retrieval layer: embeddings, chunking strategy, semantic search, hybrid retrieval and retrieval quality validation.
• Implement GraphRAG patterns that ground agents and AI products in governed enterprise context.
• Build and operate pipelines that keep graph and vector stores synchronized with governed data on Databricks.
• Define governed, classification-aware access patterns for context retrieval with security engineering.
• Evaluate enterprise memory technologies (Neo4j, Genie Ontology, Lakebase and related) and drive recommendations with the Platform Architect.
• Set standards for graph and retrieval engineering and mentor junior Data Platform Engineers.

Skills And Background You’ll Need

Education: B.Tech / B.E. in Software Engineering, Computer Science or Information Systems is required.

Experience

• Typically requires 4+ years of data engineering experience building production pipelines.
• Strong PySpark and SQL skills and solid Python fundamentals.
• Hands-on Databricks experience: Delta Lake, jobs/workflows and familiarity with Unity Catalog.
• Kafka/Confluent experience, including consuming event streams into analytical stores.
• Experience with pipeline orchestration (Lakeflow/Delta Live Tables, Airflow, Azure Data Factory or equivalent).
• Experience processing unstructured data (documents, text) in pipelines.
• Working knowledge of a graph or vector data store (Neo4j, Databricks Vector Search, Azure AI Search or equivalent), including routine operations such as backups, monitoring and index refreshes.
• Data-quality testing experience (Great Expectations, dbt tests or equivalent) and lineage/freshness monitoring.
• Git-based workflows and CI/CD for data pipelines

Preferred Experience

• Cypher basics and interest in growing into graph engineering.
• Disaster recovery or multi-region operations exposure (replication, failover drills, backup/restore testing).
• Lakebase or Postgres-style operational store experience.
• Confluent ecosystem depth (Schema Registry, connectors) and CDC tooling.
• Observability tooling (Datadog) and on-call experience.
• Good to have Databricks Data Engineer Associate or Confluent Certified Developer.

Key Behaviors Of a Successful Candidate

• Adaptability — Seeks information to understand the rationale for and importance of the change.
• Customer Focus — Displays an interest in the customer by trying to understand their concerns and issues; draws on customer insight to help others best meet current and future customer needs.
• Improvement Mindset — Demonstrates curiosity by asking questions regarding current approaches/methods and identifying potential changes.

Why Join Standard India?

We Have Built An Enduring Legacy Of Stability, Financial Strength And Exceptional Customer Service Through The Contributions Of The Service-oriented People Who Choose To Work At The Standard. To Ensure We Can Attract And Retain The Best Talent, When You Join StanCorp Global Servicesyou Can Expect

• A rich benefits package that supports your health, well-being, and financial goals
• An annual incentive bonus plan tied to both individual and organizational performance
• Paid time off including earned leave, sick/casual leave, and public holidays, in accordance with the company’s leave policy
• A supportive, responsive management approach that empowers you to grow
• Opportunities for career advancement through learning, coaching, and leadership enablement
• A culture where your voice matters—your ideas shape our future, and we win as one
• Purpose-driven work that makes a difference for our customers, communities, and each other

In addition to a competitive salary, our employee-focused benefits are designed to support work-life balance, personal growth, and long-term impact.

Eligibility to participate in an incentive program is subject to the rules governing the program and plan. Any award depends on a variety of factors including individual and organizational performance.

StanCorp Global Services India Private Limited is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, religion, colour, sex, gender identity, sexual orientation, age, disability, caste, HIV status or any other characteristic protected by applicable laws of India.