Lead - IT Data Engineering and Analytics

StoneX Group Inc.; Bengaluru; Hybrid; INR 3,500,000 - 6,500,000; Full time

Job summary

StoneX Group Inc. in Bengaluru is seeking a hands-on Technical Lead to steer the Azure data platform strategy, architecture, and delivery.

You will guide a team of four engineers and collaborate closely with product, business, and technical stakeholders to tackle the most challenging platform initiatives. You will own end‑to‑end platform architecture for Databricks Lakehouse, Fabric, and BI semantic layer, and set standards for data modeling, CI/CD, and production readiness, while ensuring

Qualifications

• 8+ years of data engineering and 2+ years as technical lead owning architecture and guiding engineers.
• Deep hands-on expertise in Azure Databricks — Delta Lake, PySpark, Unity Catalog, cluster and performance tuning at scale.
• Strong experience with Microsoft Fabric and ADLS Gen2.
• Strong Python (PySpark) and SQL; proficient in at least one additional language (Java, C#, or similar).
• Hands-on with Docker, Git, Kubernetes, and IaC (Terraform, Ansible).
• Solid competencies across Azure cloud networking, identity management, storage, and compute.
• Bachelor’s degree in Computer Science, Mathematics, Electrical Engineering, or related discipline — or equivalent experience.

Responsibilities

• Own the architecture of the Azure data platform end-to-end — Databricks Lakehouse, Fabric, and the BI semantic layer.
• Engage with product, business, and technical stakeholders to identify, scope, and deliver data platform initiatives.
• Lead delivery across a team of engineers — break down work, unblock, mentor, and raise the engineering bar through design and code reviews.
• Set standards for data modeling, PySpark/SQL quality, semantic-model design, testing, CI/CD, and production readiness.
• Own platform infrastructure as code (Terraform, Kubernetes, Helm) and the CI/CD, monitoring, and observability that supports it.
• Define and uphold SLAs for the platform; lead incident response; drive cost, performance, and reliability improvements.
• Partner with Architecture, Security, DevOps, Cloud Engineering, and Networks to meet enterprise and regulatory standards.
• Architecting AI platforms at scale — Claude, GitHub, Azure AI Foundry, and Databricks Mosaic AI

Skills

Leadership

Data architecture

Cloud experience

Python/PySpark

Team mentoring

Education

Bachelor’s degree in Computer Science or related

Tools

Azure Databricks

Power BI

Terraform

Kubernetes

Python

SQL

Unity Catalog

ADLS Gen2

Git

Job description

Position Purpose

Lead the technical direction of StoneX's Azure data platform. You will own the platform architecture of our Lakehouse and BI semantic layer, guide a team of four engineers, and work directly with product, business, and technical stakeholders to deliver platform initiatives. This is a hands‑on technical lead role — you set direction, review designs, and solve the hardest problems.

Overview

Lead the technical direction of StoneX's Azure data platform. You will own the platform architecture of our Lakehouse and BI semantic layer, guide a team of four engineers, and work directly with product, business, and technical stakeholders to deliver platform initiatives. This is a hands‑on technical lead role — you set direction, review designs, and solve the hardest problems.

Primary Responsibilities

• Own the architecture of the Azure data platform end-to-end — Databricks Lakehouse, Fabric, and the BI semantic layer (Power BI, SSAS/AAS).
• Engage directly with product, business, and technical stakeholders to identify, scope, and deliver data platform initiatives.
• Lead delivery across a team of four engineers — break down work, unblock, mentor, and raise the engineering bar through design and code reviews.
• Set standards for data modeling, PySpark/SQL quality, semantic-model design, testing, CI/CD, and production readiness.
• Own platform infrastructure as code (Terraform, Kubernetes, Helm) and the CI/CD, monitoring, and observability that supports it.
• Define and uphold SLAs for the platform; lead incident response; drive cost, performance, and reliability improvements.
• Partner with Architecture, Security, DevOps, Cloud Engineering, and Networks to meet enterprise and regulatory standards.
• Architecting AI platforms at scale — Claude, GitHub, Azure AI Foundry, and Databricks Mosaic AI

Required

Qualifications

• 8+ years of data engineering / data platform experience, including 2–3 years as a technical lead owning architecture and guiding engineers.
• Deep, hands‑on expertise in Azure Databricks — Delta Lake, PySpark, Unity Catalog, cluster and performance tuning at scale.
• Strong experience with Microsoft Fabric and ADLS Gen2.
• Strong Python (PySpark) and SQL; proficient in at least one additional language (Java, C#, or similar).
• Hands‑on with Docker, Git, Kubernetes, and IaC (Terraform, Ansible).
• Solid competencies across Azure cloud networking, identity management, storage, and compute.
• Track record of architecture and design authority on non‑trivial platforms.
• Bachelor’s degree in Computer Science, Mathematics, Electrical Engineering, or related discipline — or equivalent experience.

Preferred

• Financial services or other regulated‑industry experience.
• Production experience with Microsoft Fabric (OneLake, Direct Lake).
• Data governance experience — Unity Catalog, lineage, data contracts, cost governance / FinOps on Databricks.
• Experience designing and operating BI solutions on Power BI and SSAS - dataset design, DAX, RLS, capacity and refresh.
• Familiarity with Kimball modeling patterns.

Working Environment

• Hybrid, Bangalore (4 days).
• Dynamic, time‑sensitive environment.
• Travel as required.