Solution Architect - Databricks (India)

Thakral One; Maharashtra; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Thakral One seeks a Solution Architect – Databricks to design enterprise-grade data solutions on Azure Databricks. You will lead a large data modernization program for a telecom client, architecting migration strategies, governance, and a lakehouse transformation with minimal legacy refactoring.

You will drive end-to-end data pipelines, establish robust governance, and guide teams in PySpark, Spark SQL, and Delta Lake, ensuring scalable analytics and reliable operations across multiple cloud

Qualifications

• 8+ years in data engineering and architecture roles.
• 4+ years hands-on with Databricks (Delta Lake, Spark, Unity Catalog).
• 3+ years in Azure services (ADLS Gen2, Azure DevOps, ADF).
• Proven experience in large-scale data migration projects.

Responsibilities

• Design end-to-end data pipelines on Azure Databricks with Medallion Architecture.
• Lead hybrid orchestration using DLT-Lakeflow for CDC ingestion and meta-driven layers.
• Define Unity Catalog governance for data access, security, and lineage.
• Architect Databricks Workflows and complex EDW migration patterns.
• Guide on schema evolution, data quality, and reconciliation strategies.

Skills

Databricks

PySpark

Spark SQL

Azure

Data Architecture

Medallion Architecture

Data Migration

Git & CI/CD

Tools

Delta Lake

DLT

Lakeflow

Unity Catalog

Databricks Workflows

Git

CI/CD

Azure Data Factory

ADLS Gen2

Job description

As a Solution Architect – Databricks, you will design and deliver enterprise‑grade data solutions on Azure Databricks, leading a large‑scale data modernisation programme for a telecommunications client. You will architect migration strategies, define governance frameworks, and provide technical leadership to ensure seamless transformation from legacy data warehousing systems to a modern lakehouse architecture.

What You’ll Do and How You’ll Succeed

• Design and architect end‑to‑end data pipelines using Azure Databricks with Medallion Architecture (Bronze Silver Gold Semantic layers).
• Lead hybrid orchestration frameworks combining DLT‑Lakeflow for CDC ingestion and metadata‑driven frameworks for transformation layers.
• Define and implement Unity Catalog governance strategies for data access, security, and lineage.
• Architect Databricks Workflows for job scheduling, dependency management, and replacing legacy Control‑M orchestration.
• Design SCD Type 2 implementations and complex transformation patterns for EDW migration.

Technical Leadership

• Provide guidance on PySpark and Spark SQL best practices for large‑scale data processing.
• Define coding standards, modular notebook organisation, and configuration‑driven development approaches.
• Lead technical decisions on schema evolution, data quality frameworks, and reconciliation strategies.
• Recommend approaches for surrogate key generation, batch control mechanisms, and selective reprocessing.

Migration & Modernisation

• Architect migration strategies from legacy systems (ODS, EDW, Informatica PowerCenter) to Azure Databricks lakehouse.
• Design CDC ingestion patterns using Oracle GoldenGate and Informatica IDR integration.
• Define approaches for historical data migration and parallel run strategies.
• Ensure minimal refactoring of existing SQL/PySpark code through metadata‑driven frameworks.

Operational Excellence

• Design solutions supporting BAU operations including manual data patching, hold/resume/skip controls, and entity‑level reprocessing.
• Architect job/cycle/batch auditing frameworks aligned with existing operational patterns.
• Define monitoring, alerting, and logging strategies across all pipeline layers.
• Ensure solutions support targeted fixes without requiring full refreshes.

Stakeholder Engagement

• Collaborate with Amdocs and customer architecture teams on design approvals and technical alignment.
• Participate in discovery sessions for EDW entities (DDS, SDS, DNF).
• Present technical solutions and trade‑off analyses to leadership and steering committees.
• Work closely with delivery teams to translate designs into implementable solutions.

We’d Love to Hear From You If…

Experience

• You have 8+ years in data engineering and architecture roles.
• You have 4+ years of hands‑on experience with Databricks (Delta Lake, Spark, Unity Catalog).
• You have 3+ years of experience with Azure cloud services (ADLS Gen2, Azure DevOps, Azure Data Factory).
• You have proven experience in large‑scale data migration projects, ideally EDW modernisation.

Technical Expertise

• You are expert in Azure Databricks (Delta Lake, DLT/Lakeflow, Databricks Workflows, Unity Catalog).
• You are proficient in PySpark and Spark SQL for optimised transformations.
• You have hands‑on experience with Medallion Architecture (Bronze/Silver/Gold).
• You are skilled in dimensional modelling, SCD implementations, and surrogate key strategies.
• You are experienced in metadata‑driven ETL/ELT frameworks.
• You have worked with CDC tools such as Oracle GoldenGate or Kafka.
• You are familiar with data quality frameworks, reconciliation, and exception handling.
• You are experienced with Git, CI/CD pipelines, and Databricks Asset Bundles (DAB).

Ways of Working

• You have strong analytical and problem‑solving abilities.
• You communicate complex technical concepts clearly to diverse audiences.
• You collaborate effectively across distributed teams and time zones.
• You mentor and guide junior team members.
• You document design decisions thoroughly (HLSD, LLD).
• You bring a collaborative mindset when working with customer stakeholders.

Certifications (Preferred)

• Databricks Certified Solution Architect Professional
• Microsoft Azure Solutions Architect Expert (AZ‑305)

---

Who We Are

Thakral One is a consulting and technology services company headquartered in Singapore, with a pan‑Asian presence. We focus primarily around technology‑driven consulting, adoption of value‑added bespoke solutions, enabling enhanced decision support through data analytics, and embracing possibilities in the cloud. We are heavily inclined towards building capabilities collaboratively with clients and believe strongly in improving grounded and practical outcomes.

This approach is possible through our partnership with leading global technology providers and internal R&D teams. Our clients come from Financial Services, Banking, Telco, Government, Healthcare, and Consumer‑oriented organisations.