Data Architect - Databricks

L&T Technology Services; Bengaluru; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

L&T Technology Services Bengaluru is seeking a senior data architect with deep hands-on Databricks expertise to lead lakehouse and medallion architecture initiatives. You will design scalable batch and streaming pipelines using PySpark and Delta Lake, implement data governance, and enable secure data sharing across platforms.

The role requires 12–20 years of experience, strong cloud skills (Azure/AWS/GCP), and the ability to engage in pre-sales, solution design, and client discussions, with a

Qualifications

• Strong hands-on experience in Databricks Lakehouse and Medallion Architecture (Bronze, Silver, Gold).
• Experience with Databricks services like ZeroBus, Lakebridge, Lakebase, Unity Catalog and DLT.
• Design and implement scalable batch and streaming data pipelines (PySpark, Delta Lake).
• Strong background in developing reusable accelerators and frameworks.
• Experience in data governance, quality, and lineage (Unity Catalog, Great Expectations).
• Exposure to event-driven architectures and real-time ingestion (Kafka/Event Hubs).
• Strong understanding of manufacturing domain, including IoT/Sensor data ingestion (SCADA, OPC-UA, MQTT) into Databricks.
• Data sharing and collaboration using Delta Sharing and secure data exchange mechanisms.
• Proficiency in cloud platforms (Azure, AWS, or GCP) with strong experience in data storage, integration, and analytics services.
• Ability to support pre-sales, solution design, and client architecture discussions.
• Strong focus on performance optimization, scalability, and cost efficiency.

Skills

Databricks Lakehouse

Medallion Architecture

Delta Live Tables

Unity Catalog

PySpark

Delta Lake

Data Governance

Kafka

MQTT

OPC-UA

Azure

AWS

GCP

Great Expectations

Tools

Kafka

MQTT

OPC-UA

Job description

Job Description

Exp – 12-20 years

• Strong hands-on experience in Databricks Lakehouse & Medallion Architecture (Bronze, Silver, Gold)
• Experience with modern Databricks services: ZeroBus, Lakebridge, Lakebase, Unity Catalog, DLT
• Ability to design and implement scalable batch & streaming data pipelines (PySpark, Delta Lake)
• Strong background in developing reusable accelerators and frameworks
• Experience in data governance, quality, and lineage (Unity Catalog, Great Expectations)
• Exposure to event-driven architectures and real-time ingestion (Kafka/Event Hubs)
• Strong understanding of manufacturing domain, including IoT/Sensor data ingestion (SCADA, OPC-UA, MQTT) into Databricks
• Experience in data sharing and collaboration using Delta Sharing and secure data exchange mechanisms
• Proficiency in cloud platforms (Azure, AWS, or GCP) with strong experience in data storage, integration, and analytics services
• Ability to support pre-sales, solution design, and client architecture discussions
• Strong focus on performance optimization, scalability, and cost efficiency

Role will be discussed during interviews. *