Data Architect – Databricks

Wavicle Data Solutions; Chennai District; On-site; INR 2,000,000 - 3,000,000; Full time

Job summary

A data solutions firm is looking for an experienced Senior Databricks Architect to lead the design and delivery of solutions on the Databricks platform. The position involves defining enterprise-grade architectures and mentoring teams while collaborating with clients. Key requirements include strong experience in Databricks services, cloud integrations, and a proven track record in presales and solution consulting. Ideal candidates will have over 12 years of experience in data engineering, with significant hands-on experience with Databricks and major cloud platforms.

Qualifications

• 12+ years in Data Engineering/Architecture, with at least 4+ years in Databricks.
• Strong experience in performance optimisation techniques.

Responsibilities

• Define and implement enterprise-grade architectures using Databricks tools.
• Lead Databricks project delivery from assessment to governance.
• Integrate Databricks with various cloud-native services.
• Mentor teams on Databricks best practices and cost optimisation.

Skills

Advanced knowledge of Databricks services

Strong experience in PySpark

Extensive hands-on experience with AWS

Familiarity with cloud-native security

Proven track record in supporting presales activities

Expertise in data governance frameworks

Job description

Role overview

We are seeking an experienced Senior Databricks Architect to lead the design and delivery of comprehensive solutions on the Databricks platform. The ideal candidate will possess deep expertise in modern data architecture, hands‑on experience with the latest Databricks services, and a proven track record in presales support, solution consulting, and large‑scale implementations. This role requires strong collaboration with clients and internal teams to deliver scalable, secure, and optimised data solutions across one or more major cloud ecosystems (AWS, Azure, or GCP).

Key responsibilities

• Define and implement enterprise‑grade architectures leveraging Databricks Lakehouse, Delta Lake, and advanced features like Unity Catalog, Delta Live Tables, and MLflow.
• Develop reference architectures and best practices for data engineering, analytics, and AI/ML workloads.
• Lead the full lifecycle delivery of Databricks projects, including assessment, design, migration, performance optimisation, and governance.
• Integrate Databricks with cloud‑native services (AWS, Azure, or GCP) for networking, security, and compliance.
• Partner with sales teams to provide technical expertise during RFP responses, client workshops, and proof‑of‑concept (POC) engagements.
• Build solution proposals, effort estimates, and architecture diagrams for pursuits.
• Guide teams on implementing Medallion architecture (Bronze, Silver, Gold layers) and advanced ETL/ELT patterns.
• Mentor engineers on Databricks best practices, performance tuning, and cost optimisation.
• Stay current with the latest Databricks capabilities and cloud ecosystem advancements.
• Contribute to internal accelerators, reusable frameworks, and Go‑To‑Market strategies.

Required skills & qualifications

• Advanced knowledge of Databricks services, including Delta Lake, Unity Catalog, Delta Live Tables, MLflow, and Databricks SQL.
• Strong experience in PySpark, Spark SQL, and performance optimisation techniques.
• Extensive hands‑on experience with AWS, Azure, or GCP, including integration with Databricks.
• Familiarity with cloud‑native security, IAM, networking, and cost management.
• Proven track record in supporting presales activities, building proposals, and delivering client presentations.
• Expertise in data governance frameworks, security practices, and compliance standards.

Preferred skills/experience

• Experience with AI/ML workloads on Databricks.
• Certifications in Databricks and one major cloud platform (AWS/Azure).

Experience: 12+ years in Data Engineering/Architecture, with at least 4+ years in Databricks