Solutions Architect

Celebal Technologies; Bengaluru; On-site; INR 2,000,000 - 2,500,000; Full time

Job summary

Celebal Technologies is seeking a Senior Solution Architect to join the Databricks Practice in Bengaluru, India. In this pivotal role, you will engage with enterprise customers to shape their data modernization journeys, focusing on designing and delivering scalable Lakehouse solutions. The ideal candidate has over 8 years of experience in data engineering, with significant expertise in Databricks, and excellent communication skills to advise and collaborate with stakeholders across various levels. Immediate joiners preferred.

Qualifications

• 8+ years in data engineering or data platform architecture.
• 3+ years hands-on experience on Databricks in consulting capacity.
• Strong understanding of Databricks Data Intelligence Platform.

Responsibilities

• Lead pre-sales and delivery architecture conversations with customers.
• Design end-to-end Databricks Lakehouse architectures.
• Advise on the adoption of advanced Databricks features.

Skills

Data engineering

Databricks

SQL

PySpark

Cloud fluency (AWS/Azure/GCP)

Stakeholder management

Tools

Delta Lake

Unity Catalog

Terraform

Job description

Solution Architect – Databricks Practice

Designation – Solution Architect – Databricks Practice

Experience – 8–14 years

Job Summary

We are seeking a Senior Solution Architect to join our Databricks Practice and play a pivotal role in shaping data modernization journeys for enterprise customers. This is a customer-facing, consulting-oriented role where you will engage with CDOs, Data Architects, and Engineering leaders to design and deliver scalable, future-ready Lakehouse solutions on the Databricks Data Intelligence Platform.

You will be the trusted technical advisor — translating business problems into architectural blueprints, guiding customers through EDW modernization programs, and championing the adoption of Databricks’ most advanced capabilities including Lakeflow Declarative Pipelines (LDP), Lakeflow Connect, Serverless Compute, Unity Catalog, and AI/BI workloads.

Job Description

• Lead pre-sales and delivery architecture conversations with enterprise customers, owning the technical narrative from discovery through solution design and through to implementation oversight.
• Design end-to-end Databricks Lakehouse architectures spanning ingestion, transformation, governance, ML, and consumption layers — aligned to Medallion Architecture principles.
• Drive EDW modernization engagements, including migration strategies from legacy platforms (Teradata, Netezza, Oracle, SAS, Greenplum, Synapse, Snowflake, on-prem Hadoop) to Databricks, with clear wave planning, risk mitigation, and TCO/ROI articulation.
• Advise customers on the adoption of advanced Databricks features, examples:
  • Lakeflow Declarative Pipelines (LDP / formerly DLT) for production-grade ETL with built-in data quality and lineage
  • Lakeflow Connect for managed ingestion from SaaS, databases, and file sources
  • Serverless Compute (SQL warehouses, jobs, notebooks) for cost and operational efficiency
  • Unity Catalog for unified governance, lineage, and fine-grained access control
  • Databricks Asset Bundles (DAB) for CI/CD and environment promotion
  • MLflow, Model Serving, and Mosaic AI for ML and GenAI workloads
• Conduct architecture deep-dives, PoCs, and workshops — including cost modeling, performance benchmarking, DR design, and platform sizing.
• Produce client-ready deliverables: HLD/LLD documents, reference architectures, migration roadmaps, runbooks, and executive presentations.
• Partner with sales, delivery, and Databricks field teams to shape proposals, SoWs, and bid responses.
• Stay ahead of the Databricks product roadmap and evangelize new capabilities internally and with customers.
• Mentor data engineers, platform engineers, and junior architects on Databricks best practices.

Must-Have

• 8+ years in data engineering / data platform architecture, with 3+ years hands‑on on Databricks in a customer‑facing or consulting capacity.
• Demonstrated experience leading at least 2–3 large‑scale EDW modernization or Lakehouse migration programs end‑to‑end.
• Strong fundamentals‑level understanding of the Databricks Data Intelligence Platform, including:
  • Delta Lake internals (transaction log, OPTIMIZE, Z‑ORDER, Liquid Clustering, Deletion Vectors, Predictive Optimization) Spark execution model, Photon, cluster sizing, and performance tuning
  • Unity Catalog object model (metastore, catalogs, schemas, volumes, external locations, storage credentials) Workspace, account, and identity architecture across AWS / Azure / GCP
  • Hands‑on experience designing and deploying Lakeflow Declarative Pipelines, Lakeflow Connect, and Serverless workloads in production.
• Solid grounding in Medallion Architecture, dimensional modeling, and data governance frameworks.
• Strong SQL and PySpark skills; comfort reading and reasoning about Spark execution plans.
• Cloud fluency on at least one of Azure, AWS, or GCP — including networking, IAM, and storage layers (ADLS Gen2 / S3 / GCS).
• Excellent communication and stakeholder management skills — able to engage equally with engineers and C‑suite.
• Willing to travel and stay overseas for solutioning and delivering projects.

Good to Have

• Databricks certifications: Certified Data Engineer Professional, Certified Machine Learning Professional, or Databricks Certified Solutions Architect Professional.
• Experience with DR architectures (Delta Deep Clone, cross‑region replication, RPO/RTO design).
• Exposure to MLOps / GenAI patterns on Databricks (MLflow, Model Serving, Vector Search, Mosaic AI Agent Framework).
• Familiarity with legacy ETL/ELT platforms (Informatica, ODI, SAS DI, DataStage, Talend) for migration credibility.
• Experience with Terraform / Databricks Asset Bundles for IaC and CI/CD.
• Working knowledge of Immuta, Collibra, Purview, or Alation for governance integration.
• Industry depth in BFSI, Insurance, Retail, Manufacturing, or Healthcare.

What Success Looks Like (First 6–12 Months)

• Own the architecture for at least 2 strategic customer engagements from discovery to go‑live.
• Establish yourself as the go‑to advisor on advanced Databricks adoption (LDP, Lakeflow Connect, Serverless) within the practice.
• Contribute to reusable accelerators, reference architectures, and migration playbooks that scale across the practice.
• Build strong working relationships with Databricks field teams and contribute to joint pursuits.

Immediate Joiners Preferred