Solution Architect

Estuate Software; Bengaluru; Hybrid; INR 3,500,000 - 7,000,000; Full time

Job summary

Estuate Software in Bengaluru seeks a Senior Solution Architect for Databricks with 10+ years in IT and 7+ in data engineering. You will lead end-to-end Databricks Lakehouse implementations, design architectures, and collaborate with clients.

You will optimize Spark performance, oversee multi-cloud deployments (AWS/Azure/GCP), mentor teams, conduct architecture workshops, and ensure governance and security. Strong knowledge of Delta Lake, Unity Catalog, Workflows, and MLOps basics is preferred.

Qualifications

• 10+ years overall IT experience with at least 7+ years in Data Eng/Big Data/Analytics.
• Deep Databricks hands-on architecture and development experience.
• 6-8+ end-to-end Databricks implementations demonstrated.
• Strong Spark/PySpark knowledge including performance tuning.
• Extensive cloud exposure (AWS/Azure/GCP) with another cloud familiarity.
• Client-facing workshops, requirements gathering and solution design.

Responsibilities

• Lead enterprise Databricks implementations from architecture to deployment.
• Design secure, governed multi-cloud Lakehouse architectures.
• Drive performance optimization for Spark/Delta and cost efficiency.
• Conduct architecture workshops and present solutions to clients.
• Mentor teams and ensure successful delivery of projects.

Skills

Databricks architecture

Spark/PySpark

Data engineering

Cloud -- multi cloud

Client-facing leadership

Performance optimization

MLOps basics

Tools

Databricks

Delta Lake

Unity Catalog

Workflows

Auto Loader

DLT/Lakeflow

Photon

Job description

Solution Architect Databricks | Concise Requirement

• Experience: 10+ years overall; 7+ years in Data Engineering/Big Data/Analytics.
• Databricks: Strong hands-on architecture/development experience with 6-8+ end-to-end implementations.
• Core: Databricks Lakehouse, Delta Lake, Unity Catalog, Workflows, Auto Loader, Databricks SQL, DLT/Lakeflow, Serverless.
• Spark: Deep Apache Spark/PySpark expertise, including internals, performance tuning, partitioning, shuffle, skew, joins, AQE and Catalyst.
• Data Engineering: ETL/ELT, batch & streaming, data pipelines, modeling, SQL, Python/PySpark.
• Cloud: Deep expertise in AWS/Azure/GCP + working knowledge of a second cloud.
• DevOps: Git, CI/CD, Terraform, Databricks Asset Bundles, Azure DevOps/GitHub/GitLab/Jenkins.
• Performance: Spark/Delta optimization, Photon, cluster sizing, autoscaling and cost optimization.
• MLOps: Working knowledge of MLflow, model registry and deployment.
• Architecture: Enterprise Databricks implementation, migration/modernization, security, governance and multi-cloud.
• Client-facing: Architecture workshops, requirement gathering, solution design, presentations, troubleshooting and technical leadership.
• Certification: Databricks Certified Data Engineer Professional - mandatory/highly preferred.
• Ideal: Senior hands‑on consultant who can independently operate as a Solution Architect, not someone with basic notebook/ETL exposure.