Solution Architect – Databricks

LumenData

Bengaluru

On-site

INR 3,000,000 - 6,000,000

Full time

6 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

LumenData in Bengaluru, India seeks a highly experienced Senior FDE / Resident Solution Architect – Databricks to design, implement, and optimize scalable data engineering and analytics solutions on the Databricks platform.

The role requires hands-on Databricks, Spark, PySpark, and cloud platform expertise, with strong leadership in architecture discussions, performance tuning, and production deployments.

Qualifications

10+ years of overall consulting / technology experience.
7+ years in Data Engineering, Big Data, or Analytics.
Strong hands-on Databricks experience.
Minimum 6-8 end-to-end Databricks projects delivered.

Responsibilities

Design and implement scalable Databricks Lakehouse solutions.
Work with customers to capture requirements and define architecture.
Build and optimize data pipelines using Databricks, Spark, PySpark, SQL, and Delta Lake.
Provide guidance on Databricks architecture, standards, and best practices.
Troubleshoot Spark/Databricks performance and optimize workloads.
Support CI/CD processes for Databricks deployments and DevOps integration.
Mentor customer teams and act as a technical advisor.

Skills

Senior-level consulting experience

Databricks expertise

Spark / PySpark development

Data engineering architecture

Cloud platform knowledge

Client-facing / advisory

Delata Lake / Unity Catalog

CI/CD / DevOps basics

Performance optimization

End-to-end data pipelines

Tools

Databricks

Spark

PySpark

Delta Lake

Unity Catalog

Workflows

Auto Loader

Databricks SQL

Terraform

Job description

10+ years of overall consulting / technology experience
7+ years of experience in Data Engineering, Data Platforms, Big Data, or Analytics
Strong hands-on Databricks experience
Minimum 6-8 end-to-end Databricks project implementations

Role Overview

We are looking for a highly experienced Senior FDE / Resident Solution Architect – Databricks who can work closely with enterprise customers to design, develop, optimize, and support scalable data engineering and analytics solutions on the Databricks platform.

The consultant should have strong hands-on expertise in Databricks, Apache Spark, PySpark, distributed computing, cloud platforms, performance optimization, and solution architecture.

This is a highly technical and client-facing role. The consultant should be able to independently drive architecture discussions, troubleshoot complex Databricks/Spark issues, provide implementation guidance, and support production deployments.

Key Responsibilities

Design and implement scalable Databricks Lakehouse solutions.
Work directly with customers to understand technical and business requirements.
Define end-to-end data engineering and platform architecture.
Build and optimize data pipelines using Databricks, Spark, PySpark, SQL, and Delta Lake.
Design batch and streaming data-processing solutions.
Provide technical guidance on Databricks architecture, development standards, and best practices.
Troubleshoot complex Spark and Databricks performance issues.
Optimize workloads for performance, scalability, reliability, and cost.
Support enterprise Databricks platform implementation and modernization initiatives.
Work with Databricks capabilities such as Delta Lake, Unity Catalog, Workflows, Auto Loader, Databricks SQL, Lakeflow/DLT, and Serverless.
Design and support CI/CD processes for Databricks deployments.
Work with DevOps and Infrastructure-as-Code tools such as Git, Terraform, Azure DevOps, GitHub, GitLab, or Jenkins.
Provide guidance on Databricks security, governance, access control, and Unity Catalog.
Support customer teams with architecture reviews, code reviews, troubleshooting, and technical mentoring.
Work as a trusted technical advisor to customer architects, engineering teams, and stakeholders.

Mandatory Skills

Databricks