Databricks Solution Architect

Prism IT Global; India; On-site; INR 14,354,067 - 21,052,631; Full time

Job summary

Prism IT Global is seeking a Senior Databricks Solutions Architect (RSA) to independently lead complex customer engagements, bridging hands-on data engineering with strategic technical leadership. You will act as a trusted advisor, proposing scalable Databricks Lakehouse solutions and driving value for our clients across the US and India from a remote setup.

In this role you will guide architecture and optimization of large Spark workloads, mentor engineers in PySpark and Delta Lake, design

Qualifications

• 5–10 years in data engineering or analytics solution delivery.
• 3+ years hands-on Databricks experience including job optimization and workload governance.
• Deep understanding of Spark internals, PySpark, and DBSQL performance tuning.
• Strong knowledge of Delta Lake, Structured Streaming, and cloud infra.
• Autonomy: solve complex problems with minimal oversight.
• Excellent ability to communicate technical concepts to business leaders.

Responsibilities

• Lead engagements from discovery to delivery with full ownership and accountability.
• Architect, implement, and optimize large-scale Spark/Databricks workloads focusing on scalability and cost-efficiency.
• Apply expert-level Spark fundamentals to troubleshoot and tune distributed data jobs and SQL workloads.
• Design and execute PoCs and workshops to demonstrate solution vision and inspire customer confidence.
• Act as a technical advocate for customers, anticipating issues and applying data-driven solutions.
• Collaborate with product and engineering teams to improve customer experience and platform features.
• Mentor junior engineers and promote best practices in PySpark, Databricks, and Lakehouse design.

Skills

Databricks

Spark

PySpark

Delta Lake

Autonomy

Technical communication

Tools

Databricks SQL

DLT

Unity Catalog

Cloud infrastructure

Job description

Role: Senior Databricks Solutions Architect (RSA)

Experience: 15+ Years

Location: US and India Remote

Role Overview

We are seeking a Senior Data Solutions Consultant with deep expertise in Apache Spark and Databricks. This role requires a decisive, agentic-forward approach to problem-solving. You will independently lead complex customer engagements, bridging hands-on data engineering excellence with strategic technical leadership. As a trusted advisor, you will proactively build and implement solutions that unlock significant value for our customers.

Key Responsibilities

• Customer Leadership: Lead engagements from discovery to delivery with full ownership and accountability.
• Architecture & Optimization: Architect, implement, and optimize large-scale Spark/Databricks workloads focusing on scalability and cost-efficiency.
• Spark Expertise: Apply expert-level Spark fundamentals to troubleshoot and tune distributed data jobs and SQL workloads.
• Proactive Delivery: Design and execute PoCs and workshops to demonstrate solution vision and inspire customer confidence.
• Strategic Advocacy: Act as a technical advocate for customers, anticipating issues and applying creative, data-driven solutions.
• Cross-functional Partnership: Collaborate with product and engineering teams to improve customer experience and platform features.
• Mentorship: Champion best practices in PySpark, Databricks, and Lakehouse design while mentoring junior engineers.

Required Qualifications

• Experience: 5–10 years in data engineering or analytics solution delivery.
• Databricks Mastery: 3+ years of hands-on expertise, including job optimization, debugging, and workload governance.
• Technical Depth: Deep understanding of Spark Internals, PySpark, and Databricks SQL (DBSQL) performance tuning.
• Modern Lakehouse: Strong knowledge of Delta Lake, Structured Streaming, and cloud infrastructure.
• Autonomy: Proven ability to identify and solve complex technical problems with minimal oversight.
• Communication: Exceptional skills to simplify technical complexity for business leaders.

Preferred Qualifications

• Certifications: Databricks Certified Data Engineer Professional.
• Advanced Skills: Experience with Delta Live Tables (DLT) and Unity Catalog (UC).
• Consulting Background: Experience in large-scale data migration or AI-assisted analytics in enterprise environments.