Databricks Solution Architect (Forward Deployed Engineer)

Unison Group; Chennai District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Unison Group is seeking a hands-on Databricks architect to design, implement, and optimize Delta Lakehouse-based data and AI solutions for enterprise customers in Chennai. The role emphasizes ownership of end-to-end delivery, performance tuning, and governance across data engineering, ML, and DevOps.

You will configure Databricks Workspaces, Unity Catalog, and pipelines, automate infrastructure with Terraform and CI/CD, and mentor engineering teams on best practices for scalable, secure data

Qualifications

• Hands-on Databricks experience with workspace setup, notebooks, clusters, and job orchestration.
• Deep knowledge of Delta Lake, DLT, Unity Catalog, and SQL Warehouses.
• Proficiency in Python or Scala for data engineering and ML workflows.

Responsibilities

• Design and implement scalable data pipelines using Delta Live Tables, Spark SQL, Python, or Scala.
• Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability.
• Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure environments.

Skills

Databricks expertise

Delta Lake/Delta Lakehouse

Delta Live Tables (DLT)

Python

Scala

SQL

Cloud platforms (AWS/Azure/GCP)

Terraform / DevOps / MLOps

Observability & monitoring

Data governance (Unity Catalog)

Education

Bachelor's degree in Computer Science or related

Tools

Terraform

Git

CI/CD

Splunk

Prometheus

CloudWatch

MLflow

DBRX

Mosaic AI

Job description

• We?re seeking a hands-on experience in Databricks with deep technical expertise in building and optimizing Lakehouse-based data and AI solutions.
• In this role, you?ll design, develop, and operationalize Delta Lakehouse architectures using Databricks, driving real-world outcomes for enterprise customers. You?ll take ownership of implementation tasks, lead technical delivery, and mentor engineering teams in best practices across data engineering, governance, and AI.

Key Responsibilities

• Design and implement scalable data pipelines using Delta Live Tables (DLT), Spark SQL, Python, or Scala.
• Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability.
• Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments.
• Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines.
• Implement observability, cost optimization, and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch.
• Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI.

Requirements

Required Skills & Experience

• Strong hands-on experience with Databricks, including workspace setup, notebooks, clusters, and job orchestration.
• Expertise in Delta Lake, DLT, Unity Catalog, and SQL Warehouses.
• Proficiency in Python or Scala for data engineering and ML workflows.
• Strong understanding of AWS, Azure, or GCP cloud ecosystems.
• Experience with Terraform automation, DevOps, and MLOps practices.

Familiarity with monitoring and governance frameworks for large-scale data platforms.