Databricks Architect - Wishtree Technologies

OpenTalent; India; On-site; INR 700,000 - 1,100,000; Full time

Job summary

OpenTalent is seeking an experienced Databricks Architect to design scalable data solutions and provide technical leadership across Databricks projects. The role covers end-to-end Databricks/Lakehouse architecture, Bronze-to-Gold data layers, and governance across platforms.

You will work closely with stakeholders to translate requirements into robust data pipelines, ETL/ELT processes, and migration plans, leveraging Delta Lake, Spark, and Databricks SQL within AWS/Azure/GCP environments.

Qualifications

• Strong hands-on experience with Databricks and Apache Spark.
• Deep understanding of Data Engineering, Data Warehousing, ETL/ELT, and Lakehouse architecture.
• Strong knowledge of Delta Lake, Databricks SQL, Unity Catalog, and data governance.
• Experience with AWS, Azure, or GCP cloud platforms.
• Experience designing and leading large-scale data migration / modernization projects.
• Strong communication and stakeholder-management skills.
• Databricks certification is an advantage.

Responsibilities

• Design and implement end-to-end Databricks/Lakehouse architectures.
• Define data architecture across Bronze, Silver, and Gold layers.
• Design solutions using Delta Lake, Databricks SQL, Apache Spark, and Unity Catalog.
• Work with stakeholders to translate requirements into scalable solutions.
• Provide architectural guidance for data migration, ETL/ELT, data pipelines, and data transformation.
• Collaborate with Data Engineers, Cloud Architects, and business stakeholders.
• Ensure solutions meet performance, scalability, security, governance, and cost optimization.

Skills

Databricks

Apache Spark

Data Engineering

Lakehouse architecture

ETL/ELT

Data governance

Stakeholder management

Technical leadership

Tools

Delta Lake

Unity Catalog

Databricks SQL

AWS

Azure

GCP

Job description

We are looking for an experienced Databricks Architect with strong expertise in the Databricks ecosystem, Data Engineering, and cloud data architecture. The candidate will be responsible for designing scalable data solutions and providing technical leadership across Databricks projects.

Key Responsibilities:

• Design and implement end-to-end Databricks/Lakehouse architectures .
• Define data architecture across Bronze, Silver, and Gold layers .
• Design solutions using Delta Lake, Databricks SQL, Apache Spark, and Unity Catalog .
• Work with stakeholders to understand business and technical requirements and translate them into scalable solutions.
• Provide architectural guidance for data migration, ETL/ELT, data pipelines, and data transformation .
• Collaborate with Data Engineers, Cloud Architects, and business stakeholders.
• Ensure solutions meet requirements for performance, scalability, security, governance, and cost optimization .
• Provide technical leadership, best practices, and architectural recommendations.

Key Requirements:

• Strong hands-on experience with Databricks and Apache Spark .
• Deep understanding of Data Engineering, Data Warehousing, ETL/ELT, and Lakehouse architecture .
• Strong knowledge of Delta Lake, Databricks SQL, Unity Catalog, and data governance .
• Experience with AWS, Azure, or GCP cloud platforms.
• Experience designing and leading large-scale data migration / modernization projects .
• Strong communication and stakeholder-management skills.
• Databricks certification is an advantage.