Databricks Architect - Data Engineering

BOT Consulting; Jaipur; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

BOT Consulting seeks an experienced Databricks Architect Practice Lead to guide enterprise Data & AI initiatives and define scalable data platform architectures.

Responsibilities include designing lakehouse architectures, pipelines, and governance across AWS/Azure/GCP, while mentoring teams and supporting pre-sales with architecture workshops.

Qualifications

• Bachelor's degree in a related field.
• 7+ years in Data Engineering, Data Warehousing, BI, Analytics.
• 3+ years in Data Architecture or Solution Architecture.
• 3+ years hands-on Databricks and modern data platforms.

Responsibilities

• Design, develop, and optimize scalable data lakehouse architectures using Databricks.
• Define enterprise data architecture standards, frameworks, and best practices.
• Architect and implement batch and real-time data pipelines for analytics, AI, and reporting workloads.
• Drive modernization and migration strategies from legacy data platforms to Databricks.
• Ensure data integrity, governance, security, scalability, and performance across the platform.

Skills

Databricks Lakehouse

Apache Spark

Delta Lake

Data Modeling

ETL/ELT

Data Governance

Cloud Platforms (AWS/Azure/GCP)

SQL

Python

CI/CD/DevOps

Stakeholder management

Education

Bachelor's Degree in Computer Science / Information Systems / Engineering / Mathematics

Tools

Snowflake

Kafka

Airflow

Power BI

Tableau

Job description

About The Job

We are seeking an experienced Databricks Architect Practice Lead to lead enterprise Data & AI initiatives, define scalable modern data platform architectures, and drive practice growth across client engagements.

Job Title : Databricks Architect Practice Lead

Experience : 8-12 Years

Shift Timing : EMEA Shift

Key Responsibilities

Architecture & Solution Design

• Design, develop, and optimize scalable data lakehouse architectures using Databricks
• Define enterprise data architecture standards, frameworks, and best practices
• Architect and implement batch and real-time data pipelines for analytics, AI, and reporting workloads
• Drive modernization and migration strategies from legacy data platforms to Databricks
• Ensure data integrity, governance, security, scalability, and performance across the platform

Practice Leadership

• Lead and grow the Databricks practice by defining capabilities, accelerators, reusable frameworks, and delivery standards
• Mentor architects, engineers, and technical teams on Databricks and cloud-native best practices
• Support pre-sales activities including solutioning, estimations, proposals, client presentations, and architecture workshops
• Build strong relationships with stakeholders, leadership teams, and clients across engagements
• Act as the primary technical advisor and escalation point for Databricks-related initiatives

Data Engineering & Cloud Platforms

• Design and implement ETL/ELT frameworks and ingestion pipelines using Databricks, Spark, and cloud-native services
• Work extensively with Delta Lake, Unity Catalog, Databricks Workflows, and Lakehouse architecture
• Develop scalable solutions on cloud platforms such as AWS, Azure, or GCP
• Collaborate with DevOps and platform teams to establish CI/CD and automation practices
• Optimize data processing performance and cost efficiency across platforms

Collaboration

• Collaborate with business stakeholders to translate requirements into scalable technical solutions
• Lead architecture governance, technical reviews, and solution validation processes
• Drive Agile delivery methodologies and ensure alignment with business objectives
• Create metrics, dashboards, and actionable insights to support strategic decision-making
• Manage and support enterprise-scale technology transformation initiatives

Qualifications

• Bachelor's Degree in Computer Science, Information Systems, Engineering, Mathematics, or a related field
• 7+ years of experience in Data Engineering, Data Warehousing, BI, and Analytics
• 3+ years of experience in Data Architecture or Solution Architecture roles
• 3+ years of hands‑on experience with Databricks and modern data platforms

Strong Expertise In

• Databricks Lakehouse Platform
• Apache Spark / PySpark
• Delta Lake
• Data Modeling and Data Architecture
• ETL/ELT Pipeline Development
• Data Governance and Security
• Experience working with cloud platforms such as AWS, Azure, or GCP
• Strong knowledge of SQL and Python
• Experience with CI/CD, DevOps, and Infrastructure Automation practices
• Strong understanding of migration architectures and modern data platform modernization
• Excellent stakeholder management, communication, and leadership skills
• Experience managing enterprise‑scale consulting or transformation programs
• Ability to work effectively with global teams during EMEA shift timings

Preferred Skills

• Databricks certifications:
  • Databricks Certified Data Engineer Professional
  • Databricks Certified Solution Architect
• Experience with:
• Snowflake
• Kafka or streaming platforms
• Airflow or orchestration tools
• Power BI, Tableau, or modern BI tools
• ML/AI workloads on Databricks
• Unity Catalog and data governance frameworks
• Exposure to multi‑cloud architecture and hybrid data platforms

Signs You May Be a Great Fit

• Impact: Play a pivotal role in shaping a rapidly growing venture studio with Cloud‑driven digital transformation.
• Culture: Thrive in a collaborative, innovative environment that values creativity, ownership, and agility.
• Growth: Access professional development opportunities, and mentorship from experienced peers.

Benefits

• Competitive salary, wellness packages, and flexible work arrangements that support your lifestyle and goals