Technology Architect - Databricks

Natobotics; Hyderabad; Hybrid; INR 2,000,000 - 3,000,000; Full time

Job summary

Natobotics is seeking a Technology Architect with deep expertise in Databricks and big data architectures. The ideal candidate will have over 12 years of experience leading large-scale data engineering initiatives. Responsibilities include defining architectural solutions, driving best practices, and guiding engineering teams to create scalable data platforms. This role is hybrid, involving 3 days in the office per week, and the contract duration is 8 months.

Qualifications

• 12+ years of experience in technology architecture.
• Deep expertise in Databricks and big data technologies.
• Experience with cloud platforms like Azure.

Responsibilities

• Define end to end architectural solutions.
• Guide engineering teams for cost optimized data platforms.
• Evaluate and recommend new tools and technologies.

Skills

Databricks

Big data architectures

Cloud platforms (Azure)

Data engineering frameworks

PySpark

Spark SQL

Delta Live Tables

Job description

Work mode

Hybrid

Number of days a week worked in the office

3

Contract duration

8 months

Location

London

End client

Bank

JOB DETAILS

Role Title: Technology Architect

Technology Architect – Databricks with over 12 years of experience in designing and leading large scale data engineering, analytics, and cloud transformation initiatives.

The ideal candidate will have deep expertise in Databricks, big data architectures, cloud platforms (Azure), and modern data engineering frameworks.

This role will be responsible for defining end to end architectural solutions, driving best practices, and guiding engineering teams to deliver scalable, secure, and cost optimized data platforms.

• Design end to end data platforms leveraging Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and ML/AI workloads.
• Define data ingestion, transformation, governance, and consumption frameworks aligned to enterprise standards.
• Evaluate and recommend architectural improvements, new tools, and emerging technologies.
• Develop reference architectures, solution blueprints, and best‑practice playbooks for Databricks implementations.
• Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows.
• Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage.
• Guide teams in building curated, governed data models leveraging Delta Lake Medallion Architecture (Bronze–Silver–Gold).