Databricks Architect

Experion Technologies

Kochi

On-site

INR 1,800,000 - 2,400,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Experion Technologies is seeking a Databricks Architect to own end-to-end solution design and provide hands-on technical leadership across Databricks and cloud data platforms.

The role involves translating business and data requirements into scalable architectures, establishing engineering standards, guiding development teams, and driving modernization and migration initiatives for clients in Trivandrum/Kochi.

Qualifications

  • 10+ years of experience in Data Engineering / Data Architecture.
  • Hands-on experience with Databricks and Lakehouse architecture.
  • Strong knowledge of Apache Spark, PySpark, Python and SQL.
  • Experience with Delta Lake and Medallion Architecture.
  • Experience with data modelling, ETL/ELT and data integration.
  • Experience designing scalable batch and real-time data solutions.
  • Strong knowledge of Azure, AWS or GCP cloud platforms.
  • Familiar with Databricks Workflows/Jobs and Unity Catalog.
  • Understanding of data security, governance, quality and lineage.
  • Experience with CI/CD, Git and DevOps practices.

Responsibilities

  • Design and implement enterprise-scale Databricks Lakehouse architectures.
  • Define architecture across Azure, AWS and GCP based on requirements.
  • Design data ingestion, transformation and processing using Databricks, Spark, PySpark, SQL and Python.
  • Establish Lakehouse architecture and data modelling standards.
  • Lead migration and modernization of legacy data platforms to Databricks.
  • Integrate Databricks with cloud-native services and establish CI/CD pipelines.

Skills

Databricks
Lakehouse architecture
Apache Spark
PySpark
Python
SQL
Azure
AWS
GCP
CI/CD
DevOps practices
Databricks Workflows
Unity Catalog

Tools

Delta Lake
Medallion Architecture
Git

Job description

Databricks Architect

Total Experience :10+years

Work Location : Trivandrum /Kochi Only

The Databricks Lead / Architect will own end-to-end solution design and provide hands-on technical leadership across Databricks and cloud data platforms. The role involves translating business and data requirements into scalable architectures, establishing engineering standards, guiding development teams, driving modernization and migration initiatives, and working closely with clients, architects and technology leadership.

Key Responsibilities
  • Design and implement enterprise-scale Databricks Lakehouse architectures.
  • Define architecture across Azure, AWS and GCP based on business and technical requirements.
  • Design data ingestion, transformation and processing using Databricks, Spark, PySpark, SQL and Python.
  • Establish Lakehouse architecture, including Delta Lake, Medallion Architecture and data modelling.
  • Design batch and real-time data processing and integration solutions.
Job Description
  • Architect and implement Databricks Workflows, Jobs, Unity Catalog and governance capabilities.
  • Define data security, access control, lineage, quality, monitoring and governance standards.
  • Design scalable and optimized solutions for performance and cloud cost.
  • Lead migration and modernization of legacy data platforms to Databricks.
  • Integrate Databricks with cloud-native services across Azure / AWS / GCP.
  • Establish CI/CD, Git, DevOps and deployment standards for data engineering.
  • Provide technical leadership through design reviews, code reviews and engineering standards.
  • Guide and mentor Data Engineers and technical teams.
  • Conduct POCs and evaluate new Databricks/cloud capabilities.
  • Work with business stakeholders, project managers and enterprise architects to translate requirements into technical solutions.
  • Support estimation, solution proposals, technical presentations and client discussions.
  • Adhere to the Information Security Management policies and procedures.
Job Specification / Skills and Competencies
Mandatory Skills
  • 10+ years of experience in Data Engineering / Data Architecture.
  • Strong hands-on experience with Databricks and Lakehouse architecture.
  • Strong knowledge of Apache Spark, PySpark, Python and SQL.
  • Experience with Delta Lake and Medallion Architecture.
  • Strong experience in data modelling, ETL/ELT and data integration.
  • Experience designing scalable batch and real-time data solutions.
  • Strong knowledge of at least one major cloud platform: Azure, AWS or GCP.
  • Understanding of cloud data services and integration patterns.
  • Experience with Databricks Workflows/Jobs and Unity Catalog.
  • Strong understanding of data security, governance, quality and lineage.
  • Experience with CI/CD, Git and DevOps practices.
  • Strong solution architecture and technical leadership skills.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Architect
Databricks Architect

Experion Technologies • Ernakulam

On-site
INR 4,000,000 - 7,000,000
Cloud Data Architect
Cloud Data Architect

Maveric • Pune, Chennai, Bengaluru

On-site
INR 3,500,000 - 6,000,000
Databricks Solution Architect
Databricks Solution Architect

N Human Resources & Management Systems • Dehradun

Hybrid
INR 2,500,000 - 4,500,000
Databricks Senior Architect
Databricks Senior Architect

Vrinda Global • Bengaluru

On-site
INR 3,000,000 - 6,000,000
Resident Solution Architect – Databricks | 10+ Yrs | Bangalore
Resident Solution Architect – Databricks | 10+ Yrs | Bangalore

nHRMS Inc. • Bengaluru

Hybrid
INR 4,200,000 - 7,800,000
Senior Data Architect (Databricks, Azure, AWS)
Senior Data Architect (Databricks, Azure, AWS)

Happiest Minds Technologies • Bengaluru

On-site
INR 4,500,000 - 7,000,000
Resident Solution Architect – Databricks | 10+ Yrs | Bangalore
Resident Solution Architect – Databricks | 10+ Yrs | Bangalore

N Human Resources & Management Systems • Bengaluru

On-site
INR 2,500,000 - 3,500,000
Associate Architect - Databricks
Associate Architect - Databricks

Carelon Global Solutions • Gurugram District, Bengaluru

Hybrid
INR 4,000,000 - 9,000,000
Data Architect
Data Architect

United HR Solutions Pvt. Ltd. • India

On-site
INR 550,000 - 900,000
Senior Architect_Databricks
Senior Architect_Databricks

Tredence • Kolkata District, Pune District, Chennai

Hybrid
INR 3,500,000 - 7,500,000