Databricks Architect

Moder Solutions; Bengaluru; On-site; INR 2,000,000 - 3,200,000; Full time

Job summary

Moder Solutions is seeking a Databricks Architect to design and optimize enterprise-scale data platforms. You will lead the implementation of scalable data solutions using Databricks, Spark, Delta Lake, and cloud services to empower data-driven decision making.

You will mentor engineering teams, establish data governance, and drive migration from legacy systems to cloud-native architectures, while collaborating with cross-functional partners to define data strategies and robust ETL processes.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
• Proven experience with Databricks, Apache Spark, and cloud platforms (Azure, AWS, or GCP).
• Strong knowledge of data warehousing, ETL, and real-time streaming solutions.
• Hands-on experience with Delta Lake, MLflow, and advanced analytics frameworks.
• Excellent problem-solving, communication, and leadership skills.

Responsibilities

• Architect and implement scalable data solutions leveraging Databricks, Apache Spark, and Delta Lake.
• Collaborate with cross-functional teams to define data strategies, pipelines, and integration frameworks.
• Optimize ETL workflows, data lakes, and machine learning environments for performance and reliability.
• Establish and enforce best practices for data governance, security, and compliance.
• Lead migration initiatives from legacy data systems to Databricks and cloud-native platforms.
• Provide technical leadership, mentoring, and architectural guidance to engineering teams.
• Stay current with emerging technologies in big data, AI/ML, and cloud ecosystems.

Skills

Databricks

Apache Spark

Cloud platforms

Data warehousing

ETL pipelines

Delta Lake

MLflow

Leadership

Communication

Machine learning

Education

Bachelor's/Master's in CS or related

Tools

CI/CD pipelines

Docker

Kubernetes

Power BI

Tableau

Job description

Employment Type: Full-time

Role Overview

We are seeking a highly experienced Databricks Architect to lead the design, implementation, and optimization of enterprise-scale data solutions. This role requires expertise in cloud-based data engineering, advanced analytics, and scalable architecture design. The successful candidate will play a pivotal role in enabling data-driven decision-making across the organization.

Key Responsibilities

• Architect and implement scalable data solutions leveraging Databricks, Apache Spark, and Delta Lake.
• Collaborate with cross-functional teams to define data strategies, pipelines, and integration frameworks.
• Optimize ETL workflows, data lakes, and machine learning environments for performance and reliability.
• Establish and enforce best practices for data governance, security, and compliance.
• Lead migration initiatives from legacy data systems to Databricks and cloud-native platforms.
• Provide technical leadership, mentoring, and architectural guidance to engineering teams.
• Stay current with emerging technologies in big data, AI/ML, and cloud ecosystems.

Qualifications

• Bachelors or Master’s degree in Computer Science, Data Engineering, or related field.
• Proven experience with Databricks, Apache Spark, and cloud platforms (Azure, AWS, or GCP).
• Strong knowledge of data warehousing, ETL, and real-time streaming solutions.
• Hands‑on experience with Delta Lake, MLflow, and advanced analytics frameworks.
• Excellent problem-solving, communication, and leadership skills.

Preferred Skills

• Experience with CI/CD pipelines and DevOps practices for data engineering.
• Knowledge of containerization (Docker, Kubernetes) and microservices architecture.
• Familiarity with BI tools (Power BI, Tableau) for data visualization.