Sr. Databricks Architect

Weekday AI (YC W21); Chennai District; On-site; INR 2,500,000 - 3,500,000; Full time

Job summary

A leading IT services company is seeking a Data Architect with expertise in Azure Databricks to design innovative data solutions. This role requires a minimum of 14 years of IT experience, including 5 years in data warehouse projects. Responsibilities include developing data warehouse solutions and mentoring team members. The ideal candidate will possess strong client management skills and be proficient in various modern data engineering practices. This is a full-time position located in Chennai or other major Indian cities.

Qualifications

• 14+ years of IT experience with 5+ years in data warehouse/ETL projects.
• Hands-on experience with Azure Databricks, PySpark, and SQL.
• Strong understanding of Medallion Architecture and Unity Catalog.

Responsibilities

• Design and develop modern data warehouse solutions using Databricks and the Azure stack.
• Provide innovative solutions in data engineering and analytics.
• Collaborate with DW/BI leads to understand ETL pipeline development.

Skills

Azure Databricks

Medallion Architecture

Unity Catalog

PySpark

ETL

SQL

Data Warehousing

Client Management

Team Management

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Azure Databricks

SQL

Kinesis

Apache Kafka

Hadoop ecosystem (Hive, Pig, Impala)

NoSQL databases (MongoDB, Cassandra, Neo4J)

Terraform

CircleCI

Git

Job description

3 days ago Be among the first 25 applicants

This role is for one of the Weekday's clients

Min Experience: 14 years

Location: Bengaluru, Pune, NCR, Hyderabad, Chennai, Kolkata

JobType: full-time

We are looking for an experienced Data Architect with strong expertise in Azure Databricks and modern data engineering practices. The ideal candidate combines technical mastery with a creative and analytical mindset to design forward-thinking data solutions, solve complex business problems, and maximize the value of data. Strong client management and team leadership skills are essential to drive collaboration and deliver impactful results.

Key Responsibilities

• Design and develop modern data warehouse solutions using Databricks and the Azure stack.
• Provide innovative solutions in data engineering and analytics to solve business problems.
• Collaborate with DW/BI leads to understand ETL pipeline development requirements.
• Identify gaps in existing pipelines, triage issues, and implement fixes.
• Work with business stakeholders to design data models that fulfill reporting needs.
• Mentor and guide team members to resolve technical challenges.
• Drive technical discussions with client architects and project teams.
• Orchestrate data pipelines using Airflow and ensure smooth end-to-end operations.

Skills & Qualifications

• Bachelor's or Master's degree in Computer Science or related field.
• 14+ years of IT experience with 5+ years in data warehouse/ETL projects.
• Hands-on experience with Azure Databricks, PySpark, SQL, and Databricks Delta Lake Architecture.
• Strong understanding of Medallion Architecture and Unity Catalog.
• Experience with batch and streaming ETL (Kinesis) and event-driven data pipelines.
• Familiarity with Apache Kafka, Hadoop ecosystem (Hive, Pig, Impala), and NoSQL databases (MongoDB, Cassandra, Neo4J).
• Skilled in handling structured and unstructured data, including imaging and geospatial datasets.
• Experience in DevOps environments with Terraform, CircleCI, Git, and Agile methodology.
• Proficient in RDBMS, complex SQL, PL/SQL, Unix shell scripting, performance tuning, and troubleshooting.
• Databricks Certified Data Engineer Associate/Professional (preferred).

Core Skills: Azure Databricks, Medallion Architecture, Unity Catalog, PySpark, ETL, SQL, Data Warehousing, Team & Client Management

Seniority level

Director

Employment type

Full-time

Job function

Other

Industries

IT Services and IT Consulting