Databricks Architect

Persistent; Pune District; On-site; INR 2,500,000 - 3,500,000; Full time

Benefits offered by this job

Competitive salary and benefits package

Company-sponsored higher education and certifications

Annual health check-ups

Insurance coverage for self and family

Job summary

A leading technology company is seeking an experienced Databricks Architect in Pune. This role involves developing and maintaining scalable data pipelines on the Databricks platform, designing Lakehouse architecture, and implementing Medallion Architecture. The ideal candidate has over 12 years of experience and expertise in Databricks, PySpark, and cloud platforms. Competitive salary and benefits, along with a culture focused on talent development and flexibility, are offered in this role.

Qualifications

• 12+ years of experience in data architecture or a related field.
• Strong experience with a major cloud platform (Azure/AWS/GCP).
• Experience leading large-scale data platform implementations.

Responsibilities

• Develop and maintain ETL/ELT pipelines using Databricks.
• Design end-to-end Lakehouse architecture.
• Implement Medallion Architecture using Delta Lake.
• Architect and optimize batch and streaming data pipelines.

Skills

Databricks Lakehouse Platform

PySpark

Spark SQL

Delta Lake

Structured Streaming

CI/CD pipelines

Data modeling

Distributed computing

Job description

About Position

We are looking for an experienced Databricks Architect who can build, optimize, and maintain scalable data pipelines on the Databricks platform.

• Role: Databricks Architect
• Location: Pune
• Experience: 12+ years
• Job Type: Full Time Employment

What You'll Do

• Develop and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks).
• Design end-to-end Lakehouse architecture including ingestion, transformation, modeling, and consumption.
• Define and implement Medallion Architecture (Bronze/Silver/Gold) using Delta Lake.
• Build high-performance ETL/ELT pipelines using PySpark, Spark SQL, Delta Lake.
• Architect and optimize batch and streaming data pipelines.
• Perform advanced Spark optimization, cluster sizing, and cost management.
• Implement CI/CD, version control, and DevOps best practices within Databricks.

Expertise You'll Bring

• Advanced expertise in:
• Databricks Lakehouse Platform
• PySpark & Spark SQL
• Delta Lake, Structured Streaming
• Unity Catalog & governance frameworks
• Strong experience with a major cloud platform (Azure/AWS/GCP).
• Strong understanding of:
• Distributed computing & Spark internals
• Data warehousing concepts
• Data modeling (dimensional, normalized, Lakehouse modeling)
• ETL/ELT architecture
• Experience in CI/CD pipelines, Git, orchestration tools.
• Experience in leading large-scale data platform implementations.

Benefits

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.