Databricks Solution Architect (India)

Codvo.ai; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

A leading data solutions company in Pune, India, is seeking an experienced Senior/Expert Databricks Solutions Architect to design and deliver end-to-end data solutions. You will work closely with stakeholders to translate business needs into scalable architectures using Databricks. This role requires deep expertise in Databricks components and strong cloud experience. Join a team passionate about solving complex data challenges and making an impact with innovative solutions.

Qualifications

• Experience leading design and delivery of data solutions on Databricks.
• In-depth knowledge of Databricks components and cloud services.
• Ability to mentor junior architects and optimize data pipelines.
• Strong cloud experience (AWS, Azure, or GCP) with data storage and compute services.
• Proficiency in data integration/orchestration tools: Airflow, dbt, Kafka, Spark Streaming.
• Advanced SQL and Python or Scala; prototype data pipelines.
• Excellent communication and stakeholder management.
• Experience delivering large-scale lakehouse migrations and optimization.
• Databricks certifications or equivalent; willingness to certify.

Responsibilities

• Lead design of data lakehouse architectures on Databricks.
• Engage with stakeholders to understand data needs and create solutions.
• Monitor performance and optimize SQL and Spark workloads.
• Architect end-to-end data pipelines with reliability and cost optimization.
• Enable ML workflows on Databricks and design end-to-end MLOps.
• Ensure governance, security, compliance (IAM, encryption, Unity Catalog, masking).
• Collaborate with data engineers/scientists/DevOps; implement CI/CD for data/ML.
• Lead customer-facing workshops, demos, POCs, ROI guidance.
• Mentor junior architects and engineers; develop training materials.
• Monitor performance and optimize SQL and Spark workloads; manage clusters.

Skills

Databricks platform expertise

Cloud services (AWS, Azure, GCP)

Advanced SQL skills

Data integration and orchestration

Communication skills

Analytical skills

CI/CD for data/ML

Communication

Education

8+ years in solutions/enterprise architecture

3+ years of hands-on experience with Databricks

Tools

Apache Airflow

Kafka

Spark

Spark

Delta Lake

Unity Catalog

Job description

Senior / Expert Databricks Solutions Architect — Job Description

About Us

At Codvo, we are committed to building scalable, future‑ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting‑edge technology.

About the role

We are seeking a highly experienced Solutions Architect to lead the design and delivery of end‑to‑end data and analytics solutions on the Databricks platform. You will translate complex business needs into scalable, secure, and cost‑efficient data lakehouse architectures, collaborate with cross‑functional teams, and guide customers from concept through implementation and adoption.

What you’ll do (Responsibilities)

• Engage with business stakeholders to understand goals, data sources, and analytic use cases; translate into a holistic Databricks‑based solution.
• Design scalable data lakehouse architectures on Databricks (Delta Lake, Databricks SQL, Unity Catalog, Delta Live Tables) that support data ingestion, cleansing, modeling, governance, security, and analytics.
• Lead technical architecture decisions and produce high‑quality artifacts (reference architectures, solution blueprints, data models, data governance models, and integration plans).
• Architect data pipelines end‑to‑end (ingestion, transformation, storage, cataloging) with best practices for reliability, observability, and cost optimization.
• Enable data science and ML workflows on Databricks (MLflow, feature store, notebooks, Automated ML) and design end‑to‑end MLOps strategies.
• Ensure data governance, security, and compliance (IAM, encryption, Unity Catalog, data masking, lineage, access controls).
• Collaborate closely with data engineers, data scientists, software engineers, and DevOps to deliver production‑ready solutions; implement CI/CD for data and ML pipelines.
• Lead customer‑facing activities: workshops, solution demos, proofs of concept, and responses to RFPs/RFIs; provide strategic guidance on platform adoption and ROI.
• Mentor and coach junior architects and engineers; develop training materials and run knowledge‑sharing sessions.
• Monitor performance, optimize SQL and Spark workloads, manage cluster configurations, and drive cost/performance improvements.

What you’ll bring (Required qualifications)

• 8+ years of experience in solutions/enterprise architecture or senior data engineering roles; 3+ years of hands‑on experience with the Databricks platform and Spark-based architectures.
• Deep expertise in Databricks components: Delta Lake, Unity Catalog, Databricks SQL, Delta Live Tables, notebooks, and orchestration patterns.
• Strong cloud experience (AWS, Azure, or GCP) with data storage and compute services (e.g., S3/Blob, ADLS, GCS, Redshift, BigQuery, Synapse, EMR/Databricks on cloud).
• Proficiency in data integration and orchestration tools (e.g., Apache Airflow, dbt, Kafka, Spark Structured Streaming).
• Advanced SQL and programming skills (Python or Scala); ability to prototype and review data pipelines, models, and analytics solutions.
• Excellent communication and stakeholder management skills; ability to present complex technical concepts to both technical and non‑technical audiences.
• Experience delivering large‑scale data lakehouse migrations/transformations, performance tuning, and cost optimization.
• Databricks certification(s) or equivalent demonstrable expertise; willingness to obtain relevant certifications if not already held.

Preferred qualifications

• Experience with ML and MLOps on Databricks (MLflow, feature stores, model registry, CI/CD for ML).
• Domain expertise in industries such as financial services, healthcare, retail, or telecommunications.
• Familiarity with data governance, privacy regulations, and security frameworks (e.g., GDPR, HIPAA, SOC 2).
• Familiarity with real‑time data processing and streaming architectures.
• Prior experience in pre‑sales or solutioning for customers, including building compelling ROI stories and technical demos.

About you (soft skills and capabilities)

• Strategic thinker with a hands‑on mindset; comfortable operating at both business and technical levels.
• Strong analytical, problem‑solving, and decision‑making capabilities.
• Collaborative team player who can lead without authority and influence stakeholders.
• Comfortable working in a fast‑paced, client‑facing environment with travel as needed.
• Submit your resume/CV and a brief cover letter outlining your Databricks projects and impact.
• Include links to relevant work (e.g., public case studies, GitHub repositories, or portfolio demos) if available.