Senior Data Architect – Databricks

Recro; India; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Recro is seeking a Senior Data Architect to join our enterprise data engineering team, building scalable, cloud-based data platforms using Databricks. You will own technical architecture, lead large-scale data migrations, production deployments, and customer engagements while mentoring junior engineers.

You will collaborate with project managers and stakeholders to design end-to-end data architectures, apply CI/CD and MLOps best practices, and travel up to 30% to work with clients across

Qualifications

• 6+ years of experience in data engineering, data platforms, and analytics.
• Strong hands-on experience with Databricks and enterprise data platforms.
• Mandatory: Databricks certification.
• Proven experience with large-scale data migrations to/from Databricks.
• Deep expertise in Apache Spark, including architecture and runtime internals.
• Strong programming experience in Python or Scala.
• Experience with two major cloud platforms — AWS, Azure, or GCP — with deep expertise in at least one.
• Experience designing and deploying high-performance, scalable end-to-end data architectures.
• Hands-on experience deploying and integrating Databricks-based solutions in production.
• Working knowledge of CI/CD and MLOps.
• Experience managing technical projects, scope, timelines, and delivery.
• Strong documentation, presentation, and whiteboarding skills.
• Proven customer-facing / consulting experience with external clients.
• Strong stakeholder management and conflict-resolution skills.
• Excellent communication, collaboration, and problem-solving abilities.

Responsibilities

• Design and implement end-to-end data architectures using Databricks and cloud technologies.
• Lead large-scale data migrations to and from Databricks.
• Work directly with customers to understand requirements and translate them into scalable technical solutions.
• Build reference architectures, technical documentation, and how-to guides.
• Guide customers through the design, development, deployment, and adoption of Databricks-based data and AI solutions.
• Develop and productionize large-scale data engineering and analytics applications.
• Collaborate with Project Managers, Architects, Engagement Managers, and customer teams to ensure successful technical delivery.
• Provide technical guidance and support for complex production issues.
• Manage technical scope, timelines, and delivery for customer projects.
• Apply best practices around CI/CD, MLOps, security, scalability, and performance.
• Mentor and guide junior data engineers and technical team members.
• Conduct technical discussions, architecture sessions, and whiteboarding with customers and internal stakeholders.
• Travel up to 30%, based on customer requirements.

Skills

Data architecture

Cloud platforms

CI/CD

MLOps

Python/Scala

Stakeholder management

Customer-facing

Communication

Problem-solving

Tools

Databricks

Apache Spark

Python

Scala

AWS

Azure

Job description

We are looking for a Senior Data Architect to join a high-impact enterprise data engineering team focused on building scalable, cloud-based data platforms using Databricks.

In this role, you will work closely with strategic customers to design, implement, and deploy modern data and AI solutions. You will own technical architecture, large-scale data migrations, production deployments, and customer engagements while also mentoring junior engineers.

Key Responsibilities

• Design and implement end-to-end data architectures using Databricks and cloud technologies.
• Lead large-scale data migrations to and from Databricks.
• Work directly with customers to understand requirements and translate them into scalable technical solutions.
• Build reference architectures, technical documentation, and how-to guides.
• Guide customers through the design, development, deployment, and adoption of Databricks-based data and AI solutions.
• Develop and productionize large-scale data engineering and analytics applications.
• Collaborate with Project Managers, Architects, Engagement Managers, and customer teams to ensure successful technical delivery.
• Provide technical guidance and support for complex production issues.
• Manage technical scope, timelines, and delivery for customer projects.
• Apply best practices around CI/CD, MLOps, security, scalability, and performance.
• Mentor and guide junior data engineers and technical team members.
• Conduct technical discussions, architecture sessions, and whiteboarding with customers and internal stakeholders.
• Travel up to 30%, based on customer requirements.

Required Skills & Experience

• 6+ years of experience in data engineering, data platforms, and analytics.
• Strong hands‑on experience with Databricks and enterprise data platforms.
• Mandatory: Databricks certification.
• Proven experience with large-scale data migrations to/from Databricks.
• Deep expertise in Apache Spark, including Spark architecture and runtime internals.
• Strong programming experience in Python or Scala.
• Experience with at least two major cloud platforms — AWS, Azure, or GCP — with deep expertise in at least one.
• Experience designing and deploying high-performance, scalable end-to-end data architectures.
• Hands‑on experience deploying and integrating Databricks-based solutions in production.
• Working knowledge of CI/CD and MLOps.
• Experience managing technical projects, scope, timelines, and delivery.
• Strong documentation, presentation, and whiteboarding skills.
• Proven customer-facing / consulting experience with external clients.
• Strong stakeholder management and conflict-resolution skills.
• Excellent communication, collaboration, and problem-solving abilities.