Azure Data Bricks Architect

Persistent Systems; Pune District; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Persistent is seeking an experienced Azure Databricks Architect for its Pune office. The role requires 8 to 12 years in data engineering or data platform architecture and hands-on expertise with Azure Databricks, Data Lake, and Terraform.

You will lead enterprise-scale cloud data platform design, governance, and modernization efforts, collaborating with stakeholders and cross-functional teams to deliver scalable solutions.

Qualifications

• 8 to 12 years of experience in data engineering, cloud engineering, or data platform architecture.
• Hands-on expertise in Azure Cloud services and enterprise cloud architectures.
• Experience with Azure Databricks and large-scale data processing environments.
• Experience designing Data Lake and Lakehouse architectures.
• Experience with TB-scale data pipelines and data integration solutions.

Responsibilities

• Design and implement enterprise-scale Azure cloud data platforms using Databricks and Data Lake technologies.
• Define scalable, secure, and high-performing cloud architectures aligned with business and technical requirements.
• Build and optimize data ingestion, transformation, and processing pipelines.
• Develop and maintain infrastructure as code using Terraform for cloud resource provisioning and management.
• Design and implement modern data lake and lakehouse architectures for analytics and reporting workloads.
• Collaborate with business stakeholders to translate requirements into scalable technical solutions.
• Work closely with architects, product owners, QA, DevOps, and security teams throughout project delivery.
• Implement Azure Data Factory pipelines and orchestration frameworks for enterprise data integration.
• Establish cloud governance, security, compliance, and operational best practices.
• Review solution architectures and ensure adherence to enterprise standards and design principles.
• Perform architecture reviews, testing, troubleshooting, performance optimization, and production-readiness assessments.
• Support cloud migration and modernization initiatives involving Azure data platforms.
• Identify project risks, dependencies, and technical challenges and drive timely resolution.
• Create architecture documentation, technical designs, deployment standards, and operational runbooks.
• Mentor engineering teams and promote reusable assets, automation, and engineering excellence.
• Drive continuous improvement initiatives across cloud, data engineering, and platform operations.

Skills

Azure Databricks

Data Lake

Architecture Leadership

Cloud Data Platform

Data Modeling

Security & Governance

CI/CD

Tools

Terraform

Azure Data Factory

Job description

We are looking for an experienced Azure Databricks Architect with 8 to 12 years of expertise in designing and delivering enterprise-scale cloud data platforms. The ideal candidate will have strong hands-on experience in Azure Cloud, Databricks, Data Lake architectures, Terraform, and Azure Data Factory. This role requires a blend of architecture leadership, cloud engineering expertise, and data platform modernization experience to build scalable, secure, and business-driven data solutions.

• Role: Architect


• Location: Pune


• Experience: 8 to 12 Years


• Job Type: Full Time Employment

What You'll Do:

• Design and implement enterprise-scale Azure cloud data platforms using Databricks and Data Lake technologies.


• Define scalable, secure, and high-performing cloud architectures aligned with business and technical requirements.


• Build and optimize data ingestion, transformation, and processing pipelines.


• Develop and maintain infrastructure as code using Terraform for cloud resource provisioning and management.


• Design and implement modern data lake and lakehouse architectures for analytics and reporting workloads.


• Collaborate with business stakeholders to translate requirements into scalable technical solutions.


• Work closely with architects, product owners, QA, DevOps, and security teams throughout project delivery.


• Implement Azure Data Factory pipelines and orchestration frameworks for enterprise data integration.


• Establish cloud governance, security, compliance, and operational best practices.


• Review solution architectures and ensure adherence to enterprise standards and design principles.


• Perform architecture reviews, testing, troubleshooting, performance optimization, and production-readiness assessments.


• Support cloud migration and modernization initiatives involving Azure data platforms.


• Identify project risks, dependencies, and technical challenges and drive timely resolution.


• Create architecture documentation, technical designs, deployment standards, and operational runbooks.


• Mentor engineering teams and promote reusable assets, automation, and engineering excellence.


• Drive continuous improvement initiatives across cloud, data engineering, and platform operations.

Expertise You'll Bring:

• 8 to 12 years of experience in Data Engineering, Cloud Engineering, or Data Platform Architecture.


• Strong hands-on expertise in Azure Cloud services and enterprise cloud architectures.


• Extensive experience with Azure Databricks and large-scale data processing environments.


• Strong experience designing and implementing Data Lake and Lakehouse architectures.


• Hands-on experience with Azure Data Factory and enterprise data integration solutions.


• Expertise in Infrastructure as Code using Terraform.


• Experience developing scalable ETL/ELT pipelines and modern data platforms.


• Strong understanding of data modeling, data warehousing, and analytics architectures.


• Experience delivering production-grade enterprise solutions with strong focus on security, scalability, reliability, and performance.


• Knowledge of cloud networking, monitoring, governance, and operational excellence frameworks.


• Understanding of CI/CD pipelines, DevOps methodologies, and automation practices.


• Strong troubleshooting, root cause analysis, and performance optimization skills.


• Experience supporting cloud migration and modernization programs.


• Ability to analyze complex business requirements and design practical, scalable solutions.


• Experience working in Agile and cross-functional delivery environments.


• Strong communication, stakeholder management, documentation, and leadership skills.


• Ability to mentor teams and provide architectural guidance across projects.


• Competitive salary and benefits package


• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications


• Opportunity to work with cutting-edge technologies


• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards


• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.


• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.


• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

\"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.\"