GyanSys - Databricks Platform Admin Consultant

GyanSys Inc.; Kolkata District; On-site; INR 1,500,000 - 2,000,000; Full time

Job summary

GyanSys Inc. is seeking an experienced Databricks Platform Admin Consultant in Kolkata, India. This role focuses on Azure Databricks administration and Lakehouse architecture, requiring deep technical expertise in managing large-scale environments and ensuring secure data access.

The ideal candidate should have 8 to 12 years of experience with Azure services, including Data Factory and Synapse Analytics, and be proficient in governance frameworks and access management. Strong troubleshooting and stakeholder collaboration skills are essential for success.

Qualifications

• 8 to 12 years of experience in Data Platform Administration and Azure Data Ecosystems.
• Strong hands-on expertise in Azure Databricks, Unity Catalog, and SQL.
• Excellent troubleshooting, analytical, and stakeholder management skills.

Responsibilities

• Manage and administer enterprise-scale Azure Databricks environments.
• Monitor platform health, performance, usage, and cost optimization.
• Implement platform governance and operational best practices.

Skills

Azure Databricks

Unity Catalog

SQL

Azure Data Factory (ADF)

Azure Synapse Analytics

Data Governance

RBAC

Tools

Azure Storage/Data Lake

Job description

About the Role

We are looking for an experienced Databricks Platform Admin Consultant with strong expertise in Azure Databricks administration, Lakehouse architecture, Unity Catalog governance, and enterprise data platform management.
The ideal candidate should possess deep technical expertise in managing and securing large‑scale Databricks environments while enabling scalable, secure, and governed analytics ecosystems on Microsoft Azure.
This role requires hands‑on experience with Unity Catalog RBAC, fine‑grained access controls, data governance frameworks, Azure data services, and enterprise cloud data platforms.
Candidates with strong platform administration, security governance, performance optimization, and stakeholder management capabilities will be strongly preferred.

Key Responsibilities

Databricks Platform Administration

• Manage and administer enterprise‑scale Azure Databricks environments.
• Configure and maintain:
  • Workspaces
  • Clusters
  • Access policies
  • Compute configurations
  • Security settings
• Monitor platform health, performance, usage, and cost optimization.
• Implement platform governance and operational best practices.

Lakehouse Architecture & Governance

• Design and support scalable Lakehouse architectures using Azure Databricks.
• Implement governance frameworks leveraging:
  • Unity Catalog
  • RBAC
  • Fine‑grained access controls
• Manage access controls across:
  • Catalogs
  • Schemas
  • Tables
  • Data assets
• Ensure secure and compliant data access management across enterprise environments.

Security & Access Management

• Implement and manage:
  • Role‑based access control (RBAC)
  • Data security policies
  • User provisioning
  • Permission governance
• Support audit readiness, compliance standards, and enterprise security requirements.
• Collaborate with security and governance teams to establish data protection standards.

Azure Data Platform Management

Work closely with Azure Data Factory (ADF), Azure Synapse Analytics, and SQL‑based data systems to support integrated data platform operations. Support orchestration, connectivity, and data movement across Azure ecosystems. Ensure platform scalability, reliability, and performance optimization.

Performance Optimization & Troubleshooting

• Troubleshoot platform, security, and performance‑related issues.
• Optimize:
  • Cluster utilization
  • Query performance
  • Resource allocation
  • Workload management
• Support incident management, root cause analysis, and issue resolution.

Stakeholder Collaboration

• Collaborate with Data Engineers, Architects, Governance Teams, Security Teams, and Business Stakeholders to support enterprise data initiatives.
• Provide technical guidance and platform best practices to engineering teams.

Required Skills & Qualifications

• 8 to 12 years of experience in Data Platform Administration, Cloud Data Engineering, Azure Data Ecosystems, and Databricks Platform Management.
• Strong hands‑on expertise in Azure Databricks, Unity Catalog, SQL, Azure Data Factory (ADF), and Azure Synapse Analytics.
• Strong experience implementing Lakehouse Architecture, RBAC, fine‑grained access controls, and data governance frameworks.
• Strong understanding of cloud security, data governance, access management, and enterprise data platforms.
• Excellent troubleshooting, analytical, and stakeholder management skills.

Technical Skills

Cloud & Data Platforms

• Azure Databricks
• Azure Synapse Analytics
• Azure Data Factory (ADF)
• Azure Storage / Data Lake

Governance & Security

• Unity Catalog
• RBAC
• Fine‑grained Access Controls
• Data Governance
• Access Management

Data & Querying

• SQL
• Data Modeling
• Data Integration
• ETL / ELT Concepts

Platform Operations

• Cluster Management
• Performance Optimization
• Monitoring & Troubleshooting
• Cost Optimization

Preferred Skills

• Experience working on enterprise‑scale cloud data modernization programs.
• Exposure to CI/CD pipelines, DevOps/DataOps practices, Delta Lake, Lakehouse optimization strategies.
• Azure or Databricks certifications preferred.
• Experience supporting global enterprise environments.