Databricks Admin

GyanSys Inc.; Santa Clara (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

GyanSys Inc. is seeking a skilled Databricks Administrator to manage, secure, optimize, and support enterprise Databricks environments across development, test, and production settings.

The role emphasizes Unity Catalog governance, cluster tuning, and cost-aware operations. Ideal candidates will bring 8+ years of hands-on Databricks experience, expertise in Azure Databricks and Data Lake Storage, and strong cross-functional collaboration skills to enable secure analytics and scalable data

Qualifications

• 8+ years of hands-on experience in Databricks administration and workspace management.
• Strong understanding of Unity Catalog administration, data governance, access control, and security concepts.
• Experience with cluster management, compute configuration, job monitoring, and performance tuning.
• Knowledge of Azure Databricks and integration with Azure Data Lake Storage.
• Ability to troubleshoot Databricks platform issues, optimize workloads, and support production environments.
• Good communication skills with the ability to work with cross-functional technical teams.
• Bachelor's Degree is required.

Responsibilities

• Administer and manage Databricks workspaces across development, test, and production environments.
• Configure, manage, and support Unity Catalog, including catalogs, schemas, permissions, governance policies, and data access controls.
• Create, configure, monitor, and optimize Databricks clusters, pools, jobs, and compute policies.
• Perform cluster performance tuning, cost optimization, and workload troubleshooting to ensure reliable platform operations.
• Implement and manage security controls, including user access, groups, roles, permissions, service principals, secrets, and identity integrations.
• Support data governance initiatives including centralized access control, auditing, lineage, and compliance requirements.
• Integrate Azure Databricks with Azure Data Lake Storage, Azure services, and Power BI for analytics and reporting use cases.

Skills

Databricks administration

Unity Catalog administration

Data governance

Security concepts

Cluster management

Azure Databricks

Azure Data Lake Storage

Communication skills

Education

Bachelor's Degree

Job description

We are seeking a skilled Databricks Administrator to manage, secure, optimize, and support enterprise Databricks environments.

Key Responsibilities:

• Administer and manage Databricks workspaces across development, test, and production environments.
• Configure, manage, and support Unity Catalog, including catalogs, schemas, permissions, governance policies, and data access controls.
• Create, configure, monitor, and optimize Databricks clusters, pools, jobs, and compute policies.
• Perform cluster performance tuning, cost optimization, and workload troubleshooting to ensure reliable platform operations.
• Implement and manage security controls, including user access, groups, roles, permissions, service principals, secrets, and identity integrations.
• Support data governance initiatives including centralized access control, auditing, lineage, and compliance requirements.
• Integrate Azure Databricks with Azure Data Lake Storage, Azure services, and Power BI for analytics and reporting use cases.

Required Skills and Experience

• 8+ years of hands-on experience in Databricks administration and workspace management.
• Strong understanding of Unity Catalog administration, data governance, access control, and security concepts.
• Experience with cluster management, compute configuration, job monitoring, and performance tuning.
• Knowledge of Azure Databricks and integration with Azure Data Lake Storage.
• Ability to troubleshoot Databricks platform issues, optimize workloads, and support production environments.
• Good communication skills with the ability to work with cross-functional technical teams.
• Bachelor's Degree required.

Additional Requirement:

• Must be willing and able to attend in-person interviews in Santa Clara, CA
• This is a 100% onsite role (Monday to Friday)

About GyanSys

GyanSys is a leading global system integrator company supporting enterprise customers worldwide. We specialize in solutions implementations, managed services, and data analytics spanning SAP, Salesforce, Microsoft, and other prime enterprise platforms. Using a mature blended delivery model with over 3,000 consultants, we support over 350 enterprise customers across the Americas, Europe, and APAC.