DataBricks Admin

Rubicon Path; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Rubicon Path is seeking a Databricks Administrator to design, secure, and optimize Databricks environments in Canada. You will implement security controls, manage access, and drive automation across data pipelines.

The role requires deep Databricks knowledge, Azure security experience, and a focus on governance and compliance. Collaboration with engineers and analytics teams is essential, with opportunities for training and process improvement.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field or equivalent experience.
• Proven Databricks administrator experience with focus on security and automation.
• In-depth knowledge of Databricks architecture, security features, and best practices.
• Experience with Azure cloud platforms and their security practices.
• Familiarity with data governance, compliance standards, and regulatory requirements (e.g., GDPR).

Responsibilities

• Design, implement, and manage security policies and controls within the Databricks environment.
• Monitor and audit user access and activities to ensure compliance with security policies.
• Develop and maintain data encryption strategies.
• Manage roles, permissions, and access controls to ensure data security and compliance.
• Develop and implement automation scripts to streamline data workflows and administrative tasks.
• Optimize Databricks performance by tuning queries, managing storage, and implementing best practices.
• Utilize Databricks features such as tasks, streams, and stored procedures to automate data processes.
• Leverage CI/CD best practices to automate productionalization of data pipelines.
• Work with data engineers, analysts, and stakeholders to understand needs and provide solutions.
• Provide technical support and troubleshooting for Databricks-related issues.
• Conduct training sessions and create documentation on Snowflake best practices and security protocols.
• Set up and maintain monitoring tools to track performance and security.
• Generate and analyze reports on system performance, security incidents, and usage metrics.
• Implement alerts and notifications for critical security and performance events.
• Stay up-to-date with Databricks features, security trends, and industry best practices.
• Proactively identify opportunities for improvement in security, performance, and automation.

Skills

Databricks administration

Azure security

Data governance

Security automation

Documentation & training

Education

Bachelor's degree in CS/IT or related

Tools

Azure Databricks

Azure Data Factory

Job description

Key Responsibilities

• Design, implement, and manage security policies and controls within the Databricks environment.
• Monitor and audit user access and activities to ensure compliance with security policies.
• Develop and maintain data encryption strategies.
• Manage roles, permissions, and access controls to ensure data security and compliance.

Automation and Optimization

• Develop and implement automation scripts to streamline data workflows and administrative tasks.
• Optimize Databricks performance by tuning queries, managing storage, and implementing best practices.
• Utilize Databricks features such as tasks, streams, and stored procedures to automate data processes.
• Leverage CICD best practices to automate productionalization of data pipelines

Collaboration and Support

• Work closely with data engineers, analysts, and other stakeholders to understand their needs and provide solutions.
• Provide technical support and troubleshooting for Databricks-related issues.
• Conduct training sessions and create documentation for internal teams on Snowflake best practices and security protocols.

Monitoring and Reporting

• Set up and maintain monitoring tools to track the performance and security of the Databricks environment.
• Generate and analyze reports on system performance, security incidents, and usage metrics.
• Implement alerts and notifications for critical security and performance events.
• Stay up-to-date with the latest Databricks features, security trends, and industry best practices.
• Proactively identify opportunities for improvement in security, performance, and automation.
• Participate in continuous learning and professional development activities.

Qualifications

• Bachelors degree in Computer Science, Information Technology, or a related field; or equivalent work experience.
• Proven experience as a Databricks administrator, with a strong focus on security and automation.
• In-depth knowledge of Databricks architecture, security features, and best practices.
• Experience with Azure cloud platforms and their security practices.
• Familiarity with data governance, compliance standards, and regulatory requirements (e.g., GDPR).

Preferred Qualifications

• Databricks certification(s) such as Associate or Professional Data Engineer
• Experience with data integration tools and ETL processes using Azure Data Factory.
• Knowledge of data privacy and protection laws.
• Strong problem-solving skills and the ability to work independently and as part of a team.
• Excellent communication skills, both written and verbal.
• Previous experience in a similar role within a fast-paced, dynamic environment