Databricks Security & Automation Engineer

Rubicon Path; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Rubicon Path is seeking a Databricks Administrator to design, secure, and optimize Databricks environments in Canada. You will implement security controls, manage access, and drive automation across data pipelines.

The role requires deep Databricks knowledge, Azure security experience, and a focus on governance and compliance. Collaboration with engineers and analytics teams is essential, with opportunities for training and process improvement.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field or equivalent experience.
• Proven Databricks administrator experience with focus on security and automation.
• In-depth knowledge of Databricks architecture, security features, and best practices.
• Experience with Azure cloud platforms and their security practices.
• Familiarity with data governance, compliance standards, and regulatory requirements (e.g., GDPR).

Responsibilities

• Design, implement, and manage security policies and controls within the Databricks environment.
• Monitor and audit user access and activities to ensure compliance with security policies.
• Develop and maintain data encryption strategies.
• Manage roles, permissions, and access controls to ensure data security and compliance.
• Develop and implement automation scripts to streamline data workflows and administrative tasks.
• Optimize Databricks performance by tuning queries, managing storage, and implementing best practices.
• Utilize Databricks features such as tasks, streams, and stored procedures to automate data processes.
• Leverage CI/CD best practices to automate productionalization of data pipelines.
• Work with data engineers, analysts, and stakeholders to understand needs and provide solutions.
• Provide technical support and troubleshooting for Databricks-related issues.
• Conduct training sessions and create documentation on Snowflake best practices and security protocols.
• Set up and maintain monitoring tools to track performance and security.
• Generate and analyze reports on system performance, security incidents, and usage metrics.
• Implement alerts and notifications for critical security and performance events.
• Stay up-to-date with Databricks features, security trends, and industry best practices.
• Proactively identify opportunities for improvement in security, performance, and automation.

Skills

Databricks administration

Azure security

Data governance

Security automation

Documentation & training

Education

Bachelor's degree in CS/IT or related

Tools

Azure Databricks

Azure Data Factory

Job description

Rubicon Path is seeking a Databricks Administrator to design, secure, and optimize Databricks environments in Canada. You will implement security controls, manage access, and drive automation across data pipelines.

The role requires deep Databricks knowledge, Azure security experience, and a focus on governance and compliance. Collaboration with engineers and analytics teams is essential, with opportunities for training and process improvement.