Databricks Platform Administrator

Capgemini; Ontario; On-site; CAD 80,000 - 110,000; Full time

Job summary

Join a forward-thinking company as a Databricks Platform Administrator, where you'll manage and optimize a cutting-edge cloud-based data and analytics platform. This role offers a unique opportunity to work with Azure and Snowflake, ensuring the reliability and performance of critical data infrastructure. You will be part of a diverse team of experts, dedicated to leveraging technology for business transformation. With a commitment to employee well-being and professional growth, this innovative firm provides an engaging environment to make a significant impact in the tech landscape.

Benefits

Healthcare including dental and vision

401(k) and Employee Share Ownership Plan

Paid time off and holidays

Paid parental leave

Family building benefits

Social well-being benefits

Mentoring and coaching programs

Employee Resource Groups

Disaster Relief

Qualifications

• Deep technical expertise in Azure cloud services and Databricks administration.
• Experience in managing Snowflake data warehousing and integrations.

Responsibilities

• Administer and maintain the Databricks platform on Azure, ensuring security and scalability.
• Collaborate with data engineers and scientists to support platform needs.

Skills

Azure Cloud Services

Databricks Administration

Snowflake Data Warehousing

Data Engineering Best Practices

Scripting (Python, Bash, PowerShell)

Education

Bachelor's Degree in Computer Science or related field

Tools

Terraform

Azure CLI

Job description

Explore our latest thought leadership, ideas, and insights on the issues that are shaping the future of business and society.

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.

Discover our portfolio – constantly evolving to keep pace with the ever-changing needs of our clients.

Become part of a diverse collective of free-thinkers, entrepreneurs and experts – and help us to make a difference.

See our latest news, and stories from across the business, and explore our archives.

We are a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.

Job Summary:
We are seeking a highly skilled and motivated Databricks Platform Administrator to manage and optimize our cloud-based data and analytics platform. This role will be responsible for the day-to-day administration, maintenance, security, and scalability of our Databricks environment on Azure, with integrations to Snowflake and other data sources. The ideal candidate will possess deep technical expertise in Azure cloud services, Databricks administration, Snowflake data warehousing, and a strong understanding of data engineering best practices. They will play a crucial role in ensuring the reliability, performance, and security of our critical data infrastructure.

Responsibilities:

Platform Administration and Maintenance:
Administer and maintain the Databricks platform on Azure, including workspace setup, user and group management, access control, and security configurations.
Monitor system health, performance, and resource utilization of the Databricks environment.
Perform regular maintenance tasks, upgrades, and patching of the Databricks platform.
Troubleshoot and resolve platform-related issues, ensuring minimal downtime.
Manage and optimize Databricks clusters, including configuration, scaling, and cost management.
Azure Cloud Management: Manage and maintain the underlying Azure infrastructure supporting the Databricks environment, including virtual networks, storage accounts, and security groups.
Implement and enforce Azure best practices for security, governance, and compliance.
Monitor Azure resource costs and identify opportunities for optimization.
Integrate Databricks with other Azure services as needed.
Snowflake Integration and Management: Manage and maintain connections and integrations between Databricks and Snowflake.
Optimize data pipelines and workflows involving both Databricks and Snowflake.
Monitor Snowflake performance and resource utilization.
Implement and enforce security best practices for Snowflake.
Security and Compliance: Implement and enforce security policies and procedures within the Databricks and Azure environments.
Manage user authentication and authorization, ensuring appropriate access controls.
Monitor for security vulnerabilities and implement remediation plans.
Ensure compliance with relevant data governance and regulatory requirements.
Automation and Infrastructure as Code (IaC): Develop and maintain automation scripts and tools for platform provisioning, configuration management, and routine tasks (e.g., using Terraform, Azure CLI, Python).
Implement Infrastructure as Code (IaC) principles for managing the Databricks and Azure environments.
Monitoring and Alerting: Implement robust monitoring and alerting systems for key platform metrics and potential issues.
Proactively identify and address performance bottlenecks and potential failures.
Collaboration and Support: Collaborate with data engineers, data scientists, and other stakeholders to understand their platform needs and provide support.
Document platform configurations, procedures, and troubleshooting steps.
Participate in on-call rotation as needed to address critical platform issues.

Technical Skill Sets:
Azure Cloud: Strong understanding of core Azure services, including Azure Virtual Machines, Azure Virtual Network, Azure Storage (ADLS Gen2, Blob Storage), Azure Active Directory (Azure AD), Azure Key Vault, and Azure Monitor.
Experience with Azure Resource Manager (ARM) templates and Infrastructure as Code (IaC) using Terraform or Azure CLI.
Knowledge of Azure security best practices and services (e.g., Azure Security Center, Azure Firewall).
Databricks: Extensive experience in administering and managing Databricks workspaces on Azure.
Deep understanding of Databricks architecture, including clusters, notebooks, jobs, Delta Lake, and Unity Catalog.
Proficiency in managing Databricks security, access control, and user permissions.
Experience with Databricks monitoring and performance tuning.
Familiarity with Databricks APIs and automation capabilities.
Snowflake: Solid understanding of Snowflake architecture, data warehousing concepts, and best practices.
Experience in managing Snowflake users, roles, and security.
Knowledge of Snowflake data loading and transformation techniques.
Familiarity with Snowflake performance optimization and cost management.
Scripting and Automation: Proficiency in scripting languages such as Python, Bash, or PowerShell.
Experience with automation tools and techniques.
Networking and Security: Understanding of network concepts (TCP/IP, DNS, firewalls) and security principles.
Operating Systems: Familiarity with Linux and/or Windows Server operating systems.

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to
engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2024 global revenues of €22.1 billion.

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.

Ref. code 079358

Posted on 16 Apr 2025

Contract type Regular

Business unit I and D Global Business Line

When you join Capgemini, you don’t just start a new job. You become part of something bigger.

Learn about how the recruitment process works – how to apply, where to follow your application, and next steps.

To help you bring out the best of yourself during the interview process, we’ve got some great interview tips to share before the big day.