Technology Lead - Databricks Admin

Infosys Limited; Mississauga; Hybrid; CAD 93,000 - 123,000; Full time

Job summary

Infosys is seeking an experienced Databricks Administrator to manage, secure, and optimize Databricks environments on AWS. You will handle workspace governance, cluster management, and CI/CD integrations to support analytics and engineering teams.

The role requires 4+ years IT experience, 6+ years cloud-based DB administration, and Databricks expertise, with an Ontario relocation allowance and Ontario residency recommended.

Qualifications

• Bachelor’s degree or foreign equivalent required; three years of progressive experience may substitute.
• At least 4 years of Information Technology experience.
• 6+ years of experience in cloud-based database and platform administration (AWS/Azure) and Databricks administration.

Responsibilities

• Manage Databricks workspaces, clusters, pools, jobs, and user access controls.
• Implement and enforce cluster policies, workspace governance and standards.
• Oversee Libraries, Repos, and Job scheduling within Databricks.
• Provide L2/L3 support for platform issues, job failures, cluster outages, and maintenance.
• Automate deployment processes using Git-based workflows and maintain workspace automation scripts.
• Monitor performance, audit logs, and cost trends; optimize Spark configurations and autoscaling.
• Implement RBAC and secrets management; integrate with AWS IAM/Azure AD.
• Administer cloud-based databases (AWS/Azure) and S3/ADLS storage integrations.

Skills

Databricks

Cloud platforms (AWS/Azure)

Automation scripting (Python/Shell)

Education

Bachelor’s degree or foreign equivalent

Tools

GitHub Actions

Azure DevOps

Jenkins

Job description

Data Management|Big Data - Hadoop|Hadoop Administration, Technology|Consulting - Data Management|Technology

Domain

Delivery

Interest Group

Company

ITL Canada

Requisition ID

153573BR

Infosys is seeking an experienced Databricks Administrator with strong expertise in managing, securing, and optimizing Databricks environments on cloud platform: AWS. The ideal candidate should have hands-on experience in cloud database administration, cluster management, workspace governance, performance optimization, CI/CD integrations, and platform reliability.
The role supports our client's enterprise data modernization initiatives by ensuring a robust, scalable, and secure Databricks platform for analytics and engineering teams.
Required Qualifications:

• Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
• Candidate must be located within commuting distance of Mississauga, Ontario or be willing to relocate to the areas.
• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• At least 4 years of Information Technology experience

Preferred Qualifications:

• 6+ years of experience in cloud-based database and platform administration (AWS/Azure).
• 3+ years hands-on experience administering Databricks environments.
• Strong understanding of autoscaling, job orchestration, and pipeline execution.
• Deep knowledge of cloud storage, networking basics, IAM, and security best practices.
• Experience with Delta Lake, Unity Catalog, and workspace governance.
• Proficiency in scripting (Python, Shell, PowerShell) for automation.
• Experience with monitoring tools and log analytics (CloudWatch, Azure Monitor, Databricks Logs).
• Familiarity with DevOps and CI/CD (GitHub Actions, Azure DevOps, Jenkins).
• Databricks certifications (Admin, Associate Data Engineer, or Architect).
• Understanding of data engineering, ETL/ELT workflows, and big data concepts.

Key Responsibilities

Databricks Platform & Workspace Administration

• Manage and administer Databricks workspaces, clusters, pools, jobs, and user access controls.
• Implement and enforce cluster policies, workspace best practices, and governance standards.
• Oversee Libraries, Repos, and Job scheduling within Databricks.
• Monitor and optimize runtime versions, cluster configurations, and performance.

Operational Support

• Provide L2/L3 support for platform issues, job failures, cluster outages, and scheduled maintenance.
• Collaborate with Data Engineering, Security, Cloud Infra, and Governance teams.
• Support upgrades, migrations, patching, and operational improvements.

DevOps, Automation & CI/CD

• Automate deployment processes using Git-based workflows (Repos/GitHub).
• Develop and maintain scripts for workspace automation.
• Manage CI/CD pipelines for notebooks, jobs, and Delta pipelines.

Performance Monitoring & Optimization

• Troubleshoot cluster performance issues, job failures, and resource utilization.
• Optimize Spark configurations, autoscaling parameters, and workload management.
• Monitor audit logs, job runs, compute usage, and cost trends.

Security, Compliance & Access Management

• Implement role-based access control (RBAC) and workspace governance aligned with corporate security standards.
• Manage secrets, tokens, service principals, and integration with Azure AD / AWS IAM.
• Ensure compliance with data protection, logging, audit requirements, and enterprise governance.

Cloud & Database Administration

• Administer cloud-based databases (AWS/Azure), including provisioning, performance tuning, maintenance, and monitoring.
• Manage S3 / ADLS storage integrations, mount points, permissions, and lifecycle policies.
• Support ingestion frameworks and ETL/ELT workflows using Spark, Delta Lake, and Databricks Asset Bundles (optional).

The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements
Estimated annual compensation range for the candidate based in the below location will be:
Ontario: $ 92740 to $ 123375

Additional Required Qualifications

Databrick Administration
AWS/Azure
SQL
Database Administration

About Us

Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

EEO

Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.