Databricks Administration

Infosys; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Infosys in Bengaluru, India seeks an experienced Databricks Administrator to manage Databricks workspaces, clusters, access controls, and governance. The role emphasizes cost control, security, and reliability across notebooks and jobs.

You will collaborate with data and engineering teams, implement automation, and contribute to platform stability and documentation. Prior experience with cloud platforms is essential.

Qualifications

• Minimum qualifications include a bachelor's degree or equivalent in engineering or computer science.
• 3–5 years of platform administration experience with hands-on Databricks administration.
• Experience with cloud platforms, IAM, storage, compute, and governance in shared environments.

Responsibilities

• Administer and maintain Databricks workspaces, clusters, and compute policies for availability and performance.
• Manage user access, roles, permissions, and workspace governance aligned to security best practices.
• Monitor platform health, job reliability, and troubleshoot notebook, job, and connectivity issues.
• Implement cost optimization via cluster sizing, auto-scaling, scheduling, and usage reporting.
• Support integrations with cloud services and storage with secure data access patterns.
• Create and maintain runbooks and standard operating procedures for admin tasks.
• Partner with engineering and data teams to onboard workloads and improve usability.
• Assist with incident response, root-cause analysis, and continuous improvements.

Skills

Databricks Administration

Platform administration

Cloud concepts

Security governance

Troubleshooting

Collaboration with data teams

Education

Bachelor's degree or equivalent in Engineering, Computer Science, MCA, MSc, or related discipline

Tools

Terraform

CI/CD

Python scripting

Grafana

Prometheus

CloudWatch

IAM

Job description

• Primary skills:Technology->Data Engineering->Databricks

• Primary skills:Technology->Data Engineering->Databricks

Key Responsibilities:

• Administer and maintain Databricks workspaces, clusters, and compute policies to ensure high availability and performance.
• Configure and manage user access, roles, permissions, and workspace governance aligned to security best practices.
• Monitor platform health, job reliability, cluster utilization, and troubleshoot failures across notebooks, jobs, and connectivity.
• Implement cost optimization practices such as cluster sizing, auto-scaling, scheduling, and usage reporting.
• Support integrations with cloud services and storage, ensuring stable connectivity and secure data access patterns.
• Create and maintain operational documentation, runbooks, and standard procedures for recurring administration tasks.
• Partner with engineering and data teams to onboard workloads, enforce standards, and improve platform usability.
• Assist with incident response, root-cause analysis, and continuous improvements to reduce operational risk.

Minimum Qualifications:

• Bachelor's degree or equivalent in Engineering, Computer Science, MCA, MSc, or related discipline.
• 3-5 years of experience in platform administration/support with hands-on Databricks Administration.
• Working experience with cloud platforms and core cloud concepts (networking, IAM, storage, compute).
• Experience managing access controls, policies, and operational governance in a shared environment.
• Strong troubleshooting skills with the ability to analyze logs/metrics and resolve platform issues effectively.

Preferred Qualifications:

• Experience operating Databricks on major cloud platforms with an understanding of cloud-native security and governance.
• Exposure to automation for administrative tasks and environment standardization to improve reliability and speed.
• Proven ability to drive performance tuning and cost optimization for compute workloads in cloud environments.
• Experience supporting multiple teams, prioritizing requests, and communicating clearly with technical and non-technical stakeholders.
• Familiarity with monitoring/alerting practices and building operational dashboards for platform visibility.
• Good to have skills: Terraform, CI/CD, Python scripting, Monitoring & Alerting (Grafana/Prometheus/CloudWatch), Identity & Access Management (IAM)