Databricks Administration

Infosys; Bengaluru; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Infosys seeks a Databricks Platform Administrator in Bengaluru to manage Databricks workspaces, clusters, and compute policies, ensuring high availability and performance. You will control access, roles, and governance while monitoring health and optimizing costs.

You will collaborate with engineering and data teams, onboard workloads, and implement security and operational standards to minimize risk and maximize platform usability.

Qualifications

• 3–5 years of Databricks administration experience.
• Hands-on Databricks administration and support experience.
• Experience with cloud platforms and core cloud concepts (networking, storage, compute).
• Experience managing access controls, policies, and governance in a shared environment.
• Strong troubleshooting skills with logs and metrics.

Responsibilities

• Administer and maintain Databricks workspaces, clusters, and compute policies for high availability.
• Configure and manage user access, roles, permissions, and workspace governance.
• Monitor platform health, job reliability, and troubleshoot notebooks, jobs, and connectivity.
• Implement cost optimization such as cluster sizing, auto-scaling, scheduling, and usage reporting.
• Support integrations with cloud services and storage with secure data access patterns.
• Create and maintain runbooks and standard procedures for admin tasks.
• Partner with engineering and data teams to onboard workloads and improve usability.
• Assist with incident response and root-cause analysis to reduce operational risk.

Skills

Databricks administration

Cloud platforms

IAM & access governance

Troubleshooting

Cost optimization

Scripting (Python)

Education

Bachelor's degree in Engineering/CS

Tools

Terraform

CI/CD

Python scripting

Grafana/Prometheus/CloudWatch

IAM

Job description

• Primary skills:Technology->Data Engineering->Databricks
  

• Primary skills:Technology->Data Engineering->Databricks
  

Key Responsibilities:

• Administer and maintain Databricks workspaces, clusters, and compute policies to ensure high availability and performance.
• Configure and manage user access, roles, permissions, and workspace governance aligned to security best practices.
• Monitor platform health, job reliability, cluster utilization, and troubleshoot failures across notebooks, jobs, and connectivity.
• Implement cost optimization practices such as cluster sizing, auto-scaling, scheduling, and usage reporting.
• Support integrations with cloud services and storage, ensuring stable connectivity and secure data access patterns.
• Create and maintain operational documentation, runbooks, and standard procedures for recurring administration tasks.
• Partner with engineering and data teams to onboard workloads, enforce standards, and improve platform usability.
• Assist with incident response, root-cause analysis, and continuous improvements to reduce operational risk.

Minimum Qualifications:

• Bachelor's degree or equivalent in Engineering, Computer Science, MCA, MSc, or related discipline.
• 3–5 years of experience in platform administration/support with hands-on Databricks Administration.
• Working experience with cloud platforms and core cloud concepts (networking, IAM, storage, compute).
• Experience managing access controls, policies, and operational governance in a shared environment.
• Strong troubleshooting skills with the ability to analyze logs/metrics and resolve platform issues effectively.

Preferred Qualifications:

• Experience operating Databricks on major cloud platforms with an understanding of cloud-native security and governance.
• Exposure to automation for administrative tasks and environment standardization to improve reliability and speed.
• Proven ability to drive performance tuning and cost optimization for compute workloads in cloud environments.
• Experience supporting multiple teams, prioritizing requests, and communicating clearly with technical and non-technical stakeholders.
• Familiarity with monitoring/alerting practices and building operational dashboards for platform visibility. Good to have skills: Terraform, CI/CD, Python scripting, Monitoring & Alerting (Grafana/Prometheus/CloudWatch), Identity & Access Management (IAM)