AWS Databricks Platform Admin

Advance Career Solutions; Hyderabad, Chennai District, Bengaluru; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Advance Career Solutions is seeking an experienced Databricks Administrator for Pan India operations. The role focuses on AWS Databricks administration, cluster management, security, and workspace governance.

You will manage Databricks workspaces, optimize clusters and jobs, implement security policies, and automate deployments using Terraform and CI/CD across AWS services.

Qualifications

• 5+ years of experience as a Databricks Administrator.
• Strong experience with AWS Databricks.
• Databricks clusters, jobs, notebooks, repos, and workspaces.
• Apache Spark, Delta Lake, and MLflow.
• AWS IAM, S3, EC2, VPC, CloudWatch.
• Python or Scala.
• Databricks SQL.
• Unity Catalog and access management.
• Cloud networking and troubleshooting.
• Terraform / CloudFormation / AWS CDK.
• CI/CD for Databricks notebooks and pipelines.

Responsibilities

• Manage and administer AWS Databricks workspaces.
• Manage and optimize clusters, jobs, and SQL warehouses.
• Manage users, permissions, security policies, and access controls.
• Monitor performance and troubleshoot issues.
• Automate deployments using Terraform or similar tools.
• Integrate Databricks with AWS services such as S3, Kinesis, Redshift, and Glue.
• Support development and engineering teams with Databricks-related issues.
• Ensure security and compliance standards are followed.

Skills

Databricks Administrator

AWS Databricks

Databricks components

Spark Delta MLflow

AWS services

Python/Scala

Databricks SQL

Unity Catalog

Cloud networking

Terraform / CloudFormation / AWS CDK

CI/CD for Databricks

Tools

Terraform

CloudFormation

AWS CDK

Job description

Job Title: Databricks Administrator
Experience: 5+ Years
Location: Pan India
Employment Type: Full-Time

Job Description

We are looking for an experienced Databricks Administrator with strong experience in AWS Databricks administration, cluster management, security, and workspace management.

Mandatory Skills

• 5+ years of experience as a Databricks Administrator
• Strong experience with AWS Databricks
• Databricks clusters, jobs, notebooks, repos, and workspaces
• Apache Spark, Delta Lake, and MLflow
• AWS IAM, S3, EC2, VPC, CloudWatch
• Python or Scala
• Databricks SQL
• Unity Catalog and access management
• Cloud networking and troubleshooting
• Terraform / CloudFormation / AWS CDK
• CI/CD for Databricks notebooks and pipelines

Responsibilities

• Manage and administer AWS Databricks workspaces.
• Manage and optimize clusters, jobs, and SQL warehouses.
• Manage users, permissions, security policies, and access controls.
• Monitor performance and troubleshoot issues.
• Automate deployments using Terraform or similar tools.
• Integrate Databricks with AWS services such as S3, Kinesis, Redshift, and Glue.
• Support development and engineering teams with Databricks-related issues.
• Ensure security and compliance standards are followed.

Key Skills

Databricks Admin | AWS | Unity Catalog | Spark | Delta Lake | Python | SQL | IAM | S3 | Terraform | CI/CD