AWS Databricks Platform Administrator

CloudBigD

Raritan (NJ)

Remote

USD 94,000 - 134,000

Full time

34 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CloudBigD is seeking an experienced AWS Databricks Platform Administrator to own platform reliability, governance, security, and cost management across enterprise data workloads on AWS. The role requires deep Databricks administration know-how, cloud security, and production support expertise.

You will drive automation, incident management, and platform upgrades while coordinating with data engineering and security teams to onboard workloads and maintain park diagrams and runbooks.

Qualifications

  • 9+ years IT experience with Databricks on AWS.
  • Hands-on administration, security, optimization and support of Databricks in AWS.
  • Experience with production support and platform governance.

Responsibilities

  • Administer and support Databricks accounts, workspaces, Unity Catalog and clusters on AWS.
  • Design secure, scalable and highly available Databricks platform architecture.
  • Manage IAM roles, service principals, SCIM provisioning, and access controls.
  • Implement Unity Catalog governance with catalogs, schemas, privileges and audits.
  • Configure AWS integrations (S3, IAM, VPC, KMS, CloudWatch, etc.) and Secrets Manager.
  • Establish policies for runtime, tagging, workload isolation and cost controls.
  • Monitor health, performance, capacity and optimize resource usage.
  • Lead FinOps efforts, analyze DBU and AWS consumption, enforce budgets.
  • Automate provisioning and policy enforcement using Terraform and Databricks tools.
  • Lead incident, change, release and security management with SLAs and KPIs.

Skills

Databricks administration
AWS
Terraform
Python
CI/CD pipelines
Cloud security
FinOps

Tools

Databricks CLI/SDK
Databricks Asset Bundles
Terraform
Python
CI/CD tooling
AWS services (S3 IAM)

Job description

AWS Databricks Platform Administrator

Location: Raritan, NJ (Remote)

Duration: 24 Months + Extension

Bill Rate: $83/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H4-EAD, Other

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Description:

We are seeking an experienced AWS Databricks Platform Administrator with 9 years of overall IT experience including substantial handson expertise in administering securing optimizing and supporting Databricks on AWS The role will own platform reliability governance security cost management automation and operational excellence across enterprise data and analytics workloads The ideal candidate combines strong Databricks administration skills with deep knowledge of AWS services infrastructure automation cloud security and production support

Key Responsibilities:
  • Administer and support Databricks accounts workspaces Unity Catalog metastores clusters SQL warehouses jobs instance pools repositories libraries secrets and access controls on AWS
  • Design and maintain secure scalable and highly available Databricks platform architecture aligned with enterprise cloud standards
  • Manage identity and access through IAM roles and policies service principals single signon SCIM provisioning and rolebased access control
  • Implement data governance using Unity Catalog including catalogs schemas external locations storage credentials privileges lineage and auditability
  • Configure and troubleshoot AWS integrations such as S3 IAM VPC PrivateLink KMS CloudWatch CloudTrail Route 53 and Secrets Manager
  • Establish cluster policies approved runtime standards library controls tagging autotermination serverless usage guidelines and workload isolation
  • Monitor platform health performance job reliability capacity and usage proactively identify and resolve bottlenecks and recurring issues
  • Drive FinOps practices by analyzing DBU and AWS consumption enforcing tagging and budgets optimizing compute configurations and reducing idle or inefficient resources
  • Automate workspace provisioning configuration policy enforcement and operational tasks using Terraform Databricks Asset Bundles Databricks CLISDK Python and CICD pipelines
  • Lead incident problem change release vulnerability and servicerequest management for the platform while meeting agreed SLAs and operational KPIs
  • Plan and execute runtime upgrades platform migrations disasterrecovery tests backup validation and businesscontinuity activities
  • Partner with data engineering analytics security networking cloud engineering and application teams to onboard workloads and resolve complex technical issues
  • Maintain architecture diagrams runbooks standard operating procedures support documentation compliance evidence and knowledge articles
  • Provide technical leadership mentor administrators and engineers conduct reviews and define platform standards and product roadmaps
  • Coordinate with Databricks and AWS support teams for critical incidents product defects and service improvements

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AWS Databricks Platform Administrator
AWS Databricks Platform Administrator

Robotics Technologies • Raritan (NJ)

Remote
USD 96,000 - 132,000
AWS Databricks Platform Administrator
AWS Databricks Platform Administrator

Valiant Technologies LLC • Raritan (NJ)

Remote
USD 94,000 - 134,000
AWS Databricks Platform Administrator
AWS Databricks Platform Administrator

Robotic Process Automation LLC • Raritan (NJ)

Remote
USD 94,000 - 134,000
AWS Databricks Platform Administrator
AWS Databricks Platform Administrator

Quantum Technologies LLC • Raritan (NJ)

Remote
USD 94,000 - 134,000
AWS Databricks Platform Administrator
AWS Databricks Platform Administrator

Ethereum Technologies LLC • Raritan (NJ)

Remote
USD 98,000 - 131,000
AWS Databricks Platform Administrator
AWS Databricks Platform Administrator

MACHINE LEARNING TECHNOLOGIES LLC • Raritan (NJ)

Hybrid
USD 96,000 - 138,000
AWS Databricks Platform Support Architect
AWS Databricks Platform Support Architect

Ethereum Technologies LLC • Raritan (NJ)

On-site
USD 150,000 - 190,000
AWS Databricks Platform Support Architect
AWS Databricks Platform Support Architect

Robotic Process Automation LLC • Raritan (NJ)

On-site
USD 120,000 - 190,000
AWS Databricks Platform Support Architect
AWS Databricks Platform Support Architect

Quantum Technologies LLC • Raritan (NJ)

On-site
USD 170,000 - 240,000
AWS Databricks Platform Support Architect
AWS Databricks Platform Support Architect

Valiant Technologies LLC • Raritan (NJ)

On-site
USD 140,000 - 180,000