AWS Databricks Platform Administrator at Neshent Technologies Raritan, NJ

Healing Strides Counseling; Raritan (NJ); Sur place; USD 150 000 - 210 000; Plein temps

Résumé du poste

Healing Strides Counseling is seeking a Senior Databricks Platform Engineer to administer, secure, and optimize Databricks environments on AWS. You will focus on platform reliability, governance, automation, and production support for enterprise data platforms.

Responsibilities include managing Unity Catalog, clusters, and SQL warehouses; implementing security policies; and driving cost optimization with Terraform, Python, and CI/CD pipelines.

Qualifications

• 9+ years of IT experience with at least 5 years of hands-on Databricks administration.

Responsabilités

• Administer Databricks workspaces, Unity Catalog, clusters, SQL warehouses, jobs, secrets, and access controls.

Connaissances

Databricks administration

AWS cloud services

Terraform

Python scripting

CI/CD pipelines

Unity Catalog

Delta Lake

Apache Spark

Cloud security

Production support

Formation

Bachelor’s degree in Computer Science/IT/Engineering

Outils

Databricks CLI/SDK

Terraform

CI/CD tooling

CloudWatch

CloudTrail

Description du poste

Job Summary

We are seeking a Senior Databricks Platform Engineer with strong hands-on experience in administering, securing, optimizing, and supporting Databricks environments on AWS. The role focuses on platform reliability, security, governance, automation, cost optimization, and production support for enterprise data platforms.

Key Responsibilities

• Administer Databricks workspaces, Unity Catalog, clusters, SQL warehouses, jobs, secrets, and access controls.


• Manage AWS integrations, including S3, IAM, VPC, KMS, PrivateLink, CloudWatch, and CloudTrail.


• Implement security, identity management, data governance, and access control policies.


• Automate platform provisioning and operations using Terraform, Python, Databricks CLI/SDK, and CI/CD pipelines.


• Monitor platform performance, troubleshoot production issues, manage incidents, and ensure SLA compliance.


• Optimize Databricks and AWS resource utilization and costs.


• Manage platform upgrades, disaster recovery, compliance, and operational documentation.


• Collaborate with cloud, security, and data engineering teams and provide technical guidance.

Required Qualifications

• 9+ years of overall IT experience, with at least 5 years of hands‑on Databricks administration experience.


• Strong knowledge of Databricks on AWS, Unity Catalog, Delta Lake, Apache Spark, clusters, jobs, and SQL warehouses.


• Hands‑on experience with AWS services, including S3, IAM, VPC, KMS, PrivateLink, CloudWatch, and CloudTrail.


• Experience with Terraform, Python, shell scripting, REST APIs, Databricks CLI/SDK, and CI/CD.


• Strong understanding of cloud security, networking, monitoring, performance tuning, FinOps, and production support.


• Bachelor's degree in Computer Science, IT, Engineering, or equivalent relevant experience.