Senior AWS Databricks Platform Engineer

Extend Information Systems Inc.; Raritan (NJ); On-site; USD 120,000 - 190,000; Full time

Job summary

Extend Information Systems Inc. in Raritan, NJ seeks an experienced AWS Databricks Platform Administrator to own platform reliability, security, and cost management across analytics workloads.

You will manage Databricks on AWS, Unity Catalog, and associated services, ensuring scalable, secure operations. The role requires strong Databricks administration skills, AWS knowledge, and production-support experience, with automation using Terraform and Python.

Qualifications

• 9 years of overall experience in cloud infrastructure, data platforms, DevOps, or production administration.
• 5 years of hands-on Databricks administration, preferably enterprise deployments on AWS.
• Strong knowledge of Databricks account console, workspace administration, Unity Catalog, clusters, SQL warehouses, jobs, and audit logs.
• Strong knowledge of AWS networking, security, storage, encryption, monitoring, and identity services.
• Hands-on IaC and automation using Terraform, Python, REST APIs, and CICD tools.
• Experience supporting production platforms with incident response, capacity planning, and SLA governance.
• Bachelor's degree or equivalent experience; Databricks account and Unity Catalog administration.

Responsibilities

• Administer and support Databricks accounts, workspaces, Unity Catalog, metastores, clusters, and jobs on AWS.
• Design secure, scalable, highly available Databricks platform architecture aligned with cloud standards.
• Manage identity and access via IAM roles, SCIM, and RBAC.
• Implement data governance using Unity Catalog including catalogs, schemas, and auditability.
• Configure AWS integrations such as S3, VPC, KMS, CloudWatch, CloudTrail, and Secrets Manager.
• Establish policies, tagging, and workload isolation; monitor health, performance, and capacity.
• Drive FinOps through DBU analysis, cost controls, and optimization of compute resources.
• Automate provisioning and policy enforcement using Terraform, Databricks CLI/SDK, and CICD pipelines.
• Lead incident, problem, change, release, vulnerability, and service requests with SLAs.
• Plan runtime upgrades, migrations, DR tests, backups, and continuity activities.
• Collaborate with data engineering, security, networking, and cloud teams to onboard workloads.
• Maintain runbooks, SOPs, and knowledge articles; provide technical leadership and roadmaps.

Skills

AWS S3

Databricks

Redshift

IAM

Terraform

Python

REST APIs

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or related field

Tools

Databricks CLI/SDK

Terraform

Python

Job description

Extend Information Systems Inc. in Raritan, NJ seeks an experienced AWS Databricks Platform Administrator to own platform reliability, security, and cost management across analytics workloads.

You will manage Databricks on AWS, Unity Catalog, and associated services, ensuring scalable, secure operations. The role requires strong Databricks administration skills, AWS knowledge, and production-support experience, with automation using Terraform and Python.