Senior AWS Databricks Platform Architect

Quantum Technologies. LLC; Raritan (NJ); On-site; USD 170,000 - 240,000; Full time

Job summary

Quantum Technologies. LLC is seeking an AWS Databricks Platform Support Architect to lead governance, reliability, and optimization of enterprise Databricks on AWS across development, QA, UAT, and production.

You will own incident management, performance tuning, security controls, and cost optimization while collaborating with Data Engineering, Cloud, and Security teams to drive platform enhancements and scalable solutions.

Qualifications

• 10+ years in IT with Databricks administration experience.
• Hands-on AWS cloud and enterprise production support.
• Strong troubleshooting, stakeholder management and leadership skills.

Responsibilities

• Architect and support AWS Databricks environments across DEV QA UAT and Prod.
• Manage Databricks workspaces, clusters, jobs, workflows, Unity Catalog and access controls.
• Provide L2/L3 production support, incident management and root cause analysis.
• Implement governance, security IAM RBAC monitoring and compliance controls.
• Optimize platform performance, scalability and cloud costs.
• Automate deployments using Terraform, CI/CD and Infrastructure as Code.
• Collaborate with Data Engineering, Cloud and Security teams on platform enhancements.

Skills

Databricks Administration

Unity Catalog

Delta Lake

Cluster Management

Jobs & Workflows

AWS Cloud Services

Spark PySpark

Python Scripting

Tools

Terraform

CI/CD

Infrastructure as Code

CloudWatch

IAM

VPC

S3

EC2

Glue

Job description

Quantum Technologies. LLC is seeking an AWS Databricks Platform Support Architect to lead governance, reliability, and optimization of enterprise Databricks on AWS across development, QA, UAT, and production.

You will own incident management, performance tuning, security controls, and cost optimization while collaborating with Data Engineering, Cloud, and Security teams to drive platform enhancements and scalable solutions.