AWS Databricks Platform Support Architect

Quantum Technologies. LLC; Raritan (NJ); On-site; USD 170,000 - 240,000; Full time

Job summary

Quantum Technologies. LLC is seeking an AWS Databricks Platform Support Architect to lead governance, reliability, and optimization of enterprise Databricks on AWS across development, QA, UAT, and production.

You will own incident management, performance tuning, security controls, and cost optimization while collaborating with Data Engineering, Cloud, and Security teams to drive platform enhancements and scalable solutions.

Qualifications

• 10+ years in IT with Databricks administration experience.
• Hands-on AWS cloud and enterprise production support.
• Strong troubleshooting, stakeholder management and leadership skills.

Responsibilities

• Architect and support AWS Databricks environments across DEV QA UAT and Prod.
• Manage Databricks workspaces, clusters, jobs, workflows, Unity Catalog and access controls.
• Provide L2/L3 production support, incident management and root cause analysis.
• Implement governance, security IAM RBAC monitoring and compliance controls.
• Optimize platform performance, scalability and cloud costs.
• Automate deployments using Terraform, CI/CD and Infrastructure as Code.
• Collaborate with Data Engineering, Cloud and Security teams on platform enhancements.

Skills

Databricks Administration

Unity Catalog

Delta Lake

Cluster Management

Jobs & Workflows

AWS Cloud Services

Spark PySpark

Python Scripting

Tools

Terraform

CI/CD

Infrastructure as Code

CloudWatch

IAM

VPC

S3

EC2

Glue

Job description

AWS Databricks Platform Support Architect

Location: Raritan, NJ

Duration: 12Months+ Extension

Domain Exposure: Education

Lead the administration support governance and optimization of enterprise Databricks platforms on AWS Responsible for platform reliability security automation performance and production support

Key Responsibilities:

• Architect and support AWS Databricks environments across Dev QA UAT and Prod
• Manage Databricks workspaces clusters jobs workflows Unity Catalog and access controls
• Provide L2L3 production support incident management and root cause analysis
• Implement governance security IAM RBAC monitoring and compliance controls
• Optimize platform performance scalability and cloud costs
• Automate deployments using Terraform CICD and Infrastructure as Code
• Collaborate with Data Engineering Cloud and Security teams on platform enhancements

Required Skills:

• Databricks Workspace Administration Unity Catalog Delta Lake Cluster Management Jobs Workflows
• AWS S3 IAM EC2 Lambda Glue CloudWatch VPC Secrets Manager
• Data Technologies Spark PySpark SQL Data LakeLakehouse Architecture
• Programming Python PySpark Shell Scripting

Qualifications:

• 10 years in IT with 4 years of Databricks administration support
• Handson experience with AWS cloud platforms and enterprise production support
• Strong troubleshooting stakeholder management and leadership skills

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.