AWS Databricks Platform Support Architect

Robotic Process Automation LLC; Raritan (NJ); On-site; USD 120,000 - 190,000; Full time

Job summary

Robotic Technologies Automation in New Jersey seeks an AWS Databricks Platform Support Architect to lead administration, governance and optimization of enterprise Databricks platforms on AWS. You will ensure platform reliability, security, automation, performance and production support across Dev/QA/UAT/Prod environments.

Responsibilities include architecture and support of Databricks environments, workspace and Unity Catalog governance, IAM RBAC and cost optimization, with hands-on incident

Qualifications

• 10 years in IT with 4 years of Databricks administration.
• Hands-on AWS cloud experience in enterprise production support.
• Strong troubleshooting, stakeholder management and leadership.

Responsibilities

• Architect and support AWS Databricks environments across Dev, QA, UAT and Prod.
• Manage Databricks workspaces, clusters, jobs, workflows, Unity Catalog and access controls.
• Provide L2/L3 production support, incident management and root cause analysis.
• Implement governance, security, IAM RBAC, monitoring and compliance controls.
• Optimize platform performance, scalability and cloud costs.
• Automate deployments using Terraform, CI/CD and Infrastructure as Code.
• Collaborate with Data Engineering, Cloud and Security teams on platform enhancements.

Skills

Databricks Workspace Administration

Unity Catalog

Delta Lake

Cluster Management

Jobs

Workflows

Tools

AWS

S3

IAM

EC2

Lambda

Glue

CloudWatch

VPC

Secrets Manager

Job description

AWS Databricks Platform Support Architect

Location: Raritan, NJ

Duration: 12Months+ Extension

Domain Exposure: Education

Lead the administration support governance and optimization of enterprise Databricks platforms on AWS Responsible for platform reliability security automation performance and production support

Key Responsibilities:

• Architect and support AWS Databricks environments across Dev QA UAT and Prod
• Manage Databricks workspaces clusters jobs workflows Unity Catalog and access controls
• Provide L2L3 production support incident management and root cause analysis
• Implement governance security IAM RBAC monitoring and compliance controls
• Optimize platform performance scalability and cloud costs
• Automate deployments using Terraform CICD and Infrastructure as Code
• Collaborate with Data Engineering Cloud and Security teams on platform enhancements

Required Skills:

• Databricks Workspace Administration Unity Catalog Delta Lake Cluster Management Jobs Workflows
• AWS S3 IAM EC2 Lambda Glue CloudWatch VPC Secrets Manager
• Data Technologies Spark PySpark SQL Data LakeLakehouse Architecture
• Programming Python PySpark Shell Scripting

Qualifications:

• 10 years in IT with 4 years of Databricks administration support
• Handson experience with AWS cloud platforms and enterprise production support
• Strong troubleshooting stakeholder management and leadership skills

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.