AWS Databricks Platform Support Architect

Machine Learning Technologies, LLC; Raritan (NJ); Presencial; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

Machine Learning Technologies, LLC seeks an AWS Databricks Platform Support Architect to lead administration, governance, and optimization of enterprise Databricks platforms on AWS from Raritan, NJ. You will oversee reliability, security, automation, and production support across Dev, QA, UAT, and Prod.

The role requires hands-on Databricks administration, AWS services proficiency, and experience with Terraform and CI/CD pipelines.

Formación

• 10 years in IT with 4 years of Databricks administration support
• Handson experience with AWS cloud platforms and enterprise production support
• Strong troubleshooting stakeholder management and leadership skills

Responsabilidades

• Architect and support AWS Databricks environments across Dev QA UAT and Prod
• Manage Databricks workspaces clusters jobs workflows Unity Catalog and access controls
• Provide L2/L3 production support incident management and root cause analysis
• Implement governance security IAM RBAC monitoring and compliance controls
• Optimize platform performance scalability and cloud costs
• Automate deployments using Terraform, CI/CD and Infrastructure as Code
• Collaborate with Data Engineering Cloud and Security teams on platform enhancements

Conocimientos

Databricks administration

Unity Catalog

Delta Lake

Cluster management

Jobs & Workflows

Spark

PySpark

Python

Shell scripting

Educación

IT experience

Databricks administration experience

Herramientas

AWS

Terraform

CI/CD

Infrastructure as Code

S3

EC2

Lambda

Glue

CloudWatch

Descripción del empleo

AWS Databricks Platform Support Architect

Location: Raritan, NJ

Duration: 12Months+ Extension

Domain Exposure: Education

Lead the administration support governance and optimization of enterprise Databricks platforms on AWS Responsible for platform reliability security automation performance and production support

Key Responsibilities:

• Architect and support AWS Databricks environments across Dev QA UAT and Prod
• Manage Databricks workspaces clusters jobs workflows Unity Catalog and access controls
• Provide L2L3 production support incident management and root cause analysis
• Implement governance security IAM RBAC monitoring and compliance controls
• Optimize platform performance scalability and cloud costs
• Automate deployments using Terraform CICD and Infrastructure as Code
• Collaborate with Data Engineering Cloud and Security teams on platform enhancements

Required Skills:

• Databricks Workspace Administration Unity Catalog Delta Lake Cluster Management Jobs Workflows
• AWS S3 IAM EC2 Lambda Glue CloudWatch VPC Secrets Manager
• Data Technologies Spark PySpark SQL Data LakeLakehouse Architecture
• Programming Python PySpark Shell Scripting

Qualifications:

• 10 years in IT with 4 years of Databricks administration support
• Handson experience with AWS cloud platforms and enterprise production support
• Strong troubleshooting stakeholder management and leadership skills

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.