AWS Databricks Platform Architect - Production Reliability

Machine Learning Technologies, LLC; Raritan (NJ); Presencial; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

Machine Learning Technologies, LLC seeks an AWS Databricks Platform Support Architect to lead administration, governance, and optimization of enterprise Databricks platforms on AWS from Raritan, NJ. You will oversee reliability, security, automation, and production support across Dev, QA, UAT, and Prod.

The role requires hands-on Databricks administration, AWS services proficiency, and experience with Terraform and CI/CD pipelines.

Formación

• 10 years in IT with 4 years of Databricks administration support
• Handson experience with AWS cloud platforms and enterprise production support
• Strong troubleshooting stakeholder management and leadership skills

Responsabilidades

• Architect and support AWS Databricks environments across Dev QA UAT and Prod
• Manage Databricks workspaces clusters jobs workflows Unity Catalog and access controls
• Provide L2/L3 production support incident management and root cause analysis
• Implement governance security IAM RBAC monitoring and compliance controls
• Optimize platform performance scalability and cloud costs
• Automate deployments using Terraform, CI/CD and Infrastructure as Code
• Collaborate with Data Engineering Cloud and Security teams on platform enhancements

Conocimientos

Databricks administration

Unity Catalog

Delta Lake

Cluster management

Jobs & Workflows

Spark

PySpark

Python

Shell scripting

Educación

IT experience

Databricks administration experience

Herramientas

AWS

Terraform

CI/CD

Infrastructure as Code

S3

EC2

Lambda

Glue

CloudWatch

Descripción del empleo

Machine Learning Technologies, LLC seeks an AWS Databricks Platform Support Architect to lead administration, governance, and optimization of enterprise Databricks platforms on AWS from Raritan, NJ. You will oversee reliability, security, automation, and production support across Dev, QA, UAT, and Prod.

The role requires hands-on Databricks administration, AWS services proficiency, and experience with Terraform and CI/CD pipelines.