AWS Databricks Platform Support Architect

Valiant Technologies LLC; Raritan (NJ); Presencial; USD 140.000 - 180.000; Jornada completa

Descripción de la vacante

Valiant Technologies LLC in New Jersey seeks an AWS Databricks Platform Support Architect to lead administration, governance, and optimization of enterprise Databricks platforms on AWS. Responsibilities include reliability, security, automation, and production support across Dev, QA, UAT, and Prod.

The role requires hands-on Databricks administration and strong collaboration with Data Engineering, Cloud, and Security teams to implement IAM, Unity Catalog, and cost optimization.

Formación

• 10+ years in IT with Databricks administration experience.
• Hands-on AWS cloud and enterprise production support.
• Strong troubleshooting, stakeholder management and leadership skills.

Responsabilidades

• Architect and support AWS Databricks environments across Dev QA UAT and Prod.
• Manage Databricks workspaces, clusters, jobs, workflows, Unity Catalog and access controls.
• Provide L2/L3 production support, incident management and root cause analysis.
• Implement governance, security IAM, RBAC, monitoring and compliance controls.
• Optimize platform performance, scalability and cloud costs.
• Automate deployments using Terraform, CI/CD and Infrastructure as Code.
• Collaborate with Data Engineering, Cloud and Security teams on platform enhancements.

Conocimientos

Databricks Admin

Unity Catalog

AWS Cloud

IAM & RBAC

Terraform

CI/CD

Data Lakehouse

Python / PySpark

GitHub Actions

Herramientas

Terraform

CI/CD Tools

Descripción del empleo

AWS Databricks Platform Support Architect

Location: Raritan, NJ

Duration: 12Months+ Extension

Domain Exposure: Education

Lead the administration support governance and optimization of enterprise Databricks platforms on AWS Responsible for platform reliability security automation performance and production support

Key Responsibilities:

• Architect and support AWS Databricks environments across Dev QA UAT and Prod
• Manage Databricks workspaces clusters jobs workflows Unity Catalog and access controls
• Provide L2L3 production support incident management and root cause analysis
• Implement governance security IAM RBAC monitoring and compliance controls
• Optimize platform performance scalability and cloud costs
• Automate deployments using Terraform CICD and Infrastructure as Code
• Collaborate with Data Engineering Cloud and Security teams on platform enhancements

Required Skills:

• Databricks Workspace Administration Unity Catalog Delta Lake Cluster Management Jobs Workflows
• AWS S3 IAM EC2 Lambda Glue CloudWatch VPC Secrets Manager
• Data Technologies Spark PySpark SQL Data LakeLakehouse Architecture
• Programming Python PySpark Shell Scripting

Qualifications:

• 10 years in IT with 4 years of Databricks administration support
• Handson experience with AWS cloud platforms and enterprise production support
• Strong troubleshooting stakeholder management and leadership skills

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.