Databricks Administrator - Local to Georgia

New Era Technology Europe; Alpharetta (GA); On-site; USD 90,000 - 130,000; Full time

Job summary

A technology solutions company is seeking a Senior Databricks Administrator located in Georgia. This role involves designing and optimizing a scalable Databricks platform for AI and ML workloads. The ideal candidate has proven experience with Terraform, strong programming skills in Python and Java, and hands-on experience working with Databricks and cloud services. This is a contract position oriented towards information technology and computer security.

Qualifications

• Proven experience with Terraform for building and managing infrastructure.
• Hands-on experience with cloud networking and access management in Azure.
• Experience with Databricks and its functionalities such as MLFlow and Delta Lake.

Responsibilities

• Design and implement secure Databricks environments for AI/ML workloads.
• Develop infrastructure-as-code solutions using Terraform.
• Build automation capabilities with Python and Java.

Skills

Terraform

Python

Java

Azure Networking

Databricks

Distributed System Design

CI/CD Pipelines

Monitoring and Observability

Communication

Job description

Databricks Administrator - Local to Georgia

We are looking for a Senior Databricks AI Platform SRE to join our Platform SRE team. This role will be critical in designing, building, and optimizing a scalable, secure, and developer-friendly Databricks platform to enable Machine Learning (ML) and Artificial Intelligence (AI) workloads at enterprise scale.

You will partner with ML engineers, data scientists, platform teams, and cloud architects to automate infrastructure, enforce best practices, and streamline the end-to-end ML lifecycle using modern cloud-native technologies.

Responsibilities

• Design and implement secure, scalable, and automated Databricks environments to support AI/ML workloads.
• Develop infrastructure-as-code (IaC) solutions using Terraform for provisioning Databricks, cloud resources, and network configurations.
• Build automation and self-service capabilities using Python, Java and APIs for platform onboarding, workspace provisioning, orchestration and monitoring.
• Collaborate with data science and ML teams to define compute requirements, governance policies, and efficient workflows across dev/qa/prod environments.
• Integrate Databricks offering with cloud-native services on Azure/AWS
• Champion CI/CD and GitOps for managing ML infrastructure and configurations.
• Ensure compliance with enterprise security and data governance policies using RBAC, Audit Controls, Encryption, Network Isolation, and policies.
• Monitor platform performance, reliability, and usage, and drive improvements to optimize cost and resource utilizations.

Required Skills

• Proven experience with Terraform for building and managing infrastructure.
• Strong programming skills in Python and Java
• Hands-on experience with cloud networking, identity and access management, key vaults, monitoring, and logging in Azure
• Hands on experience with Databricks (Workspace management, Clusters, Jobs, MLFlow, Delta Lake, Unity Catalog, Mosaic AI)
• Deep understanding of Azure or AWS infrastructure (e.g. IAM, VNets/VPC, Storage, Networks, Compute, Key management, monitoring)
• Strong experience in distributed system design, development and deployment using agile/devops practices.
• Experience with CI/CD pipelines (GitHub Actions, or similar)
• Experience implementing monitoring and observability using Prometheus, Grafana or Databricks-native solutions.
• Good communication skills, excellent teamwork experience, ability to mentor and develop more junior developers, including participating in constructive code reviews

Preferred Skills

• Experience in multi-cloud environments (AWS/GCP) is a bonus
• Experience in working in highly regulated environments (finance, healthcare, etc.) is desirable
• Experience with Databricks REST APIs and SDKs
• Knowledge of MLFlow, Mosaic AC, & MLOps tooling
• Working with teams using Scrum, Kanban or other agile practices
• Proficiency with standard Linux command line and debugging tools

Azure or AWS Certifications

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Information Technology
• Industries
• Computer and Network Security