Data Architect

Sibitalent Corp; Atlanta (GA); Hybrid; Full time

Job summary

A technology solutions company is seeking a Databricks Platform Engineer for its Atlanta location, primarily remote. The ideal candidate has over five years of experience in Databricks administration and optimizing environments for performance and cost efficiency. Responsibilities include developing and maintaining data pipelines and implementing MLOps solutions. A strong knowledge of cloud platforms and enterprise data security is essential. This opportunity is ideal for individuals with expertise in distributed computing and data governance.

Qualifications

• 5+ years of experience with Databricks Account and Workspace Administration, including governance, configuration, and security management.
• Experience with optimizing Databricks environments for cost efficiency, performance, and reliability.
• Experience with developing and maintaining Databricks data pipelines using Autoloader, Delta Live Tables, and Databricks Workflows.
• Experience with implementing MLOps solutions using MLflow 2.0/3.0, Serving Endpoints, and Model Registry in production environments.
• Experience with Databricks SQL tools such as Queries and AI/BI Dashboards.
• Experience with large datasets and distributed computing across cloud platforms.
• Knowledge of Unity Catalog Governance Architecture and enterprise data security best practices.

Skills

Databricks Account and Workspace Administration

Optimizing Databricks environments

Developing Databricks data pipelines

Implementing MLOps solutions

Databricks SQL tools

Distributed computing across cloud platforms

Unity Catalog Governance Architecture

Job description

Job Position: Databricks Platform Engineer

Job Type: W2

Location: Atlanta, GA (90% Remote)

You Must Have:

• 5+ years of experience with Databricks Account and Workspace Administration, including governance, configuration, and security management
• Experience with optimizing Databricks environments for cost efficiency, performance, and reliability
• Experience with developing and maintaining Databricks data pipelines using Autoloader, Delta Live Tables, and Databricks Workflows
• Experience with implementing MLOps solutions using MLflow 2.0/3.0, Serving Endpoints, and Model Registry in production environments
• Experience with Databricks SQL tools such as Queries and AI/BI Dashboards
• Experience with large datasets and distributed computing across cloud platforms (AWS, GCP, Azure), including Azure services like Entra ID, Data Factory, Key Vault, and Purview
• Knowledge of Unity Catalog Governance Architecture and enterprise data security best practices