Databricks Platform Administrator | Data Eng & AI/ML

Sistema Technologies Inc.

Austin (TX)

Hybrid

USD 120,000 - 170,000

Full time

4 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Texas Health and Human Services Commission (HHSC) in Austin seeks a Systems Analyst with deep Databricks and cloud data platform expertise. You will analyze business objectives, identify data-driven solutions, and document requirements for automated processing and improved systems.

The role requires 8+ years in Databricks administration, cluster governance, and security, with on-site/hybrid work. Collaborate with data engineers, analysts, and IT teams to support scalable analytics and AI

Qualifications

8+ years administering Databricks workspaces in AWS.
Strong knowledge of Databricks cluster configuration, scheduling, and workspace management.
Experience managing user access, roles, and permissions using IAM, SCIM, and RBAC.
Proficiency with Apache Spark concepts, including performance tuning and troubleshooting.
Experience integrating Databricks with cloud storage services (e.g., S3).
Implementing and enforcing cluster policies and workspace governance standards.
Familiarity with Databricks SQL, notebooks, and job orchestration.
Experience monitoring platform health, performance, and availability.
Understanding of data security, encryption, and compliance requirements.
Experience with DevOps or automation tools (Terraform, CI/CD pipelines, scripting).
Experience administering Databricks in enterprise/government environments.
Databricks Unity Catalog for data governance.
Cost management and optimization for Databricks workloads.
AI/ML workloads using Databricks ML/MLflow.
Familiarity with data lake and lakehouse architectures.
Python, SQL, or Scala for administration and troubleshooting.

Responsibilities

Understands business objectives and problems; analyzes alternatives and conducts cost/benefit analyses.
Analyzes user requirements and procedures to automate processing or improve existing systems.
Writes detailed descriptions of user needs, program functions, and steps for development or modification.
Reviews system capabilities, specs, and scheduling to determine feasibility within the existing system.
Administers, configures, and supports the Databricks platform to enable scalable data engineering, analytics, and AI/ML workloads.
Manages workspace configuration, cluster policies, user access, and integrations with cloud services; monitors platform health.
Collaborates with data engineers, analysts, and data scientists to support data and analytics initiatives.
Ensures security, compliance, and cost controls are applied across the Databricks environment.