Local Databricks Admin with AWS

InnoSoul, Inc.; United States; Hybrid; USD 100,000 - 167,000; Full time

Job summary

InnoSoul, Inc. is seeking a Databricks Administrator for a 3-month hybrid role in Austin, TX. The position focuses on administering the Databricks platform in AWS, managing clusters, access controls, and data governance to support data engineering, analytics, and AI/ML workflows.

The ideal candidate brings extensive Databricks experience, strong Spark knowledge, and familiarity with S3 integration, Terraform/CI/CD, and security/compliance requirements. Local Texas residency is required.

Qualifications

• 8+ years experience administering Databricks in AWS cloud.
• Strong knowledge of cluster config, job scheduling, and workspace management.
• Experience with IAM/SCIM/RBAC and data security controls.

Responsibilities

• Administer, configure, and support Databricks platform for scalable data workloads.
• Ensure reliability, security, cost optimization, and compliance.

Skills

Databricks Admin

Cluster configuration

IAM/SCIM/RBAC

Apache Spark

S3 integration

Cluster policies

Databricks SQL

Platform monitoring

Security & encryption

Enterprise/government environment

Unity Catalog

Cost management

Databricks ML/MLflow

Job description

Job ID: TX-529601692 (913090409)

Hybrid/Local (Austin ONLY) Databricks Admin with AWS, S3, IAM, SCIM, RBAC, Apache Spark, SQL notebooks, encryption, DevOps, Terraform, CI/CD, Unity Catalog, AI/ML, MLflow, data lake/lakehouse, Python/SQL/Scala experience

Location: Austin, TX (HHSC)

Duration: 3 Months

Position is ONSITE/Hybrid at the location listed above (with some hybrid work - determined by the hiring manager). The program will only accept LOCAL ONLY candidates for this position. The program will only allow candidates who are LOCAL TO THE AUSTIN AREA ONLY. Please do not submit candidates who are currently out of state and are planning to move to Texas. Candidates must already reside in Texas.

Skills

• 8 Required Experience administering Databricks workspaces in a cloud environment - AWS
• 8 Required Strong understanding of Databricks cluster configuration, job scheduling, and workspace management.
• 8 Required Experience managing user access, roles, and permissions using IAM, SCIM, and role-based access control (RBAC).
• 8 Required Proficiency with Apache Spark concepts, including performance tuning and troubleshooting.
• 8 Required Experience integrating Databricks with cloud storage services (e.g., S3,)
• 8 Required Experience implementing and enforcing cluster policies and workspace governance standards.
• 8 Required Familiarity with Databricks SQL, notebooks, and job orchestration.
• 8 Required Experience monitoring platform health, performance, and availability.
• 8 Required Understanding of data security, encryption, and compliance requirements.
• 8 Required Experience with DevOps or automation tools (Terraform, CI/CD pipelines, scripting).
• 4 Preferred Experience administering Databricks in an enterprise or government environment.
• 4 Preferred Experience with Databricks Unity Catalog for data governance and access control.
• 4 Preferred Knowledge of cost management and optimization for Databricks workloads.
• 4 Preferred Experience supporting AI/ML workloads using Databricks ML and MLflow.
• 4 Preferred Familiarity with data lake and lakehouse architectures.
• 4 Preferred Knowledge of Python, SQL, or Scala for administration and troubleshooting.

Level Description

8 or more years of experience, relies on experience and judgment to plan and accomplish goals, independently performs a variety of complicated tasks, a wide degree of creativity and latitude is expected.

Job Description

Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives. Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system: Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements, such as forms of data input, how data is to be; summarized, and formats for reports. Writes detailed description of user needs, program functions, and steps required to develop or modify computer program. Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.

Additional job details and special considerations

The Databricks Administrator is responsible for administering, configuring, and supporting the Databricks platform to enable scalable data engineering, analytics, and AI/ML workloads. This role ensures platform reliability, security, cost optimization, and compliance while supporting data engineers, analysts, and data scientists across the organization. The administrator will manage workspace configuration, cluster policies, user access, integrations with cloud services, and ongoing platform monitoring to support enterprise data and analytics initiatives.