Databricks Administrator

Transcend Softech LLC; Plano (TX); On-site; USD 130,000 - 180,000; Full time

Job summary

Transcend Softech LLC is seeking a highly experienced Databricks Administrator with 15+ years of IT experience, including data platforms and cloud environments. You will manage and optimize our Databricks environment across development, test, and production, administering workspace configurations, policies, and security controls.

Responsibilities include cost optimization, notebook and job deployment, and collaboration with data engineers, analysts, and stakeholders.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or related field.
• 15+ years of overall IT experience, with significant experience in data platforms and cloud environments.
• Strong knowledge of Apache Spark, cluster management, and distributed systems.
• Experience with cloud platforms (Azure, AWS, or GCP).
• Strong understanding of IAM, networking, and security best practices.
• Experience with monitoring, troubleshooting, and performance tuning.
• Proficiency in SQL, Python, and scripting for automation.

Responsibilities

• Administer and support the Databricks platform across development, test, and production environments.
• Manage workspace configuration, cluster policies, job scheduling, and platform settings.
• Monitor system performance, usage, and cost optimization.
• Implement and manage user access, roles, permissions, and security controls.
• Integrate Databricks with cloud platforms such as Azure, AWS, or GCP.
• Support deployment of notebooks, jobs, and workflows.
• Troubleshoot platform, connectivity, and performance issues.
• Ensure platform reliability with backup, recovery, and high availability practices.
• Collaborate with data engineers, architects, analysts, and business stakeholders.
• Implement governance, compliance, and security best practices.
• Maintain technical documentation and operational procedures.
• Support upgrades, patches, and new feature implementations.

Skills

Databricks

Apache Spark

Cluster management

Security best practices

IAM

Networking

Python scripting

SQL

Cost optimization

Cloud platforms

Education

Bachelor’s degree in Computer Science, Information Technology, or related field

Job description

We are seeking a highly experienced Databricks Administrator with 10+ years of overall IT experience to manage, support, and optimize our Databricks environment. The ideal candidate will have strong expertise in data platforms, cloud infrastructure, and enterprise-level system administration, ensuring a secure, scalable, and high-performing analytics ecosystem.

Roles and Responsibilities:

• Administer and support the Databricks platform across development, test, and production environments
• Manage workspace configuration, cluster policies, job scheduling, and platform settings
• Monitor system performance, usage, and cost optimization
• Implement and manage user access, roles, permissions, and security controls
• Integrate Databricks with cloud platforms such as Azure, AWS, or GCP
• Support deployment of notebooks, jobs, and workflows
• Troubleshoot platform, connectivity, and performance issues
• Ensure platform reliability with backup, recovery, and high availability practices
• Collaborate with data engineers, architects, analysts, and business stakeholders
• Implement governance, compliance, and security best practices
• Maintain technical documentation and operational procedures
• Support upgrades, patches, and new feature implementations

Required Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or related field
• 15+ years of overall IT experience, with significant experience in data platforms and cloud environments
• Strong knowledge of Apache Spark, cluster management, and distributed systems
• Experience with cloud platforms (Azure, AWS, or GCP)
• Strong understanding of IAM, networking, and security best practices
• Experience with monitoring, troubleshooting, and performance tuning
• Proficiency in SQL, Python, and scripting for automation