DBA (Databricks)

Nitka; Batu Pahat; Remote; MYR 367,000 - 612,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Paid vacation

USD compensation

Job summary

Nitka Technologies is seeking an experienced Databricks DBA for a long-term remote engagement. You will manage Databricks workspaces, configure governance, and maintain unity catalog objects while assisting users with cluster configurations.

The role requires strong SQL, Linux, Python, and AWS skills, plus experience with Delta Lake and Parquet. English proficiency and EST/Pacific-friendly hours are preferred.

Qualifications

• Experience with implementation, integration or technical support.
• Experience with Linux, Bash.
• Confident SQL skills.
• Strong experience with AWS infrastructure (EC2, S3, IAM, VPC, secret management, SQS).
• Experience with Python for small scripts or apps.
• Experience maintaining Databricks jobs & environments.
• Experience with REST API/SDK.
• Understanding of DeltaLake/Parquet/Hive files.
• Understanding of cluster types & node families.
• English at least Intermediate.

Responsibilities

• Manage multiple Databricks workspaces (dev/QA/prod).
• Configure cluster policies, governance & compliance.
• Create and maintain unity catalog objects and permissions.
• Monitor and debug jobs using system tables and logs.
• Troubleshoot cluster crashes, OOMs and memory leaks.
• Investigate Python/Spark errors and dependencies.
• Assist users with cluster configurations and notebook errors.
• Explain platform limitations and best practices to data engineers.
• Maintain Confluence pages with rules and guides.

Skills

SQL

Python

Linux

Bash

AWS

Databricks

REST API

Delta Lake

Parquet

Hive

English

Tools

Databricks REST API

Job description

Nitka Technologies develops software for customers in the US and Europe and brings together about 300 professionals from Eastern Europe, North and South America, Armenia, Georgia and Kazakhstan.

We are looking for an experienced DBA (Databricks) for a long-term project. The customer is a company in California, an industry leader in the sale of tickets to events in Europe and the USA.

We offer 100% remote, full-time work.

Main tasks:

• Manage multiple Databricks workspaces (dev/qa/prod);
• Configure cluster policies, governance & compliance;
• Create & maintain unity catalog objects: catalogs, schemas, grants, service principals, external storage etc;
• Monitor and debug failed / long-running jobs using system tables (job_run_timeline, node_timeline, workflow_run);
• Troubleshoot cluster crashes, driver OOM, executor failures, memory leaks;
• Investigate Python / Spark errors, dependency conflicts (PyPI, WHL, Maven)
• Assist users with cluster/job configuration, notebook errors, unity catalog permissions;
• Explain platform limitations and best practices to Data engineers;
• Maintain confluence pages with platform rules & troubleshooting guides;

Requirements:

• Experience in implementation, integration or technical support;
• Experience with Linux, Bash;
• Confident SQL skills;
• Strong experience of working with AWS Infrastructure (ec2, s3, iam, vpc, secret management, sqs);
• Experience with Python sufficient for writing small scripts or applications;
• Experience of maintaining Databricks jobs & environments;
• Experience with REST API/SDK;
• Understanding of file-based databases (DeltaLake, Parquet, Hive);
• Understanding of of cluster types & node families;
• Spoken English at Intermediate level or higher;

Would be a plus:

• DatabricksREST API/ DatabricksSDK;
• Working with schema evolution, time travel, vacuum, compaction, z-order;
• Debugging corrupted delta tables (conflicting commits, tombstones, missing checkpoints);
• Understanding of acidimplementationon top of object storage;
• Spark knowledge (jobs, partitions, queries), experience in Kafka or similar technology, familiarity with Terraform / Gitlab CI;
• Cost monitoring for platform services and objects;
• Experience in enterprise Data platforms;

Working conditions:

• Nearshore candidates preferred, with availability to work EST or Pacific Time hours
• Remote work with no time trackers, flexible working hours
• Full-time (8 hours/day)
• Attractive USD compensation
• Paid vacation, holidays, sick leaves