Senior Databricks Data Engineer - Spark & Pipelines

Ultra Tendency; Kuala Lumpur; Hybrid; MYR 180,000 - 240,000; Full time

Benefits offered by this job

Hybrid work options

Udemy Business

Global collaboration

Team events

Job summary

Ultra Tendency in Kuala Lumpur is seeking a Senior Data Engineer – Databricks to design and build scalable data platforms for international clients. You will collaborate with data scientists, engineers, and architects to implement robust pipelines on cloud platforms, applying best practices for data quality, governance, and security.

Join a global engineering environment with hybrid work options, a strong emphasis on learning, certifications, and knowledge sharing to drive impactful data

Qualifications

• Strong experience with Databricks and Apache Spark (PySpark, SQL or Scala).
• Experience building data platforms on major cloud providers (AWS, Azure, or GCP).
• Solid understanding of distributed data processing, data modelling, and performance optimisation.
• Experience with CI/CD pipelines and version control tools such as Git.
• Familiarity with orchestration frameworks such as Airflow or Databricks Workflows.
• Strong communication skills in English for collaboration in an international environment.
• A collaborative mindset and interest in building reliable, scalable data systems.

Responsibilities

• Design, implement, and maintain scalable data pipelines using the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake.
• Develop and optimize batch and streaming data workflows supporting analytics, machine learning, and business intelligence applications.
• Collaborate with cross-functional teams to translate business and data requirements into reliable, production-ready data solutions.
• Improve performance and cost efficiency of data processing workloads within the Databricks environment.
• Support the implementation of best practices for data quality, governance, and security.
• Contribute to knowledge sharing within the team and support the development of junior engineers.

Skills

Databricks & Spark

PySpark/SQL/Scala

Cloud platforms AWS/Azure/GCP

CI/CD & Git

Airflow / Databricks Workflows

English communication

Collaborative mindset

Tools

Git

Airflow

Databricks Workflows

Delta Lake

Terraform

Apache Spark

Job description

Ultra Tendency in Kuala Lumpur is seeking a Senior Data Engineer – Databricks to design and build scalable data platforms for international clients. You will collaborate with data scientists, engineers, and architects to implement robust pipelines on cloud platforms, applying best practices for data quality, governance, and security.

Join a global engineering environment with hybrid work options, a strong emphasis on learning, certifications, and knowledge sharing to drive impactful data