Senior Data Engineer - Databricks

Ultra Tendency; Kuala Lumpur; Hybrid; MYR 180,000 - 240,000; Full time

Benefits offered by this job

Hybrid work options

Udemy Business

Global collaboration

Team events

Job summary

Ultra Tendency in Kuala Lumpur is seeking a Senior Data Engineer – Databricks to design and build scalable data platforms for international clients. You will collaborate with data scientists, engineers, and architects to implement robust pipelines on cloud platforms, applying best practices for data quality, governance, and security.

Join a global engineering environment with hybrid work options, a strong emphasis on learning, certifications, and knowledge sharing to drive impactful data

Qualifications

• Strong experience with Databricks and Apache Spark (PySpark, SQL or Scala).
• Experience building data platforms on major cloud providers (AWS, Azure, or GCP).
• Solid understanding of distributed data processing, data modelling, and performance optimisation.
• Experience with CI/CD pipelines and version control tools such as Git.
• Familiarity with orchestration frameworks such as Airflow or Databricks Workflows.
• Strong communication skills in English for collaboration in an international environment.
• A collaborative mindset and interest in building reliable, scalable data systems.

Responsibilities

• Design, implement, and maintain scalable data pipelines using the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake.
• Develop and optimize batch and streaming data workflows supporting analytics, machine learning, and business intelligence applications.
• Collaborate with cross-functional teams to translate business and data requirements into reliable, production-ready data solutions.
• Improve performance and cost efficiency of data processing workloads within the Databricks environment.
• Support the implementation of best practices for data quality, governance, and security.
• Contribute to knowledge sharing within the team and support the development of junior engineers.

Skills

Databricks & Spark

PySpark/SQL/Scala

Cloud platforms AWS/Azure/GCP

CI/CD & Git

Airflow / Databricks Workflows

English communication

Collaborative mindset

Tools

Git

Airflow

Databricks Workflows

Delta Lake

Terraform

Apache Spark

Job description

Ultra Tendency is a global data and AI consultancy with teams across Europe, Asia, and the US. As we continue expanding our presence in Malaysia, we are looking for a Senior Data Engineer – Databricks to join our growing Kuala Lumpur team and contribute to the development of scalable data platforms for international clients.

In this role, you will work closely with data engineers, data scientists, and architects to design and implement robust data solutions using modern cloud and data technologies.

Competitive compensation will be provided in line with the Malaysian technology market, based on experience and qualifications.

Your Responsibilities

• Design, implement, and maintain scalable data pipelines using the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake.
• Develop and optimize batch and streaming data workflows supporting analytics, machine learning, and business intelligence applications.
• Collaborate with cross-functional teams to translate business and data requirements into reliable, production-ready data solutions.
• Improve performance and cost efficiency of data processing workloads within the Databricks environment.
• Support the implementation of best practices for data quality, governance, and security.
• Contribute to knowledge sharing within the team and support the development of junior engineers.

Your Experience

• Strong experience with Databricks and Apache Spark (PySpark, SQL or Scala).
• Experience building data platforms on major cloud providers (AWS, Azure, or GCP).
• Solid understanding of distributed data processing, data modelling, and performance optimisation.
• Experience with CI/CD pipelines and version control tools such as Git.
• Familiarity with orchestration frameworks such as Airflow or Databricks Workflows.
• Strong communication skills in English for collaboration in an international environment.
• A collaborative mindset and interest in building reliable, scalable data systems.

What We Offer

• Competitive salary aligned with Malaysian market standards.
• Hybrid work options, combining office and remote work (candidates must poses permanent residency in Malaysia).
• The opportunity to collaborate with experienced colleagues in an international engineering environment.
• Exposure to large-scale data and AI projects for global organisations.
• Professional development opportunities, including certifications and continuous learning resources such as Udemy Business.
• Regular feedback cycles and structured performance reviews to support your career development.
• A collaborative culture that values knowledge sharing and long-term professional growth.
• Team events and opportunities to connect with colleagues globally.

About Us

Ultra Tendency is an international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. Since 2010, we have helped leading organizations—including the European Central Bank, Deutsche Telekom, and Europe’s largest automotive manufacturer—build and operate large-scale, data-driven platforms.

With 8 offices across 10 countries and a growing global team, we combine deep technical expertise with a strong commitment to open source. Our consultants actively contribute to projects such as Apache Kafka, Apache NiFi, Terraform, and Ansible, and we are a trusted Databricks partner.

At Ultra Tendency, you'll work on challenging projects that push the boundaries of Data and AI while collaborating with talented colleagues in a culture built on learning, knowledge sharing, and mutual support.

We evaluate candidates based on skills, experience, and business fit, and welcome applicants from all backgrounds.

Data privacy statement: Data Protection for Applicants – Ultra Tendency