Senior Data Engineer - Databricks

Ultra Tendency; Kuala Lumpur; Hybrid; MYR 180,000 - 240,000; Full time

Benefits offered by this job

Hybrid work options

Professional development

Udemy Business access

Job summary

Ultra Tendency, a global data and AI consultancy, is expanding in Kuala Lumpur. We are seeking a Senior Data Engineer – Databricks to design and build scalable data platforms for international clients.

You will collaborate with data scientists, engineers, and architects to implement robust data solutions on cloud platforms, with emphasis on performance, governance, and security.

Qualifications

• Strong experience with Databricks and Apache Spark (PySpark, SQL or Scala).
• Experience building data platforms on major cloud providers (AWS, Azure, or GCP).
• Solid understanding of distributed data processing, data modelling, and performance optimisation.
• Experience with CI/CD pipelines and version control tools such as Git.
• Familiarity with orchestration frameworks such as Airflow or Databricks Workflows.
• Strong communication skills in English for collaboration in an international environment.

Responsibilities

• Design, implement, and maintain scalable data pipelines using the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake.
• Develop and optimize batch and streaming data workflows supporting analytics, machine learning, and business intelligence applications.
• Collaborate with cross-functional teams to translate business and data requirements into reliable, production-ready data solutions.
• Improve performance and cost efficiency of data processing workloads within the Databricks environment.
• Support the implementation of best practices for data quality, governance, and security.
• Contribute to knowledge sharing within the team and support the development of junior engineers.

Job description

Ultra Tendency is a global data and AI consultancy with teams across Europe, Asia, and the US. As we continue expanding our presence in Malaysia, we are looking for a Senior Data Engineer – Databricks to join our growing Kuala Lumpur team and contribute to the development of scalable data platforms for international clients.

In this role, you will work closely with data engineers, data scientists, and architects to design and implement robust data solutions using modern cloud and data technologies.

Competitive compensation will be provided in line with the Malaysian technology market, based on experience and qualifications.

YOUR RESPONSIBILITIES

• Design, implement, and maintain scalable data pipelines using the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake.
• Develop and optimize batch and streaming data workflows supporting analytics, machine learning, and business intelligence applications.
• Collaborate with cross-functional teams to translate business and data requirements into reliable, production-ready data solutions.
• Improve performance and cost efficiency of data processing workloads within the Databricks environment.
• Support the implementation of best practices for data quality, governance, and security.
• Contribute to knowledge sharing within the team and support the development of junior engineers.

YOUR EXPERIENCE

• Strong experience with Databricks and Apache Spark (PySpark, SQL or Scala).
• Experience building data platforms on major cloud providers (AWS, Azure, or GCP).
• Solid understanding of distributed data processing, data modelling, and performance optimisation.
• Experience with CI/CD pipelines and version control tools such as Git.
• Familiarity with orchestration frameworks such as Airflow or Databricks Workflows.
• Strong communication skills in English for collaboration in an international environment.
• A collaborative mindset and interest in building reliable, scalable data systems.

WHAT WE OFFER

• Competitive salary aligned with Malaysian market standards.
• Hybrid work options, combining office and remote work (candidates must poses permanent residency in Malaysia).
• The opportunity to collaborate with experienced colleagues in an international engineering environment.
• Exposure to large-scale data and AI projects for global organisations.
• Professional development opportunities, including certifications and continuous learning resources such as Udemy Business.
• Regular feedback cycles and structured performance reviews to support your career development.
• A collaborative culture that values knowledge sharing and long-term professional growth.
• Team events and opportunities to connect with colleagues globally.

About Us

Ultra Tendency is an international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. Since 2010, we have helped leading organizations—including the European Central Bank, Deutsche Telekom, and Europe’s largest automotive manufacturer—build and operate large-scale, data-driven platforms.

With 8 offices across 10 countries and a growing global team, we combine deep technical expertise with a strong commitment to open source. Our consultants actively contribute to projects such as Apache Kafka, Apache NiFi, Terraform, and Ansible, and we are a trusted Databricks partner.

At Ultra Tendency, you'll work on challenging projects that push the boundaries of Data and AI while collaborating with talented colleagues in a culture built on learning, knowledge sharing, and mutual support.

We evaluate candidates based on skills, experience, and business fit, and welcome applicants from all backgrounds.