Lakehouse Data Engineer - Real-time Pipelines & ML

Alphv Recruit; Selangor; Sur place; MYR 120 000 - 210 000; Plein temps

Résumé du poste

Alphv Recruit in Malaysia is seeking a mid to senior data engineer to design scalable lakehouse architectures and data pipelines for a healthcare project. Based in Petaling Jaya, you will build ETL/ELT workflows and optimize storage while supporting ML workflows.

Join a project focused on healthcare data, with an emphasis on data privacy and reliable, real-time processing. This onsite role offers opportunities to advance in cloud and big data technologies.

Qualifications

• Proficient in Python, Scala, Java and SQL for data engineering tasks.
• Experience with big data frameworks and lakehouse tech stacks.
• Strong scripting skills for automation and data ops.

Responsabilités

• Design scalable data lakehouse architectures for large datasets.
• Build and maintain ETL/ELT pipelines for batch and real-time processing.
• Develop data ingestion frameworks from APIs, databases, files and streams.
• Optimize storage, partitioning and query performance in lakehouse environments.
• Support ML workflows and model deployment pipelines.
• Design disaster recovery and data backup strategies for critical assets.

Connaissances

Python

Scala

Java

SQL

Shell scripting

Outils

Apache Spark

Hadoop

Delta Lake

Apache Iceberg

Databricks

Snowflake

Apache Airflow

dbt

Description du poste

Alphv Recruit in Malaysia is seeking a mid to senior data engineer to design scalable lakehouse architectures and data pipelines for a healthcare project. Based in Petaling Jaya, you will build ETL/ELT workflows and optimize storage while supporting ML workflows.

Join a project focused on healthcare data, with an emphasis on data privacy and reliable, real-time processing. This onsite role offers opportunities to advance in cloud and big data technologies.