Senior Data Engineer - Databricks & Lakehouse Architect

Jbsfamily; Kuala Lumpur; Presencial; MYR 180.000 - 230.000; Jornada completa

Descripción de la vacante

Jbsfamily is expanding its Data Engineering team in Malaysia. We seek a Senior Data Engineer specializing in Databricks and Snowflake to build scalable lakehouse data platforms for global clients.

You will work with DevOps, Cloud Engineering and Data Scientists in Agile sprints to deliver data solutions across APAC. You will build pipelines with Azure Databricks and PySpark, design data ingestion workflows with Azure Data Factory, and define storage schemas to support AI analytics workloads.

Formación

• 6+ years hands-on experience with Databricks on Azure/AWS/GCP, including Spark/ PySpark
• Proficiency in Python/Scala with CI/CD pipelines
• Experience in ETL/ELT design and implementation
• Familiar with Hadoop and Kafka in big data environments
• Passion for building scalable and reliable data systems

Responsabilidades

• Build and maintain scalable data pipelines using Databricks and PySpark
• Design and manage data ingestion and orchestration workflows using Azure Data Factory
• Define how data is stored, organized, and accessed
• Design schemas to support AI analytics workloads
• Build real-time analytics platforms, ML-ready data environments, and large-scale reporting
• Establish best practices for data quality, governance and security within Databricks
• Mentor junior data engineers and evolve the team's Databricks expertise
• Drive data architecture and modeling strategy for AI projects
• Implement data anonymization, quality checks, lineage and controls
• Ensure timely delivery of data components aligned with milestones

Conocimientos

Databricks

PySpark

Python

Scala

CI/CD

ETL/ELT

Big data

Hadoop

Kafka

Cloud platforms

Herramientas

Azure Databricks

Azure Data Factory

Descripción del empleo

Jbsfamily is expanding its Data Engineering team in Malaysia. We seek a Senior Data Engineer specializing in Databricks and Snowflake to build scalable lakehouse data platforms for global clients.

You will work with DevOps, Cloud Engineering and Data Scientists in Agile sprints to deliver data solutions across APAC. You will build pipelines with Azure Databricks and PySpark, design data ingestion workflows with Azure Data Factory, and define storage schemas to support AI analytics workloads.