Data Engineer: Build Scalable Data Lakehouse & AI Pipelines

Mettler-Toledo International, Inc; Petaling Jaya; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Medical Coverage (Spouse and children)

Dental Coverage (Spouse and children)

Life Insurance Plan

Job summary

Mettler-Toledo International, Inc. is seeking a Data Engineer to design, build and maintain a central data platform that supports analytics, AI/ML initiatives and data distribution.

You will work with data scientists, analysts and business stakeholders to deliver trusted, well-structured data for operational and analytical use cases. You will contribute to building the enterprise data lake/lakehouse using Databricks and Snowflake, develop batch and streaming pipelines, and ensure data quality,

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent.
• 3+ years of hands-on data engineering experience.
• Proficiency with Spark, Snowflake, Databricks.
• Experience with Python and SQL.
• Experience with Airflow or Prefect.
• Familiarity with Azure cloud.
• Strong analytical and problem solving skills.
• Ability to work collaboratively in a cross-functional environment.

Responsibilities

• Design, build and maintain METTLER TOLEDO’s central data platform for analytics and AI/ML initiatives.
• Develop scalable data pipelines for batch and streaming data between systems and cloud services.
• Implement ETL/ELT and reverse ETL processes to support analytics and AI workloads.
• Create metadata catalogs, data lineage and feature stores.
• Ensure data quality, security and compliance across pipelines.
• Collaborate with data scientists, analysts and stakeholders to meet data needs.

Skills

Data engineering

Python

SQL

Spark/Databricks

Snowflake

ETL/ELT

Azure cloud

Education

Bachelor's degree in CS/Engineering/IS

Tools

Airflow

Databricks

Snowflake

Delta Lake

Azure

Job description

Mettler-Toledo International, Inc. is seeking a Data Engineer to design, build and maintain a central data platform that supports analytics, AI/ML initiatives and data distribution.

You will work with data scientists, analysts and business stakeholders to deliver trusted, well-structured data for operational and analytical use cases. You will contribute to building the enterprise data lake/lakehouse using Databricks and Snowflake, develop batch and streaming pipelines, and ensure data quality,