Cloud Data Engineer

Ams Osram; Kulim; On-site; MYR 150,000 - 200,000; Full time

Job description

• Work closely with data scientists, business analysts and other stakeholders to understand their data requirements and translate them into technical specifications and data models.
• Collaborate with data architects to design and implement cloud-based data solutions that align with business needs.
• Facilitate internal knowledge sharing to ensure team members are informed about the latest best practices.
• Implement scalable and robust data pipelines from various source systems.
• Apply business rules and transformations using SQL or Python.
• Secure data models applying object and row level security.
• Develop and document best practices and ensure they are effectively implemented across the team.
• Analyze and address issues related to data integrity, data design and both functional and technical aspects of the Cloud Data Warehouse.
• Communicate effectively about issues, solutions, and best practices with relevant stakeholders.
• Perform cost and performance-based optimization of data transfer processes.
• Continuously monitor and improve the efficiency and performance of data pipelines.