Cloud Data Engineer

Ams Osram; Kulim; On-site; MYR 120,000 - 240,000; Full time

Job summary

Ams Osram is seeking a senior data engineer to support central functions and the business in achieving strategic objectives. You will work closely with data scientists, business analysts and stakeholders to understand data requirements and translate them into technical specifications and data models.

As part of the cloud data warehouse team, you will design and implement cloud-based data solutions (Snowflake/Databricks), develop scalable data pipelines, apply data governance, and document best

Qualifications

• Bachelor’s degree in CS or related field.
• 5+ years in cloud data warehouse environments (Snowflake/Databricks).
• Experience in data vault 2.0 or star schema data modelling.
• Strong communication and problem-solving skills.

Responsibilities

• Collaborate with data scientists and analysts to translate data needs into specs.
• Design and implement cloud data solutions aligned with business needs.
• Develop scalable data pipelines and document best practices.
• Monitor data quality, data integrity, and performance of pipelines.
• Communicate progress and technical concepts to stakeholders.

Skills

SQL

Python

Data modeling

Data governance

Agile SCRUM

Communication

Cloud data pipelines

Snowflake

Databricks

ETL

dbt

Apache Airflow

Azure Data Factory

Apache NiFi

PowerBI

Theobald Universal Xtract

Education

Bachelor’s degree in Computer Science or related field

Tools

Snowflake

Databricks

PowerBI

Azure Data Factory

Apache NiFi

Theobald Universal Xtract

dbt

Apache Airflow

Job description

Central Functions support the board as well as the business in achieving its strategic objectives. These are, for example, Information Technology, Human Resources, Logistics, Compliance, Finance and many more.

• Work closely with data scientists, business analysts and other stakeholders to understand their data requirements and translate them into technical specifications and data models.
• Collaborate with data architects to design and implement cloud-based data solutions that align with business needs.
• Facilitate internal knowledge sharing to ensure team members are informed about the latest best practices.
• Implement scalable and robust data pipelines from various source systems.
• Apply business rules and transformations using SQL or Python.
• Secure data models applying object and row level security.
• Develop and document best practices and ensure they are effectively implemented across the team.
• Analyze and address issues related to data integrity, data design and both functional and technical aspects of the Cloud Data Warehouse.
• Communicate effectively about issues, solutions, and best practices with relevant stakeholders.
• Perform cost and performance-based optimization of data transfer processes.
• Continuously monitor and improve the efficiency and performance of data pipelines.

• Bachelor’s degree and above in Computer Science, Software Engineering or similar.
• Minimum 5 years of related working experience with cloud data warehouse technologies, preferably Snowflake and/or Databricks.
• Experience working in international teams.
• Hands-on experience in data warehouse modelling preferably with data vault 2.0 and/or star schema.
• Good understanding of agile methodologies like SCRUM.
• Problem-solving attitude and excellent communication skills.
• In-depth understanding of relational databases (SQL) and ETL (Extract, transform, load) frameworks.
• Experienced in data staging with SQL and Python, data visualization with tools such as PowerBI, data integration using Apache NiFi, Theobald Universal Xtract, and Azure Data Factory, as well as orchestrating data pipelines with dbt and Apache Airflow.
• Excellent organizational skills with the ability to communicate project goals and objectives, project status and deliverables with senior executives.
• Participate with the management team in developing a vision and strategic plan to guide the organization.