Data Engineer

BASF; Kuala Lumpur; On-site; EUR 40,000 - 80,000; Full time

Job summary

Join a forward-thinking company on a mission to create chemistry for a sustainable future. As a Data Engineer in the Agricultural Solutions department, you will play a key role in building and maintaining robust data infrastructures that drive analytics and decision-making. This position offers an exciting opportunity to leverage your technical expertise and leadership skills while collaborating with cross-functional teams. You will be instrumental in ensuring high data quality and compliance with industry standards, all within an inclusive environment that values diverse perspectives. Embrace the chance to innovate and contribute to meaningful projects that make a real impact.

Qualifications

• 3-5 years of professional experience in IT or IT Consulting.
• Expertise in designing and maintaining data models and ETL processes.

Responsibilities

• Design and maintain efficient data models and structures for data storage.
• Build and maintain ETL pipelines for data extraction and loading.

Skills

Java

Scala

Python

SQL

Data Modeling

ETL Processes

Data Normalization

Performance Tuning

Education

Bachelor Degree in Computer Science

Bachelor Degree in Information Technology

Tools

Databricks

Azure Data Factory

SQL Server

Synapse

Job description

Digital Hub Kuala Lumpur attracts, inspire and develop diverse talents who will elevate BASF’s digital journey.

As one of the world’s largest chemical companies, BASF is on a mission to create chemistry with a sustainable future. The Digital Hub Kuala Lumpur, alongside four other Digital Hubs across the globe are part of the technology powerhouse driving our vision. Join our organization and make an impact in an inclusive and diverse work environment. We value individual differences and provide opportunities for you to contribute your unique perspective towards our collective goals.

We are currently seeking a talented Data Engineer to join our team at BASF's Agricultural Solutions department Digital Factory.

In this role, you will be responsible for ensuring we can leverage data effectively for analytics, reporting, and decision-making. Your main objective will be to build and maintain a robust data infrastructure for enterprise-grade IT solutions of BASF Agricultural. This role requires both technical expertise and strong leadership skills to drive efficient product delivery.

Responsibilities

• You will leverage your expertise to design and maintain efficient data models, schemas, and structures that facilitate data storage and retrieval. Working closely with cross-functional teams, you will ensure that objectives are met and collaborate on data-related initiatives.
• Your responsibilities will include designing, building, and maintaining infrastructure and pipelines for extracting, transforming, and loading (ETL) data from various sources into data storage systems such as data warehouses or data lakes. You will implement quality checks, validation processes, and error handling to maintain high data quality standards.
• You will continuously monitor the pipelines and infrastructure, promptly troubleshooting and resolving any performance issues, errors, or anomalies to ensure seamless operations.
• Throughout the product lifecycle, you will provide technical support and expertise to the product team and stakeholders. This will involve performing rigorous testing and evaluation to ensure that the final product meets design specifications and quality standards.
• You will also play a crucial role in transforming and cleaning raw data, including handling missing values, data normalization, and aggregation. Administering and optimizing databases, such as performance tuning, indexing, and ensuring data security, may be required as well.
• You will have the opportunity to prepare, present, and maintain technical reports, documentation, and presentations. This may include creating and updating schematics, blueprints, and manuals to facilitate effective communication and knowledge sharing.
• To excel in this position, it is important to stay updated with new technologies, industry advancements, and best practices. This will enable you to bring innovative solutions and ideas to the table.
• You will be instrumental in improving efficiency and reducing manual intervention by automating processes and routine tasks. Ensuring compliance with regulatory standards and requirements is also crucial to meet industry guidelines.

Qualifications

• Bachelor Degree in Computer Science / Computer Engineering / Information Technology or business-technology related discipline
• Min. 3-5 years of professional experience in IT and / or IT Consulting
• Experienced in Java, Scala, Python, SQL
• Experience in Tools like Databricks, Azure Data Factory, Synapse, SQL Server
• Design & Implementation of ETL / ELT data pipelines
• Familiar with Data Warehouse and Data Lake architecture concept

At BASF, we create chemistry for a sustainable future. We combine economic success with environmental protection and social responsibility. Around 112,000 employees in the BASF Group contribute to the success of our customers in nearly all sectors and almost every country in the world. Our portfolio comprises six segments: Chemicals, Materials, Industrial Solutions, Surface Technologies, Nutrition & Care and Agricultural Solutions. BASF generated sales of €68.9 billion in 2023.

BASF is committed to empowering its employees to pursue their interests and explore emerging technologies. By investing in top-quality tools and promoting cross-functional collaboration, we encourage our team members to drive positive change within our organization. Come join us and be a part of our digitalization journey .

Further Information at https://go.basf.net/careers_digitalhubkl