Senior Data Engineer

Great Eastern; Kuala Lumpur; On-site; MYR 60,000 - 80,000; Full time

Job summary

A leading insurance company in Kuala Lumpur seeks a professional to develop and implement data models. The role requires collaboration with data science and business units, ensuring high-quality data analytics solutions while complying with governance policies. Ideal candidates will have a Bachelor's or Master's degree in Computer Science/IT/IS, with at least 3 years of experience in relevant fields, proficiency in Python, SQL, and familiarity with big data tools.

Qualifications

• Minimum 3 years working experience, preferably in Insurance or FI domain.
• Experience with distributed computing and data warehousing concepts.
• Proficiency in writing Python, PySpark, SQL, and UNIX.

Responsibilities

• Work closely with Data Science and BU team to build data models.
• Perform thorough data testing and validation.
• Analyze and organize raw data from different source systems.

Skills

Data modelling

Problem solving

SQL

Python

Experience with big data tools

Education

Bachelor's or Master's degree in Computer Science/IT/IS

Tools

Hadoop

Spark

AWS

Job description

Responsibilities

• Work closely with Data Science and BU team to build simple to complex data model that provide deep insights into data analytics. Support the implementation of high-quality analytics solutions.
• Identify data source required for analytics
• Responsible to perform thorough data testing and validation in supporting data ingestions while ensuring data quality
• Analyse and organize raw data from different source systems to build dataset and data model adhering to the data architecture
• Assembling simple to large sets of data that meet all functional business requirements
• Work closely with the data science and business units to develop data models and pipelines for research, visual analytics and machine learning
• Work closely with IT team to automate manual process in handling data scripts
• Understand the data, maintain documentation and assist in data related queries
• Ensure compliance with data governance and company security policies
• Provide guidance and coaching to Data Engineer
• Takes accountability in considering business and regulatory compliance risks and takes appropriate steps to mitigate the risks
• Maintains awareness of industry trends on regulatory compliance, emerging threats and technologies in order to understand the risk and better safeguard the company
• Highlights any potential concerns /risks and proactively shares best risk management practices

Qualifications

• At least a bachelor’s or master’s degree in computer science / IT / IS or its equivalent
• Experience with distributed computing, data warehousing concepts, data modelling/architecture and building SQL scripts to support data transformation and data delivery
• Experience with big data tools such as Hadoop, Spark, etc
• Experience with cloud solutions preferably AWS
• Minimum 3 years working experience, preferably in Insurance or FI domain
• Proficiency in writing python, pyspark, SQL and UNIX
• Excellent problem solving and troubleshooting skill
• Results oriented. Able to identify the root issues, identify what need to be done and work as team to get the issues resolved
• Familiarity with data science technique is a plus
• High level of integrity, takes accountability of work and good attitude over teamwork
• Takes initiative to improve current state of things and adaptable to embrace new changes

Great Eastern does not accept unsolicited agency resumes. Please do not forward resumes to our email or our employees. We will not be responsible for any fees related to unsolicited resumes.