Sr. Project Manager

Lavu Tech Solutions; Selangor; On-site; MYR 180,000 - 240,000; Full time

Job summary

Lavu Tech Solutions is seeking a highly skilled Data Engineer with a strong Python background and 10–15 years of experience. You will design, build, and maintain scalable data pipelines and architectures to transform raw data into actionable insights across the organization.

Key responsibilities include developing ETL processes, collaborating with data scientists and analysts, and implementing data models to support analytics and reporting.

Qualifications

• Strong proficiency in Python with data manipulation and analysis experience.
• Solid understanding of data warehousing concepts and data modeling techniques.
• Experience with ETL tools and frameworks (e.g., Apache Airflow, Talend, or similar).
• Proficient in SQL and experience with relational databases (PostgreSQL, MySQL, or similar).
• Familiarity with big data technologies (Hadoop, Spark, or similar) is a plus.
• Experience with cloud platforms (AWS, Azure, or Google Cloud) and their data services.
• Knowledge of data visualization tools (Tableau, Power BI, or similar).
• Experience with machine learning frameworks and libraries.
• Familiarity with containerization technologies (Docker, Kubernetes).
• Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field.

Responsibilities

• Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and architectures that support analytics and reporting needs.
• Optimize data storage and retrieval processes for efficient data access and performance.
• Monitor and troubleshoot data pipeline performance, ensuring data quality and reliability.
• Document data engineering processes, architectures, and best practices for future reference.
• Stay updated with the latest industry trends and technologies in data engineering and analytics.

Skills

Python

SQL

Data analysis

Education

Bachelor's or Master's degree in Computer Science / Information Technology / Data Science

Tools

Apache Airflow

Talend

PostgreSQL

MySQL

Hadoop

Spark

AWS

Azure

Google Cloud

Tableau

Power BI

Docker

Kubernetes

Job description

We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team. The ideal candidate will have 10-15 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Key responsibilities

• Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and architectures that support analytics and reporting needs.
• Optimize data storage and retrieval processes to ensure efficient data access and performance.
• Monitor and troubleshoot data pipeline performance, ensuring data quality and reliability.
• Document data engineering processes, architectures, and best practices for future reference.
• Stay updated with the latest industry trends and technologies in data engineering and analytics.

About you

• Strong proficiency in Python, with extensive experience in data manipulation and analysis.
• Solid understanding of data warehousing concepts and data modeling techniques.
• Experience with ETL tools and frameworks (e.g., Apache Airflow, Talend, or similar).
• Proficient in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, or similar).
• Familiarity with big data technologies (e.g., Hadoop, Spark, or similar) is a plus.
• Experience with cloud platforms (e.g., AWS, Azure, or Google Cloud) and their data services.
• Knowledge of data visualization tools (e.g., Tableau, Power BI, or similar).
• Experience with machine learning frameworks and libraries.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes).
• Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field.