Senior Engineer - Data Engineering

techstreet; Kuala Lumpur; In loco; MYR 180.000 - 300.000; Tempo pieno

Descrizione del lavoro

techstreet in Kuala Lumpur is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines for ingestion, transformation, and integration. You will advance data infrastructure, warehouses, and processing platforms with a focus on data quality, security, and governance.

The role requires a Bachelor's degree in a related field and 4+ years in data engineering, with hands-on experience in pipelines, data platforms, APIs, streaming, and workflow automation.

Competenze

• Bachelor's degree in Computer Science, Data Engineering, Data Science, or a related field.
• 4+ years of experience in data engineering, data platform development, or related roles.
• Hands-on experience designing and maintaining scalable data pipelines and data platforms.
• Strong proficiency in SQL, Python, and modern data engineering tools and frameworks.
• Experience with data warehousing, ETL/ELT, APIs, streaming technologies, and workflow automation.
• Knowledge of data quality, monitoring, governance, and security best practices.

Mansioni

• Design, build, and maintain scalable data pipelines for ingestion, transformation, and integration.
• Develop and optimize data infrastructure, warehouses, and processing platforms.
• Integrate data from multiple sources using APIs, streaming, and automated workflows.
• Implement data validation, monitoring, and quality controls for accurate data.
• Optimize data processing, storage, and computing resources for performance and growth.
• Implement access controls, data protection, and governance requirements.
• Deliver trusted, analysis-ready datasets to support analytics, AI, and BI initiatives.

Conoscenze

Python

SQL/NoSQL databases

Formazione

Bachelor's degree

Descrizione del lavoro

Senior Data Engineer role focused on designing, building, and maintaining scalable data pipelines for data ingestion, transformation, and integration. You will develop and optimize data infrastructure, warehouses, and processing platforms while ensuring data quality, security, and governance across the organization.

Key responsibilities

Data Pipeline Development – Design, build, and maintain scalable data pipelines for data ingestion, transformation, and integration

Data Platform Management – Develop and optimize data infrastructure, warehouses, and processing platforms

Data Integration & Automation – Integrate data from multiple sources using APIs, streaming, and automated workflows

Data Quality & Reliability – Implement data validation, monitoring, and quality controls to ensure accurate and consistent data

Performance & Scalability – Optimize data processing, storage, and computing resources for efficiency and growth

Data Security & Governance – Implement of access controls, data protection, and governance requirements

Analytics & AI Enablement – Deliver trusted, analysis-ready datasets to support data science, AI, business intelligence, and data monetization

About you

Bachelor's degree in Computer Science, Data Engineering, Data Science, or a related field

4+ years of experience in data engineering, data platform development, or related data-focused roles

Hands-on experience in designing and maintaining scalable data pipelines, data platforms, and integration solutions

Strong proficiency in SQL, Python, and modern data engineering tools and frameworks

Experience with data warehousing, ETL/ELT processes, APIs, streaming technologies, and workflow automation

Knowledge of data quality management, monitoring, governance, and security best practices

Ability to optimize data performance and deliver trusted, analysis-ready datasets to support analytics, AI, and business intelligence initiatives

Required Skills

Python

Database (SQL / NoSQL)