Senior Data Engineer

CLOUD MILE SDN. BHD.; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Benefits offered by this job

Competitive salary & benefits

Cloud project variety

Collaborative environment

Job summary

CLOUD MILE SDN. BHD. is seeking a Senior Data Engineer who will also serve as Delivery Lead in data engineering projects, guiding a small team to deliver scalable data pipelines, models, and dashboards across cloud platforms.

The role emphasizes hands-on data engineering, cloud technology, stakeholder management, and project delivery. Strong programming with Python/SQL, experience with BigQuery, Snowflake, Airflow, and dbt is highly valued, as is a track record of reliable project execution.

Qualifications

• 5+ years of experience working on data and AI projects.
• Minimum 3 years leading cloud-based data projects.
• Strong programming skills in Python and SQL; experience with NoSQL databases.
• Proficiency with cloud data platforms (GCP/AWS/Azure) and data tooling.
• Excellent communication and stakeholder management abilities.

Responsibilities

• Data Pipeline Development: design and implement scalable data integration pipelines.
• Data Modeling & Transformation: build robust models and transformation logic.
• Data Warehouse & Governance: set up data warehouses and governance controls.
• Dashboard Development: create dashboards for actionable insights.
• API Development: build scalable data APIs for cross-system access.
• Technical Leadership: lead a team of data engineers and enforce best practices.
• Stakeholder Management: gather requirements and ensure alignment with goals.

Skills

Team leadership

Data modeling

Cloud platforms

Python

SQL

Data governance

Stakeholder management

Education

Bachelor's or Master's in Computer Science or Engineering

Tools

GCP BigQuery

Snowflake

Azure Synapse

AWS Redshift

Databricks

Fivetran

Confluent

MongoDB Atlas

dbt

Airflow

Kafka

Job description

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. This individual will also take on the role as a Delivery Lead in data engineering projects, leading a small team of engineers, and ensuring seamless project execution. The ideal candidate will have a strong background in data engineering, cloud technologies, project delivery, and stakeholder management.

Key Responsibilities:

Data Pipeline Development: Design and implement scalable data integration pipelines, ensuring high performance and reliability.

Data Modeling & Transformation: Develop robust data models and transformation logic to support data analysis and business needs.

Data Warehouse & Governance: Set up and manage data warehouses, implement data governance controls, and ensure compliance with organisational standards.

Dashboard Development: Create dashboards that provide actionable insights, helping stakeholders make informed decisions.

API Development: Build scalable data APIs to facilitate data access and integration across systems.

Technical Leadership: Lead a team of data engineers, providing technical guidance and ensuring best practices in data engineering and project execution.

Stakeholder Management: Collaborate and communicate effectively with internal and external stakeholders to gather requirements, manage expectations, and ensure alignment with project goals.

Requirements:

Experience:

At least 5 years of relevant experience in data and AI projects.

Minimum 3 years of experience working with cloud platforms (preferably GCP; AWS or Azure is acceptable).

Technical Skills:

Cloud Data Platforms: Proficient in working with cloud-based data tools and platforms, including GCP BigQuery, Snowflake, Azure Synapse, AWS Redshift, Databricks, Fivetran, Confluent, and MongoDB Atlas.

Big Data & Open Source Expertise: Leverage open-source big data technologies such as Spark, Hadoop, Apache Beam, Kafka, dbt, and Airflow to orchestrate, process, and analyse large datasets efficiently.

Programming Skills: Strong programming abilities in Python, SQL, and NoSQL databases, with a focus on data transformation, processing, and querying.

API & Microservices Development: Experience in designing and building scalable microservices and data APIs (considered a bonus).

Generative AI Technologies: Familiarity with Generative AI tools and frameworks, with the ability to integrate them into data solutions (considered a bonus).

Data Management & Governance: Good knowledge of data management practices and data governance frameworks, including implementing policies, ensuring data quality, and maintaining compliance (considered a bonus).

Communication & Management Skills:

Proven experience leading a team of data engineers and demonstrated ability to manage projects and ensure successful delivery.

Excellent verbal and written communication skills, with the ability to convey complex technical concepts to both technical and non-technical audiences.

Strong stakeholder management skills to navigate expectations and drive alignment across teams.

Preferred Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Certification in cloud platforms such as Google Cloud Professional Data Engineer, AWS Certified Big Data, or Azure Data Engineer Associate.

What We Offer:

Competitive salary and benefits package.

Opportunities to work on cutting-edge data and AI projects on various cloud platforms.

A collaborative and innovative work environment.

Career growth and learning opportunities.