AI Engineer

Mediacorp Pte Ltd; Singapore; On-site; SGD 100,000 - 180,000; Full time

Job summary

Mediacorp Pte Ltd in Singapore is seeking an AI Data Engineer to design, build, and maintain scalable data pipelines for AI applications and BI initiatives.

You will collaborate with AI scientists, analysts, and product managers to understand data requirements, implement ETL, and develop data models that support AI and business intelligence needs. You will drive data governance and stay current with Spark, Hadoop, cloud platforms, Docker, and Kubernetes to ensure high-quality data delivery.

Qualifications

• Bachelor’s degree or equivalent in CS/IT or related field.
• 3+ years in end-to-end AI/ML data engineering tasks.
• Proven experience designing and building scalable data pipelines.
• Strong understanding of ETL, data warehousing, and data modeling.

Responsibilities

• Collaborate with AI Scientists, Analysts, and PMs to understand data requirements.
• Design and implement scalable ETL pipelines from multiple sources.
• Develop data models for AI and BI needs.
• Create continuous data processing jobs for analytics.
• Implement data quality checks and cleansing processes.
• Automate workflows to improve efficiency.
• Monitor data pipelines and system performance; address issues proactively.
• Stay up-to-date with data engineering tech and best practices.
• Contribute to data governance strategies.
• Work with stakeholders to ensure data governance standards.

Skills

Data pipelines

ETL

Python/Java

Cloud (AWS/Azure)

Kubernetes

Docker

Spark/Hadoop

SQL/NoSQL databases

TensorFlow/PyTorch

Graph DB

Communication

Independent / team

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

Spark/Hadoop

Job description

Job Description

We are searching for a talented AI Data Engineer to join our growing team. In this role, you will play a pivotal role in designing, building, and maintaining scalable data pipelines that fuel our AI applications and business intelligence initiatives. You will be responsible for the entire data lifecycle, from data acquisition to transformation and delivery, ensuring high-quality data is readily available for various stakeholders.

Responsibilities

• Collaborate with AI Scientists, Business Analysts, and Product Managers to understand data requirements for AI applications and business use cases.
• Design and implement scalable data pipelines for efficient data extraction, transformation and loading extract, transform, and load (ETL) from various sources.
• Develop and maintain data models that optimize data storage, retrieval, and utilization for AI and BI needs.
• Develop continuous data processing jobs and pipelines to provide scalable input for analytics and modelling needs.
• Implement data quality checks and cleansing processes to ensure data accuracy and consistency.
• Automate workflows to improve efficiency and reduce manual intervention.
• Monitor and troubleshoot data pipelines and system performance, including model performance to identify and resolve issues proactively.
• Stay up-to-date with the latest data engineering technologies and best practices.
• Contribute to the development and implementation of data governance strategies.
• Work closely with stakeholders to ensure high standards of data governance during implementation.

Job Requirements

• Bachelor’s degree in Computer Science, Information Technology, or related fields.
• 3+ years of experience in developing end-to-end AI/ML applications with a focus on Data Engineering tasks.
• Proven experience in designing and building scalable data pipelines.
• Strong understanding of algorithms, data structures, discrete math, ETL processes, and data warehousing concepts.
• Proficiency in programming languages such as Python or Java
• Experience with cloud infrastructure (AWS, Azure), Kubernetes and Docker preferred.
• Familiarity with TensorFlow, PyTorch, and other open-source AI/ML frameworks; SQL/NoSQL databases; big data technologies like Spark/Hadoop is advantageous.
• Experience with Graph DB and building Graph-based applications.
• Experience working in the Media & Entertainment industry is a strong plus.
• Self-directed with excellent communication and collaboration skills; ability to work independently or as part of a cross-functional team.