Junior Data Engineer: Python Pipelines & ML Ops

Crédit Agricole CIB; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

Crédit Agricole CIB is seeking a Data Engineer to join its Digital Excellence Centre in a challenging, multicultural environment. The role focuses on building scalable data pipelines, ML model deployment, and collaboration with data scientists and DevOps.

You will design, implement, and maintain ingestion, transformation, and delivery pipelines using Python and modern ETL tools, and work with cloud platforms and container technologies to ensure robust production systems.

Qualifications

• Graduate or Master’s degree in AI/ML/Data.
• 2+ years in software development, ML or data pipeline engineering.
• Strong Python (pandas, scikit-learn, FastAPI or Flask).
• SQL and cloud data warehouses (BigQuery, Snowflake, Redshift).
• NoSQL experience; Graph DB desirable.
• Hands-on with Airflow/Luigi for ETL pipelines.
• Git, testing and agile development practices.
• CI/CD and containerization (Docker, Kubernetes).
• Cloud exposure (AWS, GCP or Azure).

Responsibilities

• Design and develop data ingestion, transformation, and delivery pipelines using Python and modern ETL tools.
• Build backend services, APIs or UIs to support ML applications.
• Maintain and optimize batch and real‑time data pipelines for performance and scalability.
• Support packaging and deployment of machine learning models into production environments.
• Write clean, modular, testable code and participate in code reviews.
• Collaborate with data scientists, engineers and DevOps teams to scalable and reliable data pipeline.
• Support data exploration, feature engineering, and occasional model building where needed.
• Automate data validation, quality checks, and pipeline monitoring.
• Work with cloud platforms and container technologies (Docker, Kubernetes).
• Follow best practices for versioning, logging, and CI/CD.

Skills

Python

Pandas

Scikit-learn

FastAPI/Flask

SQL

BigQuery

Snowflake

Redshift

NoSQL

Airflow

Luigi

Git

CI/CD

Docker

Kubernetes

AWS

GCP

Azure

ReactJS

Education

Graduate or Master’s degree in AI/ML/Data

Tools

Airflow

Luigi

Docker

Kubernetes

Git

CI/CD tooling

Job description

Crédit Agricole CIB is seeking a Data Engineer to join its Digital Excellence Centre in a challenging, multicultural environment. The role focuses on building scalable data pipelines, ML model deployment, and collaboration with data scientists and DevOps.

You will design, implement, and maintain ingestion, transformation, and delivery pipelines using Python and modern ETL tools, and work with cloud platforms and container technologies to ensure robust production systems.