Junior Data Engineer - Python ML Pipelines

Crédit Agricole; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

Crédit Agricole CIB’s Digital Excellence Centre in Singapore is seeking a Data Engineer to design, build, and maintain data pipelines that power ML and analytics use cases. You’ll collaborate with data scientists, ML engineers, and analysts to deliver robust, scalable solutions in a multicultural environment.

The role emphasizes Python-based development, ETL tooling, and cloud-native deployment with Docker and Kubernetes, plus experience with data warehouses and modern streaming/batch processing.

Qualifications

• Graduate or Master’s degree in AI/ML/Data.
• 2+ years of software development, ML engineering, or data pipeline engineering.
• Strong Python programming skills (pandas, scikit-learn, FastAPI or Flask).
• Familiarity with SQL and cloud data warehouses (BigQuery, Snowflake, Redshift).
• Knowledge of NoSQL databases; Graph DB desirable.
• Hands-on with data pipeline tools like Apache Airflow, Luigi, or similar.
• Experience with Git, testing, and agile practices.
• Experience with CI/CD and containerization (Docker, Kubernetes).
• Experience with cloud environments (AWS, GCP, or Azure).
• Strong debugging and problem-solving skills.

Responsibilities

• Design and develop data ingestion, transformation, and delivery pipelines using Python and ETL tools.
• Build backend services, APIs or UIs to support ML applications.
• Maintain and optimize batch and real-time data pipelines for performance and scalability.
• Support packaging and deployment of ML models into production.
• Write clean, modular, testable code and participate in code reviews.
• Collaborate with data scientists, engineers and DevOps for scalable pipelines.
• Assist data exploration, feature engineering, and occasional model building.
• Automate data validation, quality checks, and pipeline monitoring.
• Work with cloud platforms and container technologies (Docker, Kubernetes).
• Follow best practices for versioning, logging, and CI/CD.

Skills

Python

SQL

NoSQL

Airflow

Docker

Kubernetes

Git

CI/CD

Testing

Agile

ReactJS

Education

Bachelor’s or Master’s degree in AI/ML/Data

Tools

BigQuery

Snowflake

Redshift

FastAPI/Flask

Job description

Crédit Agricole CIB’s Digital Excellence Centre in Singapore is seeking a Data Engineer to design, build, and maintain data pipelines that power ML and analytics use cases. You’ll collaborate with data scientists, ML engineers, and analysts to deliver robust, scalable solutions in a multicultural environment.

The role emphasizes Python-based development, ETL tooling, and cloud-native deployment with Docker and Kubernetes, plus experience with data warehouses and modern streaming/batch processing.