Junior Data Engineer

Crédit Agricole; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

Crédit Agricole CIB’s Digital Excellence Centre in Singapore is seeking a Data Engineer to design, build, and maintain data pipelines that power ML and analytics use cases. You’ll collaborate with data scientists, ML engineers, and analysts to deliver robust, scalable solutions in a multicultural environment.

The role emphasizes Python-based development, ETL tooling, and cloud-native deployment with Docker and Kubernetes, plus experience with data warehouses and modern streaming/batch processing.

Qualifications

• Graduate or Master’s degree in AI/ML/Data.
• 2+ years of software development, ML engineering, or data pipeline engineering.
• Strong Python programming skills (pandas, scikit-learn, FastAPI or Flask).
• Familiarity with SQL and cloud data warehouses (BigQuery, Snowflake, Redshift).
• Knowledge of NoSQL databases; Graph DB desirable.
• Hands-on with data pipeline tools like Apache Airflow, Luigi, or similar.
• Experience with Git, testing, and agile practices.
• Experience with CI/CD and containerization (Docker, Kubernetes).
• Experience with cloud environments (AWS, GCP, or Azure).
• Strong debugging and problem-solving skills.

Responsibilities

• Design and develop data ingestion, transformation, and delivery pipelines using Python and ETL tools.
• Build backend services, APIs or UIs to support ML applications.
• Maintain and optimize batch and real-time data pipelines for performance and scalability.
• Support packaging and deployment of ML models into production.
• Write clean, modular, testable code and participate in code reviews.
• Collaborate with data scientists, engineers and DevOps for scalable pipelines.
• Assist data exploration, feature engineering, and occasional model building.
• Automate data validation, quality checks, and pipeline monitoring.
• Work with cloud platforms and container technologies (Docker, Kubernetes).
• Follow best practices for versioning, logging, and CI/CD.

Skills

Python

SQL

NoSQL

Airflow

Docker

Kubernetes

Git

CI/CD

Testing

Agile

ReactJS

Education

Bachelor’s or Master’s degree in AI/ML/Data

Tools

BigQuery

Snowflake

Redshift

FastAPI/Flask

Job description

Position

In a challenging and multicultural environment, we are looking for a Data Engineer to join our Digital Excellence Centre (DEC) department of Crédit Agricole CIB. The department handles the development of transversal and international projects.

The ideal candidate is a Python programmer with hands‑on experience building data pipelines and integrating data workflows to support ML and analytics use cases. You'll work closely with data engineers, ML engineers, and analysts to design, build, and maintain scalable data pipelines that are robust and production ready.

Main responsibilities

• Design and develop data ingestion, transformation, and delivery pipelines using Python and modern ETL tools.
• Build backend services, APIs or UIs (if ReactJS experience is present) to support ML applications
• Maintain and optimize batch and real‑time data pipelines for performance and scalability
• Support the packaging and deployment of machine learning models into production environments.
• Write clean, modular, testable code and participate in code reviews.
• Collaborate with data scientists, engineers and DevOps teams to scalable and reliable data pipeline.
• Support data exploration, feature engineering, and occasional model building where needed.
• Automate data validation, quality checks, and pipeline monitoring.
• Work with cloud platforms and container technologies (Docker, Kubernetes)
• Follow best practices for versioning, logging, and CI/CD.

Qualifications and Profile

Mandatory:

• Have Graduate or Master’s degree in the relevant field of AI / ML / Data.
• 2+ years of experience in software development, ML engineering, or data pipeline engineering.
• Strong programming skills in Python (pandas, scikit-learn, FastAPI or Flask)
• Familiarity with SQL and working with relational databases or cloud data warehouses (e.g., BigQuery, Snowflake, Redshift).
• Knowledge on NoSQL databases (any experience in Graph database is desirable)
• Hands‑on with data pipeline tools like Apache Airflow, Luigi, or similar tools.
• Experience with version control (Git), testing, and agile development practices.
• Experience with CI/CD pipelines and containerization (Docker, Kubernetes).
• Exposure to cloud environments (AWS, GCP, or Azure) and containerization (Docker).
• Strong debugging and problem‑solving skills.

Preferred skills:

• Experience in ReactJS or building frontend components for ML dashboards or monitoring tools.
• Exposure to streaming data (e.g., Kafka, Spark Streaming).
• Familiarity with MLOps tools like MLflow, TFX, or Seldon.
• Basic understanding of machine learning concepts and model deployment lifecycle