Junior Data Engineer: Python Pipelines for ML & Analytics

Crédit Agricole SA; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Crédit Agricole CIB in Singapore is seeking a Data Engineer to design and build scalable data pipelines that support ML and analytics. You will collaborate with data scientists, ML engineers, and analysts to deliver robust, production-ready pipelines and services.

The role involves developing ingestion and transformation pipelines in Python, building backend services, and ensuring real-time and batch processing performance. Familiarity with Docker, Kubernetes and cloud platforms is essential.

Qualifications

• Graduate or Master's degree in AI/ML/Data.
• 2+ years of software development, ML engineering, or data pipeline engineering.
• Strong programming skills in Python (pandas, scikit-learn, FastAPI or Flask).
• Familiarity with SQL and cloud data warehouses (BigQuery, Snowflake, Redshift).
• Knowledge of NoSQL databases; Graph DB desirable.
• Hands-on with data pipeline tools like Airflow/Luigi.
• Experience with Git, testing, and agile practices.
• Experience with CI/CD and containers (Docker, Kubernetes).
• Exposure to cloud environments (AWS, GCP, or Azure) and containerization.

Responsibilities

• Design and develop data ingestion, transformation, and delivery pipelines using Python and ETL tools.
• Build backend services, APIs or UIs to support ML applications.
• Maintain and optimize batch and real-time data pipelines for performance and scalability.
• Support packaging and deployment of ML models into production environments.
• Write clean, modular, testable code and participate in code reviews.
• Collaborate with data scientists, engineers and DevOps for scalable pipelines.
• Support data exploration, feature engineering, and model building where needed.
• Automate data validation, quality checks, and pipeline monitoring.
• Work with cloud platforms and container technologies (Docker, Kubernetes).
• Follow best practices for versioning, logging, and CI/CD.

Skills

Python programming

Data pipelines

ML workflow integration

Git version control

CI/CD practices

Problem solving

Education

Graduate/Master’s in AI/ML/Data

Tools

Apache Airflow

Luigi

Docker

Kubernetes

ReactJS

BigQuery

Snowflake

Redshift

Job description

Crédit Agricole CIB in Singapore is seeking a Data Engineer to design and build scalable data pipelines that support ML and analytics. You will collaborate with data scientists, ML engineers, and analysts to deliver robust, production-ready pipelines and services.

The role involves developing ingestion and transformation pipelines in Python, building backend services, and ensuring real-time and batch processing performance. Familiarity with Docker, Kubernetes and cloud platforms is essential.