Data Engineer

FPT ASIA PACIFIC PTE. LTD.; Singapore; On-site; SGD 80,000 - 110,000; Full time

Job summary

A data engineering company in Singapore is looking for a Data Engineer to build and maintain scalable data systems. In this hands-on role, you will collaborate with ML engineers and data scientists to ensure the reliability and efficiency of data processes. The ideal candidate has 3-5 years of experience in data engineering, strong skills in Python, SQL, and cloud platforms, along with expertise in modern data technologies such as Kafka and Kubernetes.

Qualifications

• 3 - 5 years of experience in data engineering roles.
• Proven ability to design and deliver scalable, production-grade data systems.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines.
• Build real-time and batch data processing systems.
• Implement data quality, validation, and transformation workflows.
• Develop and operate cloud-based data architectures on AWS.
• Build and manage data warehouses and data lakes.
• Use Infrastructure as Code tools to automate data environment provisioning.
• Containerize and orchestrate workloads using Docker and Kubernetes.
• Partner with ML engineers to streamline feature pipelines.
• Support retrieval-augmented generation and AI systems.
• Ensure seamless integration of data systems into CI/CD pipelines.
• Implement and uphold data access control and privacy compliance standards.
• Monitor and optimize pipelines for cost efficiency and reliability.
• Collaborate with DevOps and IT teams to troubleshoot data services.

Skills

Python

SQL

Shell scripting

Infrastructure as Code (Terraform, CloudFormation, CDK)

Cloud data platforms (AWS, GCP)

Big data ecosystems (e.g., Spark, Hadoop)

Streaming technologies (Kafka, Kinesis)

Containerization (Docker)

Orchestration (Kubernetes)

Education

Bachelors or Masters in Computer Science, Engineering, or related technical field

Job description

You will work closely with ML engineers, data scientists, and cloud architects to ensure that data is reliable, scalable, and production-ready enabling rapid experimentation and deployment of AI models across airport systems.

This is a hands-on, delivery-focused role suited for engineers who enjoy building robust data systems in a fast-moving environment.

Key Responsibilities

Data Architecture & Pipeline Development

• Design, develop, and maintain end-to-end data pipelines to support ML and AI workloads.
• Build real-time and batch data processing systems using Kafka, Kinesis, Spark, or similar technologies.
• Implement data quality, validation, and transformation workflows to ensure trustworthy and high-quality data for model training and analytics.

Infrastructure & Platform Engineering

• Develop and operate cloud-based data architectures on AWS and hybrid on-prem environments.
• Build and manage data warehouses and data lakes for efficient storage, retrieval, and sharing.
• Use Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, or CDK to automate data environment provisioning.
• Containerize and orchestrate workloads using Docker and Kubernetes.

MLOps & Integration

• Partner with ML engineers to streamline feature pipelines, model training, and inference data flows.
• Support retrieval-augmented generation (RAG) and GenAI agent systems through optimized data access and embeddings infrastructure.
• Ensure seamless integration of data systems into CI/CD pipelines for continuous delivery and monitoring.

Security & Operations

• Implement and uphold data, access control, and privacy compliance standards.
• Monitor and optimize pipelines for cost efficiency, latency, and reliability.
• Collaborate with DevOps and IT teams to troubleshoot, deploy, and scale data services in production environments.

Innovation & Collaboration

• Work closely with cross-functional teams to translate business and research data needs into scalable technical solutions.
• Evaluate emerging data engineering technologies and architectures relevant to AI workloads.
• Contribute to internal documentation and knowledge sharing to support continuous improvement.

Qualifications

• Bachelors or Masters in Computer Science, Engineering, or related technical field.
• 3 - 5 years of experience in data engineering roles.

Proficiency in:

• Python and SQL
• Shell scripting
• Infrastructure as Code (Terraform, CloudFormation, CDK)
• Strong experience with cloud data platforms (AWS, GCP) and hybrid/on-prem environments.
• Solid understanding of big data ecosystems (e.g., Spark, Hadoop) and streaming technologies (Kafka, Kinesis).
• Familiarity with containerization (Docker) and orchestration (Kubernetes).
• Proven ability to design and deliver scalable, production-grade data systems.

Bonus Skills

• Exposure to MLOps, feature stores, or vector databases (e.g., FAISS, Pinecone, Weaviate).
• Experience supporting AI/GenAI model pipelines.
• Interest in data observability, metadata management, and responsible data practices.