Senior AI Harness Architect - Data Platform

NCS Group; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NCS Group is seeking an autonomous AI Engineer in Singapore to design and build the AI Harness and agent framework for a modern data platform based on Apache Iceberg, Trino, and Parquet. You will enable collaboration across specialized agents to execute tasks, maintain state, and deliver end-to-end data engineering capabilities.

Depending on experience, you will focus on task execution, independent delivery, or technical leadership, working with Python, FastAPI, LangChain, LangGraph, and

Qualifications

• Experience with Generative AI, Agentic AI, or LLM-based solutions.
• Proficiency in Python, including FastAPI, Pydantic and Pandas.
• Experience designing and implementing AI Harness or multi-agent frameworks.
• Hands-on experience with LangChain & LangGraph.
• Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.
• Experience building data ingestion, transformation, and orchestration pipelines.
• Strong knowledge of metadata management, data lineage, and data governance practices.
• Experience developing REST APIs, SDKs, and reusable engineering frameworks.
• Experience with observability, monitoring, tracing, and operational support practices.
• Strong understanding of distributed systems, event-driven architectures, and microservices patterns.
• Proven ability to design, develop, and operationalize enterprise-grade AI agents for data discovery, ingestion, transformation, optimization, governance, and observability.
• Familiar with DuckDB, dbt and related engineering tools for data transformation, modelling, and pipeline development.
• Senior engineers should show leadership in technical design and mentorship and work independently with clients.

Responsibilities

• Develop the AI Harness and agent framework to enable multi-agent collaboration, state management, and orchestration.
• Create specialized agents to discover Iceberg catalogs, profile data, ingest datasets, and generate Trino SQL.
• Build data pipelines, transformations, and governance workflows; ensure data quality and lineage.
• Implement logging, security, observability, and error handling for reliable operations.
• Deliver Iceberg table definitions, Trino SQL scripts, Python pipelines, and CI/CD artifacts.

Skills

Generative AI

Agentic AI

Python

FastAPI

Pydantic

Pandas

LangChain

LangGraph

Apache Iceberg

Trino

Parquet

Data ingestion

Data transformation

Metadata management

Data governance

REST APIs

SDKs

Observability

Distributed systems

Microservices

DuckDB

dbt

Tools

LangChain

LangGraph

DuckDB

dbt

Job description

NCS Group is seeking an autonomous AI Engineer in Singapore to design and build the AI Harness and agent framework for a modern data platform based on Apache Iceberg, Trino, and Parquet. You will enable collaboration across specialized agents to execute tasks, maintain state, and deliver end-to-end data engineering capabilities.

Depending on experience, you will focus on task execution, independent delivery, or technical leadership, working with Python, FastAPI, LangChain, LangGraph, and