Lead AI Data Engineer - Autonomous Data Harness

NCS; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NCS seeks an autonomous AI Engineer to design and build the AI harness, agent framework, and reusable components for a modern data platform using Iceberg, Trino, and Parquet. You will enable multi-agent collaboration, state management, and end-to-end data engineering capabilities.

Depending on experience, focus spans from task execution to technical leadership, with responsibilities in ingestion, validation, and governance across a scalable data lakehouse.

Qualifications

• Experience with Generative AI, Agentic AI, or LLM-based solutions.
• Proficiency in Python ecosystems (FastAPI, Pydantic, Pandas).
• Experience designing AI Harness or multi-agent frameworks.

Responsibilities

• Design and implement the AI Harness and agent framework.
• Develop specialized agents for data discovery, ingestion, and transformation.
• Lead technical designs and mentor engineers.

Skills

Generative AI

Agentic AI

LangChain

LangGraph

Python

FastAPI

Pydantic

Pandas

Apache Iceberg

Trino

Parquet

Data ingestion

Workflow orchestration

Metadata & lineage

Data governance

REST APIs

SDKs

Observability

Distributed systems

Microservices

DuckDB

dbt

Tools

Python

FastAPI

Pydantic

Pandas

LangChain

LangGraph

DuckDB

dbt

Apache Iceberg

Trino

Parquet

Job description

NCS seeks an autonomous AI Engineer to design and build the AI harness, agent framework, and reusable components for a modern data platform using Iceberg, Trino, and Parquet. You will enable multi-agent collaboration, state management, and end-to-end data engineering capabilities.

Depending on experience, focus spans from task execution to technical leadership, with responsibilities in ingestion, validation, and governance across a scalable data lakehouse.