AI Engineer

NCS Pte Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NCS Pte Ltd in Singapore is seeking an autonomous AI Consultant to design and build the AI harness, agent framework, and reusable components for a modern data platform based on Apache Iceberg, Trino and Parquet.

Your work will establish the agentic execution framework that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.

Qualifications

• Experience with Generative AI, Agentic AI or LLM-based solutions.
• Proficiency in Python, including FastAPI, Pydantic and Pandas.
• Experience designing and implementing AI Harness or multi-agent frameworks.
• Hands-on experience with LangChain & LangGraph.
• Experience with Iceberg, Trino and Parquet-based lakehouse architectures.
• Experience building data ingestion, transformation and orchestration pipelines.
• Strong knowledge of metadata management, data lineage, and governance.
• Experience developing REST APIs, SDKs and reusable engineering frameworks.
• Observability, monitoring, tracing and operational support practices.
• Understanding of distributed systems, event-driven architectures and microservices.
• Proven ability to design, develop and operate enterprise-grade AI agents for data discovery and governance.
• Familiar with DuckDB, dbt and related data engineering tools.

Responsibilities

• Design and implement the AI Harness (agent framework) and orchestration components.
• Develop agent orchestration, workflow execution and state management.
• Handle memory, context, tool calls and agent-to-agent communication.
• Implement logging, audit trails, error handling and security controls.
• Ensure observability, monitoring and operational support for pipelines.
• Create specialized agents for data discovery, ingestion, transformation and governance.
• Generate Iceberg metadata, schemas and lineage; optimize Iceberg and Parquet.
• Produce Trino SQL scripts and views; document metadata and runbooks.

Skills

Generative AI

Agentic AI

LLM-based solutions

Python

FastAPI

Pydantic

Pandas

AI Harness

Multi-agent frameworks

LangChain

LangGraph

Apache Iceberg

Trino

Parquet

Data ingestion

Data transformation

Orchestration

Metadata management

Data lineage

Data governance

REST APIs

SDKs

Observability

Monitoring

Tracing

Distributed systems

Event-driven

Microservices

AI agents

DuckDB

dbt

Tools

LangChain

LangGraph

Apache Iceberg

Trino

Parquet

DuckDB

dbt

Job description

NCS is a leading AI Tech Services company. With a 15,000-strong team across the Asia Pacific, NCS scales its platforms and capabilities to provide clients with greater agility and AI expertise across a range of Industries. Embracing a strong ecosystem of global partners, NCS transforms technology services delivery combining AI with digital resilience to drive real business impact. NCS is a subsidiary of the Singtel Group.

Job Description

Role Summary

You are an autonomous AI Consultant, responsible for creating the harness for designing and building the AI harness, agent framework, and reusable engineering components required to operate a modern data platform based on Apache Iceberg, Trino, and Parquet.

Your primary responsibility is not only to build data pipelines, but also to establish the agentic execution framework (AI Harness) that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.

Key Responsibilities

AI Harness Development

Design and implement the foundational agent framework that provides:

• Agent orchestration and coordination
• Workflow execution and state management
• Memory and context handling
• Tool and function calling
• Agent-to-agent communication
• Logging and audit trails
• Error handling and recovery
• Security and access controls
• Observability and monitoring

The harness must support autonomous and multi-agent execution patterns.

Specialized Agents Creation

The agents will need to perform the following:

• Discover Iceberg catalogs and schemas
• Generate metadata and lineage
• Ingest data from databases, APIs, files, and streams
• Register and maintain Iceberg tables
• Generate Trino SQL
• Build transformation workflows
• Create curated and business-ready datasets
• Validate schemas and data integrity
• Detect anomalies
• Analyze Trino workloads
• Recommend partitioning strategies
• Optimize Iceberg tables and Parquet files
• Classify sensitive information
• Manage metadata and lineage
• Apply retention and compliance policies
• Monitor pipelines and agent activities
• Detect failures and bottlenecks
• Generate alerts and operational insights
• Iceberg table definitions and schemas
• Trino SQL scripts and views
• Metadata and lineage documentation
• Monitoring and observability configurations
• Technical documentation and runbooks

Qualifications

Skills and Experience

The candidate should demonstrate expertise in:

• Experience with Generative AI, Agentic AI, or LLM-based solutions.
• Proficiency in Python, including FastAPI, Pydantic and Pandas.
• Experience designing and implementing AI Harness or multi-agent frameworks.
• Hands-on experience with LangChain & LangGraph.
• Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.
• Experience building data ingestion, transformation, and orchestration pipelines.
• Strong knowledge of metadata management, data lineage, and data governance practices.
• Experience developing REST APIs, SDKs, and reusable engineering frameworks.
• Experience with observability, monitoring, tracing, and operational support practices.
• Strong understanding of distributed systems, event-driven architectures, and microservices patterns.
• Proven ability to design, develop, and operationalize enterprise-grade AI agents for data discovery, ingestion, transformation, optimization, governance, and observability.
• Familiar with modern data engineering technologies, including DuckDB, dbt, and related engineering tools for data transformation, modelling, and pipeline development.

Additional Information

We are driven by our AEIOU beliefs—Adventure, Excellence, Integrity, Ownership, and Unity—and we seek individuals who embody these values in both their professional and personal lives. We are committed to our Impact: Valuing our clients, Growing our people, and Creating our future.

Together, we make the extraordinary happen.

Learn more about us at ncs.co and visit our LinkedIn career site.