AI/ML Engineer

Triunity Software, Inc.; New York (NY); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Bonus based on performance

Health insurance

Training & development

Job summary

Triunity Software, Inc. is seeking a talented AI/ML Engineer to join our New Jersey team. You will work on cutting‑edge AI/ML solutions that drive real-world impact, turning complex data into intelligent systems in a fast-paced environment.

The role emphasizes Python 3.11+, LLM/Generative AI, RAG, and production‑grade REST services. You will own live applications, participate in security and governance reviews, and contribute to observable, cost‑aware AI architectures.

Qualifications

• Minimum 5+ years of software engineering experience.
• Minimum 2+ years of hands‑on LLM/Generative AI development experience.
• Proven experience deploying at least one enterprise‑grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root‑cause analysis, regression management, and production enhancements.
• Exposure to enterprise security and compliance reviews.

Skills

Python 3.11+

LLM/Generative AI

RAG

LLM evaluation

REST APIs

AI observability

Security & governance

Incident management

Tools

FastAPI

Pydantic

PostgreSQL

Aurora PostgreSQL

Vector extensions

LangGraph

LangChain

LlamaIndex

Semantic Kernel

AutoGen

Amazon Bedrock Agents

Kubernetes

Helm

Terraform

CI/CD

Apache Kafka

Datadog

OpenTelemetry

OCR/Document AI

Job description

Benefits:

• Bonus based on performance
• Health insurance
• Training & development

About the Role:

Triunity Software is looking for a talented and passionate AI/ML Engineer to join our growing team in New Jersey! This is an exciting opportunity to work on cutting‑edge artificial intelligence and machine learning solutions that drive real-world impact. If you thrive in a fast‑paced, innovative environment and love turning complex data into intelligent systems, we want to hear from you.

Key Technical Requirements

• Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
• Hands‑on experience with LLM/Generative AI application development.
• Strong experience in Retrieval-Augmented Generation (RAG), embedding models, indexing strategies, and retrieval optimization.
• Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
• Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM‑as‑a‑judge techniques.
• Experience developing cloud‑based services, REST APIs, data pipelines, and event‑driven workers.
• Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
• Exposure to enterprise security, compliance, and governance requirements.

Preferred Technical Skills

• FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
• AgentCore and Agentic AI.
• Kubernetes, Helm, Terraform, and CI/CD.
• Apache Kafka and event‑driven architecture.
• Datadog and OpenTelemetry.
• Document AI, OCR, intelligent document processing, and human‑in‑the‑loop workflows.
• Experience in financial services, insurance, healthcare, or other regulated industries.

Experience Requirements

• Minimum 5+ years of overall software engineering experience.
• Minimum 2+ years of hands‑on LLM/Generative AI development experience.
• Demonstrated experience deploying at least one enterprise‑grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root‑cause analysis, regression management, and production enhancements.
• Exposure to enterprise security and compliance reviews.