AI/ML Engineer

Triunity Software, Inc.; Ocala (FL); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Bonus based on performance

Health insurance

Training & development

Job summary

Triunity Software, Inc. is seeking a talented AI/ML Engineer to join our growing team in the United States. You will work on cutting-edge AI/ML solutions, including retrieval-augmented generation, embeddings, and LLM orchestration, to deliver scalable cloud-based services and REST APIs.

The role emphasizes performance, observability, and governance in regulated environments. Required are strong Python (3.11+), asynchronous programming, and testing skills, plus experience with LLM frameworks and

Qualifications

• 5+ years of overall software engineering experience.
• 2+ years of hands-on LLM/Generative AI development experience.
• Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management and root-cause analysis.
• Exposure to enterprise security and compliance reviews.

Skills

Python

Asynchronous programming

Type hints

Automated testing

LLM development

RAG

Embeddings

Indexing

Retrieval optimization

LLM orchestration

LLM evaluation

Golden datasets

Evaluation metrics

LLM-as-judge

REST APIs

Data pipelines

Event-driven architecture

Observability

Security/compliance

Tools

FastAPI

PostgreSQL

Aurora PostgreSQL

Vector extensions

AgentCore

Agentic AI

Kubernetes

Helm

Terraform

CI/CD

Apache Kafka

Datadog

OpenTelemetry

Document AI

OCR

Job description

Benefits:

• Bonus based on performance
• Health insurance
• Training & development

About the Role:

Triunity Software is looking for a talented and passionate AI/ML Engineer to join our growing team in New Jersey! This is an exciting opportunity to work on cutting‑edge artificial intelligence and machine learning solutions that drive real-world impact. If you thrive in a fast‑paced, innovative environment and love turning complex data into intelligent systems, we want to hear from you.

Key Technical Requirements

• Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
• Hands‑on experience with LLM/Generative AI application development.
• Strong experience in Retrieval-Augmented Generation (RAG), embedding models, indexing strategies, and retrieval optimization.
• Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
• Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM‑as‑a‑judge techniques.
• Experience developing cloud‑based services, REST APIs, data pipelines, and event‑driven workers.
• Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
• Exposure to enterprise security, compliance, and governance requirements.

Preferred Technical Skills

• FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
• AgentCore and Agentic AI.
• Kubernetes, Helm, Terraform, and CI/CD.
• Apache Kafka and event‑driven architecture.
• Datadog and OpenTelemetry.
• Document AI, OCR, intelligent document processing, and human‑in‑the‑loop workflows.
• Experience in financial services, insurance, healthcare, or other regulated industries.

Experience Requirements

• Minimum 5+ years of overall software engineering experience.
• Minimum 2+ years of hands‑on LLM/Generative AI development experience.
• Demonstrated experience deploying at least one enterprise‑grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root‑cause analysis, regression management, and production enhancements.
• Exposure to enterprise security and compliance reviews.