AI/ML Engineer

Triunity Software, Inc.; Oakland (CA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Bonus based on performance

Health insurance

Training & development

Job summary

Triunity Software, Inc. is seeking a talented AI/ML Engineer to join our growing team in New Jersey. You will work on cutting‑edge AI/ML solutions that drive real‑world impact, turning complex data into intelligent systems.

The role requires deep expertise in Python, LLM development, and RAG-based pipelines. You will contribute to cloud services, REST APIs, and data workflows while focusing on observability, security, and compliance in regulated environments.

Qualifications

• Minimum 5+ years of overall software engineering experience.
• Minimum 2+ years of hands-on LLM/Generative AI development experience.
• Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root‑cause analysis, regression management, and production enhancements.
• Exposure to enterprise security and compliance reviews.

Skills

Python 3.11+

LLM development

RAG & embeddings

LLM orchestration frameworks

LLM evaluation

Data pipelines & REST APIs

AI observability & cost

Security & compliance

Tools

Kubernetes

Terraform

CI/CD

Apache Kafka

Datadog

OpenTelemetry

AgentCore/Agentic AI

Job description

Benefits:

• Bonus based on performance
• Health insurance
• Training & development

About the Role:

Triunity Software is looking for a talented and passionate AI/ML Engineer to join our growing team in New Jersey! This is an exciting opportunity to work on cutting‑edge artificial intelligence and machine learning solutions that drive real-world impact. If you thrive in a fast‑paced, innovative environment and love turning complex data into intelligent systems, we want to hear from you.

Key Technical Requirements

• Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
• Hands‑on experience with LLM/Generative AI application development.
• Strong experience in Retrieval-Augmented Generation (RAG), embedding models, indexing strategies, and retrieval optimization.
• Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
• Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM‑as‑a‑judge techniques.
• Experience developing cloud‑based services, REST APIs, data pipelines, and event‑driven workers.
• Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
• Exposure to enterprise security, compliance, and governance requirements.

Preferred Technical Skills

• FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
• AgentCore and Agentic AI.
• Kubernetes, Helm, Terraform, and CI/CD.
• Apache Kafka and event‑driven architecture.
• Datadog and OpenTelemetry.
• Document AI, OCR, intelligent document processing, and human‑in‑the‑loop workflows.
• Experience in financial services, insurance, healthcare, or other regulated industries.

Experience Requirements

• Minimum 5+ years of overall software engineering experience.
• Minimum 2+ years of hands‑on LLM/Generative AI development experience.
• Demonstrated experience deploying at least one enterprise‑grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root‑cause analysis, regression management, and production enhancements.
• Exposure to enterprise security and compliance reviews.