Senior AI/ML Engineer: LLMs in Production

Triunity Software, Inc.; New York (NY); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Bonus based on performance

Health insurance

Training & development

Job summary

Triunity Software, Inc. is seeking a talented AI/ML Engineer to join our New Jersey team. You will work on cutting‑edge AI/ML solutions that drive real-world impact, turning complex data into intelligent systems in a fast-paced environment.

The role emphasizes Python 3.11+, LLM/Generative AI, RAG, and production‑grade REST services. You will own live applications, participate in security and governance reviews, and contribute to observable, cost‑aware AI architectures.

Qualifications

• Minimum 5+ years of software engineering experience.
• Minimum 2+ years of hands‑on LLM/Generative AI development experience.
• Proven experience deploying at least one enterprise‑grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root‑cause analysis, regression management, and production enhancements.
• Exposure to enterprise security and compliance reviews.

Skills

Python 3.11+

LLM/Generative AI

RAG

LLM evaluation

REST APIs

AI observability

Security & governance

Incident management

Tools

FastAPI

Pydantic

PostgreSQL

Aurora PostgreSQL

Vector extensions

LangGraph

LangChain

LlamaIndex

Semantic Kernel

AutoGen

Amazon Bedrock Agents

Kubernetes

Helm

Terraform

CI/CD

Apache Kafka

Datadog

OpenTelemetry

OCR/Document AI

Job description

Triunity Software, Inc. is seeking a talented AI/ML Engineer to join our New Jersey team. You will work on cutting‑edge AI/ML solutions that drive real-world impact, turning complex data into intelligent systems in a fast-paced environment.

The role emphasizes Python 3.11+, LLM/Generative AI, RAG, and production‑grade REST services. You will own live applications, participate in security and governance reviews, and contribute to observable, cost‑aware AI architectures.