Senior AI Engineer - FinTech LLM in Production

Group 107; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Group 107 is seeking a Senior AI Engineer to design, build, and operate AI capabilities within our fixed income portfolio management platform. You will own client-facing AI features end to end, from discovery with product and clients through production rollout, monitoring, and iteration.

You will collaborate with the CTO, product management, and financial engineers to ensure AI outputs are accurate, explainable, and compliant within a regulated environment serving sophisticated financial

Qualifications

• 6+ years of software engineering, incl. 2+ years producing ML features in production.
• Track record shipping customer-facing AI features in B2B SaaS.
• Strong Python engineering; ability to ramp in .NET codebase.
• Hands-on experience with LLM APIs (Azure OpenAI/OpenAI/Anthropic), RAG, tool calling, and agent orchestration.
• Proven practice building evaluations for LLM systems; automated graders and regression tracking.
• Experience deploying services on Azure with containers and Kubernetes.
• Git proficiency and CI/CD pipeline work (GitHub Actions or Azure DevOps YAML).
• Understanding of AI security, data protection, and access control.

Responsibilities

• Design, build, and ship production LLM-powered features in the IMTC platform.
• Partner with product and clients to identify AI improvements and roadmap features.
• Design AI UX with streaming responses, source citations, and human-in-the-loop reviews.
• Build agentic workflows and tool-calling integrations with .NET microservices and data stores.
• Instrument AI features to measure adoption, accuracy, and business value; iterate accordingly.
• Own the AI service layer on Azure (Azure OpenAI, AKS), manage prompts and costs.
• Create evaluation harnesses to measure quality, latency, and expense in production.
• Implement guardrails for data grounding, PII handling, and regulatory compliance.

Skills

Python

C#/.NET

LLM APIs

RAG design

Agent orchestration

Azure

Kubernetes

Git & CI/CD

AI security

Explainability

Financial services

Agent Frameworks

Tools

Cosmos DB

PostgreSQL

Elasticsearch

Microsoft Agent Framework

Semantic Kernel

LangGraph

Kafka

Angular

Azure OpenAI

Job description

Group 107 is seeking a Senior AI Engineer to design, build, and operate AI capabilities within our fixed income portfolio management platform. You will own client-facing AI features end to end, from discovery with product and clients through production rollout, monitoring, and iteration.

You will collaborate with the CTO, product management, and financial engineers to ensure AI outputs are accurate, explainable, and compliant within a regulated environment serving sophisticated financial