AI/ML Engineer

Infinityy; New York (NY, CA); Hybrid; USD 120,000 - 210,000; Full time

Benefits offered by this job

Benefits details shared during the 인터뷰

Job summary

Infinityy is building Fin, the AI guide for real estate listings and buyer Q&A, grounding its agents in MLS data and partner sources. You will own prompts, measure quality, and improve agent behavior across narratives, captions, and lead summaries for a multilingual audience.

You will design retrieval pipelines, build evaluation datasets, and work with backend engineers on integration in a C#/.NET platform, ensuring guardrails and fair housing compliance.

Qualifications

• 3+ years in a technical role (AI/ML engineering, data, software engineering or similar), with hands-on LLM work in production.
• Strong experience with prompt engineering and agent configuration (OpenAI, Anthropic, LangChain, LlamaIndex, Semantic Kernel or similar).
• Python or TypeScript for scripting, data processing and experiment automation.
• Working knowledge of vector databases, embeddings and retrieval.
• Experience with LLMOps and eval tools (LangSmith, Weights & Biases, OpenAI Evals or similar).
• An analytical, experiment-driven approach; you can explain why a model behaves the way it does.
• Clear writing for documenting prompts, experiments and reproducible workflows.

Responsibilities

• Design, test and improve prompts and agent behavior for Fin across listing narratives, captions, neighborhood insights, buyer Q&A and lead summaries
• Build and maintain retrieval and context pipelines that ground Fin in MLS data, agent-uploaded files and partner data such as Local Logic
• Create evaluation datasets, scoring rubrics and automated evals, including fair housing compliance, accuracy and multilingual quality checks
• Run structured experiments and A/B tests; track model quality, latency and cost in dashboards the team can read
• Work with backend engineers on agent orchestration, tool calls and model integration in our C#/.NET platform
• Monitor production outputs for errors, bias and drift; set up guardrails and fixes
• Help shape new AI features with product and design, such as letting agents train Fin on extra context
• Document prompt patterns, eval methods and best practices so the whole team can build on them

Skills

prompt engineering

agent configuration

Python

TypeScript

vector databases

embeddings

retrieval

LLMOps

eval tools

analytical mindset

Tools

OpenAI

Anthropic

LangChain

LlamaIndex

Semantic Kernel

LangSmith

Weights & Biases

OpenAI Evals

Job description

Fin, our AI guide, is at the center of Infinityy. It writes listing narratives and photo captions from MLS data, answers buyer questions in 75 languages, follows fair housing rules and tells agents what each visitor cares about. You'll own how Fin thinks: its prompts, its grounding data, how we measure its quality and how it gets better with every release.

What you'll do

• Design, test and improve prompts and agent behavior for Fin across listing narratives, captions, neighborhood insights, buyer Q&A and lead summaries
• Build and maintain retrieval and context pipelines that ground Fin in MLS data, agent-uploaded files and partner data such as Local Logic
• Create evaluation datasets, scoring rubrics and automated evals, including fair housing compliance, accuracy and multilingual quality checks
• Run structured experiments and A/B tests; track model quality, latency and cost in dashboards the team can read
• Work with backend engineers on agent orchestration, tool calls and model integration in our C#/.NET platform
• Monitor production outputs for errors, bias and drift; set up guardrails and fixes
• Help shape new AI features with product and design, such as letting agents train Fin on extra context
• Document prompt patterns, eval methods and best practices so the whole team can build on them

What you'll bring

• 3+ years in a technical role (AI/ML engineering, data, software engineering or similar), with hands-on LLM work in production
• Strong experience with prompt engineering and agent configuration (OpenAI, Anthropic, LangChain, LlamaIndex, Semantic Kernel or similar)
• Python or TypeScript for scripting, data processing and experiment automation
• Working knowledge of vector databases, embeddings and retrieval (RAG)
• Experience with LLMOps and eval tools (LangSmith, Weights & Biases, OpenAI Evals or similar)
• An analytical, experiment-driven approach; you can explain why a model behaves the way it does
• Clear writing for documenting prompts, experiments and reproducible workflows

Nice to have

• Building eval frameworks or automated test suites for LLMs
• Multilingual NLP or content compliance work (fair housing, accessibility, regulated content)
• Data labeling, dataset curation or synthetic data generation

First 90 days

• 30: baseline evals running for listing narratives and buyer Q&A
• 60: Local Logic and agent-file grounding live with measured quality gains
• 90: every Fin change ships through an eval gate; quality and cost reported each release

About Infinityy

Infinityy is the decision-making layer for places and spaces, helping people move from initial interest to a confident decision with the information, context and human connection they need, when they need it. Its AI-powered platform brings collaborative property experiences, real-time answers, neighborhood intelligence and direct access to real estate professionals into one connected experience. The platform translates into 12 languages, while its AI assistant answers questions in more than 70.

An early-stage startup, Infinityy is backed by Second Century Ventures, the strategic investment arm of the National Association of REALTORS®, and was selected for its 2024 REACH Commercial and 2025 REACH Residential programs.

Equal Opportunity Employer

Infinityy is an equal opportunity employer. We welcome applicants of all backgrounds and do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, veteran status, or any other characteristic protected by law.

Infinityy offers a variety of benefits to its employees, with details shared during the interview process.