Vision Systems ML Engineer - Open-Weight Models & Tools

Visia; New York (NY); Ibrido; USD 170.000 - 250.000; Tempo pieno

Vantaggi offerti da questo lavoro

Employer premiums

401k match

Equity with 10-year window

Unlimited PTO

Descrizione del lavoro

Visia in New York City is seeking a senior ML engineer to own and enhance the vision system’s learning agent. You will post-train open-weight models (SFT, RL methods) and build tools and evals to improve answers across 50+ industrial sites.

Work in a hybrid setup, three days a week in the Union Square area. You’ll expand the tool catalog, manage long-context sessions, and push models beyond current weight limits with routing and planner systems.

Competenze

• Shipped a tool-calling LLM or VLM to real users and can explain evaluation outcomes.
• Post-trained open-weight LLMs or VLMs with SFT and RL methods, and can explain the impact on eval results.

Mansioni

• Post-train open-weight models on our tasks: SFT on curated traces, then RL with verifiable rewards, and build the reward functions, rollout environment, and eval gate.
• Own the agent harness: context management over long multi-turn sessions, tool-call budgets, background tools, failure recovery, and the policy deciding which tool calls need approval.
• Grow the tool catalog (SQL over Postgres and ClickHouse, frame retrieval, segmentation, depth, model training and evaluation), and give each tool a typed schema, clear errors, and a test.
• Run the evaluation loop: replay real questions against a candidate harness or model, grade the answers with calibrated judges, and report quality and dollars per correct answer before anything ships.
• Push open-source models beyond their weight class with routing, test-time selection, and advisor and planner/worker setups where a strong model plans and cheaper ones execute.

Conoscenze

Tool-calling LLM

Open-weight LLM

RL methods

Strumenti

PostgreSQL

ClickHouse

LLM tooling

Descrizione del lavoro

Visia in New York City is seeking a senior ML engineer to own and enhance the vision system’s learning agent. You will post-train open-weight models (SFT, RL methods) and build tools and evals to improve answers across 50+ industrial sites.

Work in a hybrid setup, three days a week in the Union Square area. You’ll expand the tool catalog, manage long-context sessions, and push models beyond current weight limits with routing and planner systems.