Machine Learning and Model Evaluation

Nuvnext; Región Centro; Hybrid; MXN 420,000 - 660,000; Full time

Job summary

Nuvnext in Guadalajara is seeking an in-person Full-time Engineer to design and run evaluation systems for agent-based products. You’ll collaborate with founders, build real-case evaluation sets, and measure hits, errors, cost, and time to improve models before deployment.

You’ll use Python for analysis, and you’ll explain results clearly to non-technical stakeholders while pushing for rigorous experimental methodology.

Qualifications

• Fluency in statistics and experimental method.
• Ability to explain results to non-technical audiences.
• Proficient in Python for analysis and automation.

Responsibilities

• Build evaluation sets from real operational cases.
• Measure hits, errors, cost and time for agents.
• Compare models and configurations with method, not impressions.
• Define thresholds that allow moving up a level of autonomy.

Skills

Statistics

Experimental method

Communication of results

Tools

Python

Job description

Engineering Guadalajara · in person Full time

An agent that operates has to prove it decides well. You design how that is measured: test cases, evaluation sets, metrics and the threshold at which an agent can move from proposing to acting.

The role

• Build evaluation sets from real operational cases.
• Measure each agent's hits, errors, cost and time.
• Compare models and configurations with method, not impressions.
• Define the thresholds that allow moving up a level of autonomy.

Your first 90 days

• Day 30

  You learn the agents and their logs; you measure one end to end.

• Day 60

  You build the evaluation that runs before every change to an agent.

• Day 90

  An autonomy decision gets made with your numbers.

Must have

• Fluency in statistics and experimental method.
• Python to analyze and automate evaluations.
• You distrust a number until you know where it comes from.
• You can explain a result to someone who isn't technical.

Nice to have

• Semantic search or retrieval.
• Experience with operational data.

What working here is like

What you build goes into products that operate real organizations. You work directly with the founders, with no layers between your code and production, under the same rule we give the intelligence: a person signs what is critical.