Remote Junior LLM Systems Engineer (LATAM)

Encora Inc.; United States; Remote; MXN 448,000 - 783,000; Full time

Job summary

Coforge is seeking a Junior Applied AI Engineer (LLM Systems) to design evaluation frameworks, build guardrails, and optimize prompts for production AI agents. You will work with Python, FastAPI, and cloud services to implement MCP servers, integrate tools, and monitor systems using Langfuse.

The role requires 1-3 years in AI/ML, strong English, and hands-on experience with LLMs in a remote LATAM environment. This is a growth-focused, compliant, and collaborative position.

Qualifications

• 1-3+ years in AI/ML Engineering, Applied AI, Data Science, or related fields.
• Experience with Large Language Models (LLMs) and AI-powered applications.
• Knowledge of LLM evaluation techniques, including benchmark datasets and scoring frameworks.
• Understanding of AI agent behavior across multi-turn conversations and tool-calling workflows.
• Experience with prompt engineering, structured outputs, and prompt optimization.
• Familiarity with AI safety concepts including moderation and guardrails.
• Hands-on experience with AWS Bedrock.
• Experience with Langfuse or similar observability platforms for LLM applications.
• Strong programming skills in Python.
• Experience developing REST APIs using FastAPI or similar frameworks.
• Knowledge of software engineering practices (unit testing, code reviews, Git workflows).
• Advanced English communication skills.

Responsibilities

• Design and execute evaluation frameworks for AI agents, including test datasets, LLM-as-a-Judge methodologies, human reviews, and regression testing.
• Build, configure, and optimize AI guardrails and moderation systems for regulated domains such as financial services and credit products.
• Develop, test, and continuously improve prompts based on evaluation results and production trace analysis.
• Create and maintain MCP (Model Context Protocol) servers and tool integrations that enable AI agents to interact with internal data and services.
• Support fine-tuning and evaluation of language models using domain-specific datasets.
• Prototype and validate AI workflows using System One models such as Jev and Laya for classification, routing, and verification tasks.
• Monitor AI system quality, latency, performance, and costs through Langfuse and implement improvement initiatives.
• Collaborate with Engineering, Data Science, and Compliance teams to ensure AI solutions are reliable, secure, and compliant.

Skills

LLMs

Generative AI

AWS Bedrock

Prompt Engineering

AI Agent Evaluation

Langfuse

Python

FastAPI

MCP

Guardrails

REST APIs

Git

Job description

Coforge is seeking a Junior Applied AI Engineer (LLM Systems) to design evaluation frameworks, build guardrails, and optimize prompts for production AI agents. You will work with Python, FastAPI, and cloud services to implement MCP servers, integrate tools, and monitor systems using Langfuse.

The role requires 1-3 years in AI/ML, strong English, and hands-on experience with LLMs in a remote LATAM environment. This is a growth-focused, compliant, and collaborative position.