Remote LLM Systems Engineer - Junior

Encora; United States; Remote; USD 60,000 - 90,000; Full time

Job summary

Coforge is hiring a Junior Applied AI Engineer (LLM Systems) for remote work in LATAM. You will design evaluation frameworks for AI agents, build guardrails, and develop prompts while collaborating with Engineering, Data Science, and Compliance teams to ensure reliable, compliant AI solutions.

The role emphasizes hands-on work with LLMs, AWS Bedrock, Langfuse, and MCP integrations, with a strong focus on safety and production readiness.

Qualifications

• 1-3+ years in AI/ML, Applied AI, Data Science.
• Experience with LLMs and AI-powered apps.
• Knowledge of LLM evaluation techniques, benchmarks, scoring.
• Understanding multi-turn AI agent behavior & tool-calling.
• Prompt engineering, structured outputs, and prompt optimization.
• AI safety concepts including moderation, prompt injection prevention, jailbreak mitigation, and guardrails.
• Hands-on experience with AWS cloud services, preferably Bedrock.
• Experience with Langfuse or similar observability platforms for LLM apps.
• Strong programming skills in Python.
• Knowledge of software engineering best practices including unit testing, code reviews, and Git workflows.
• Advanced English communication skills.

Responsibilities

• Design and execute evaluation frameworks for AI agents, including test datasets and regression testing.
• Build, configure, and optimize AI guardrails and moderation systems for regulated domains.
• Develop, test, and improve prompts based on evaluation results and production trace analysis.
• Create MCP servers and tool integrations enabling AI agents to access internal data and services.
• Support fine-tuning and evaluation of language models using domain-specific data.
• Prototype and validate AI workflows using System One models Jev and Laya for classification, routing, and verification.
• Monitor AI system quality, latency, performance, and costs via Langfuse and improve where needed.
• Collaborate with Engineering, Data Science, and Compliance to ensure reliable and compliant AI solutions.

Skills

LLMs

Generative AI

Prompt Engineering

AI Agent Evaluation

Python

FastAPI

Guardrails & Moderation

REST APIs

Git

MCP

Langfuse

AWS Bedrock

Tools

AWS Bedrock

Langfuse

MCP

Jev

Laya

Job description

Coforge is hiring a Junior Applied AI Engineer (LLM Systems) for remote work in LATAM. You will design evaluation frameworks for AI agents, build guardrails, and develop prompts while collaborating with Engineering, Data Science, and Compliance teams to ensure reliable, compliant AI solutions.

The role emphasizes hands-on work with LLMs, AWS Bedrock, Langfuse, and MCP integrations, with a strong focus on safety and production readiness.