Generative AI & LLM Engineer: Agents, RAG & Automation

Machine Learning Technologies, LLC; Annapolis (MD); On-site; USD 120,000 - 190,000; Full time

Job summary

Machine Learning Technologies, LLC in Annapolis, MD is seeking an experienced AI/ML Engineer to design and build scalable enterprise AI/ML and Generative AI solutions, including production-grade LLM apps, RAG pipelines, AI agents, and grounding techniques.

You will architect prompt orchestration, tool integration, evaluation frameworks, and governance, collaborating with data engineering, security, and business stakeholders. A CS/engineering degree or equivalent experience is required.

Qualifications

• Bachelor's degree or equivalent experience in CS/Engineering/Data Science.
• Hands-on production experience with Generative AI and LLM-based applications.
• Experience with prompt engineering, orchestration, and grounding.

Responsibilities

• Design and develop scalable enterprise AI/ML and Generative AI solutions.
• Build production-grade LLM applications, RAG pipelines, AI agents, classification models, and summarization workflows.
• Design prompt engineering, orchestration, grounding, tool-calling, guardrails, and fallback mechanisms.
• Develop agentic AI workflows with multi-step reasoning and tool/API integrations.
• Establish AI evaluation frameworks, datasets, scoring methodologies, and performance benchmarks.
• Evaluate AI systems for accuracy, relevance, latency, and cost; optimize accordingly.
• Integrate AI apps with enterprise APIs, data platforms, and vector databases.
• Perform failure-mode analysis and continuous production AI improvements.
• Implement AI observability, monitoring, and drift evaluation practices.
• Ensure Responsible AI, security, privacy, compliance and governance.

Skills

AI/ML Engineering

Generative AI

LLM-based applications

RAG architectures

AI agents

Prompt engineering

LLM orchestration

APIs integration

Evaluation frameworks

cloud-native architectures

Education

Bachelor's degree in CS/Engineering/Data Science or related

Job description

Machine Learning Technologies, LLC in Annapolis, MD is seeking an experienced AI/ML Engineer to design and build scalable enterprise AI/ML and Generative AI solutions, including production-grade LLM apps, RAG pipelines, AI agents, and grounding techniques.

You will architect prompt orchestration, tool integration, evaluation frameworks, and governance, collaborating with data engineering, security, and business stakeholders. A CS/engineering degree or equivalent experience is required.