AI/ML Engineer

Machine Learning Technologies, LLC; Annapolis (MD); On-site; USD 120,000 - 190,000; Full time

Job summary

Machine Learning Technologies, LLC in Annapolis, MD is seeking an experienced AI/ML Engineer to design and build scalable enterprise AI/ML and Generative AI solutions, including production-grade LLM apps, RAG pipelines, AI agents, and grounding techniques.

You will architect prompt orchestration, tool integration, evaluation frameworks, and governance, collaborating with data engineering, security, and business stakeholders. A CS/engineering degree or equivalent experience is required.

Qualifications

• Bachelor's degree or equivalent experience in CS/Engineering/Data Science.
• Hands-on production experience with Generative AI and LLM-based applications.
• Experience with prompt engineering, orchestration, and grounding.

Responsibilities

• Design and develop scalable enterprise AI/ML and Generative AI solutions.
• Build production-grade LLM applications, RAG pipelines, AI agents, classification models, and summarization workflows.
• Design prompt engineering, orchestration, grounding, tool-calling, guardrails, and fallback mechanisms.
• Develop agentic AI workflows with multi-step reasoning and tool/API integrations.
• Establish AI evaluation frameworks, datasets, scoring methodologies, and performance benchmarks.
• Evaluate AI systems for accuracy, relevance, latency, and cost; optimize accordingly.
• Integrate AI apps with enterprise APIs, data platforms, and vector databases.
• Perform failure-mode analysis and continuous production AI improvements.
• Implement AI observability, monitoring, and drift evaluation practices.
• Ensure Responsible AI, security, privacy, compliance and governance.

Skills

AI/ML Engineering

Generative AI

LLM-based applications

RAG architectures

AI agents

Prompt engineering

LLM orchestration

APIs integration

Evaluation frameworks

cloud-native architectures

Education

Bachelor's degree in CS/Engineering/Data Science or related

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Key Responsibilities

• Design and develop scalable enterprise AI/ML and Generative AI solutions.
• Build production-grade LLM applications, RAG pipelines, AI agents, classification models, summarization workflows, and decision-support systems.
• Design prompt engineering, prompt orchestration, grounding, tool-calling, guardrails, and fallback mechanisms.
• Develop and optimize agentic AI workflows, including multi-step reasoning and tool/API integrations.
• Establish AI evaluation frameworks, test datasets, scoring methodologies, and performance benchmarks.
• Evaluate and optimize AI systems for accuracy, relevance, hallucination risk, latency, reliability, and cost.
• Integrate AI applications with enterprise APIs, data platforms, vector databases, and governed data sources.
• Perform failure-mode analysis and continuously improve production AI systems.
• Implement AI observability, monitoring, evaluation, and model/drift monitoring practices.
• Ensure solutions meet enterprise requirements around Responsible AI, security, privacy, compliance, and governance.
• Collaborate with Data Engineering, Architecture, Security, Quality Engineering, and business stakeholders.

Required Skills

• Strong experience in AI/ML Engineering or Software Engineering.
• Hands-on production experience with Generative AI and LLM-based applications.
• Strong experience with RAG architectures and retrieval/grounding techniques.
• Hands-on experience building AI agents / Agentic AI solutions.
• Strong knowledge of prompt engineering and LLM orchestration.
• Experience integrating LLMs with APIs, enterprise applications, and data sources.
• Experience with model/LLM evaluation frameworks, guardrails, and hallucination mitigation.
• Strong understanding of cloud-native architectures, APIs, data platforms, and scalable distributed applications.
• Knowledge of Responsible AI, security, privacy, compliance, and AI governance.
• Strong communication skills and ability to work with both technical and business stakeholders.
• Bachelor's degree in Computer Science, Engineering, Data Science, or a related discipline, or equivalent relevant experience.

Preferred Skills

• 1-2+ years of hands-on Agentic AI development/deployment experience.
• Experience with vector databases, semantic search, embeddings, knowledge retrieval, and AI observability.
• Experience taking enterprise AI products from architecture/design through production deployment and support.
• Experience working with Finance, FP&A, Accounting, Treasury, Tax, or related enterprise finance functions.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.