Secure AI/ML Engineer - LLMs, RAG & GovCloud

Pro Integrate LLC; New York (NY); On-site; USD 120,000 - 190,000; Full time

Job summary

Pro Integrate LLC in New York, NY is seeking an AI/ML Engineer to join our team building secure, scalable AI systems for government initiatives. You will work with LLMs, RAG, and multi-agent orchestration, deploying on GovCloud platforms, and building data pipelines and APIs.

You’ll collaborate with product and security teams following CI/CD practices and document complex decisions for technical and non-technical stakeholders.

Qualifications

• Proficiency in Python for AI/ML development, including experience with REST APIs and SDK integration.
• Hands-on experience with LLMs, RAG systems, and prompt engineering in production environments.
• Familiarity with multi-agent orchestration, tool use, and frameworks like LangGraph and LangChain.
• Deep understanding of cloud AI services (AWS GovCloud, Google GovCloud, Azure IL5+, Vertex AI, AWS Bedrock).
• Background in building and maintaining data pipelines, ontologies, metadata catalogs, and ETL processes.
• Strong grasp of secure coding and modern DevOps practices (CI/CD pipelines).
• Exceptional written and verbal communication skills for effective collaboration and documentation.

Responsibilities

• Design, implement, and optimize AI/ML models leveraging LLMs, RAG, and prompt engineering.
• Develop and orchestrate multi-agent systems using LangGraph and LangChain.
• Deploy solutions on secure cloud environments including GovCloud and Vertex AI.
• Build data pipelines, manage ETL processes, and maintain metadata catalogs.
• Create and maintain REST APIs and SDK integrations for data/model interaction.
• Collaborate with product, security, and engineering teams ensuring secure coding and CI/CD.
• Document technical decisions and communicate complex concepts clearly.

Skills

Python for AI/ML

REST APIs

LLMs & RAG

LangGraph

LangChain

AWS GovCloud

Google GovCloud

Azure IL5+

Vertex AI

AWS Bedrock

SDK integration

Data pipelines

ETL processes

Metadata catalogs

Ontologies

CI/CD pipelines

Secure coding

DevOps practices

Documentation

Communication skills

Job description

Pro Integrate LLC in New York, NY is seeking an AI/ML Engineer to join our team building secure, scalable AI systems for government initiatives. You will work with LLMs, RAG, and multi-agent orchestration, deploying on GovCloud platforms, and building data pipelines and APIs.

You’ll collaborate with product and security teams following CI/CD practices and document complex decisions for technical and non-technical stakeholders.