Principal Agentic AI Architect | Racedog Technologies | Iselin, NJ

RaceDog Technologies; Woodbridge Township (NJ); On-site; USD 190,000 - 270,000; Full time

Job summary

RaceDog Technologies is seeking a Principal Agentic AI Architect to lead enterprise AI initiatives in Iselin, NJ. You will own design and deployment of autonomous multi-agent frameworks, scale LLM orchestration, and ensure data privacy and security across backend systems.

You will drive RAG pipelines, tool integrations, and governance while mentoring engineering teams and shaping AI strategy for client implementations. This onsite, long-term contract requires in-person interviews.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, AI, ML, or related field.
• 12+ years of professional software engineering, with 4+ years in AI/ML.
• Hands-on experience designing and deploying agentic AI systems, autonomous agents, and multi-agent orchestration frameworks.
• Expert proficiency in LLMs, RAG architectures, embeddings, and vector databases (Pinecone, Chroma, Milvus).
• Strong Python programming, asynchronous processing, and modern AI frameworks (LangChain, LlamaIndex, AutoGen).
• Enterprise security, API integration, data privacy, and cloud infrastructure (AWS/Azure/GCP).
• Eligible to work in the United States and willing to attend in-person interviews in Iselin, NJ.

Responsibilities

• Architect, design, and deploy advanced multi-agent autonomous AI systems and cognitive workflows.
• Implement complex LLM orchestration pipelines, RAG systems, and prompt engineering frameworks.
• Integrate autonomous agents with enterprise backend systems, microservices, and RESTful APIs.
• Establish security guardrails, evaluation benchmarks, and governance for hallucination mitigation.
• Lead evaluations of AI tooling and benchmarks; oversee secure API integrations.
• Collaborate with data science, engineering, and product teams to productionize proofs-of-concept.
• Optimize inference latency, token management, and compute cost in cloud deployments.
• Mentor teams and promote best practices in agentic AI and ethical AI.

Skills

Agentic AI design

LLM orchestration

Python programming

Async processing

AI development frameworks

LangChain

LlamaIndex

AutoGen

Education

Bachelor’s or Master’s in CS/AI

PhD in AI/ML (nice-to-have)

Tools

Pinecone

Chroma

Milvus

LangChain

LlamaIndex

AutoGen

Job description

Position Summary:

Racedog Technologies is actively seeking an elite, visionary Principal Agentic AI Architect with 12+ years of enterprise software and artificial intelligence experience to join our client implementation team in Iselin, NJ on an onsite contract basis. In this critical leadership and innovation role, you will be responsible for architecting autonomous multi-agent AI systems, designing advanced Large Language Model (LLM) orchestration pipelines, and embedding cognitive agentic workflows into enterprise software ecosystems. You will leverage your deep practical expertise in agentic frameworks, RAG architectures, prompt engineering, and production AI deployment to drive revolutionary business automation. This opportunity requires a master-level AI architect with exceptional technical depth and willingness to participate in mandatory in-person interviews in Iselin, NJ.

Detailed Job Description:

As a Principal Agentic AI Architect supporting client implementations in Iselin, NJ via Racedog Technologies, you will take full technical and architectural ownership of generative AI and autonomous agent initiatives from experimental design to production deployment. Your day-to-day responsibilities include designing scalable multi-agent frameworks, integrating vector databases, orchestrating LLM tool-use, and implementing rigorous guardrails for hallucination mitigation and data privacy. You will collaborate closely with executive leadership, data scientists, software engineers, and enterprise architects to align AI capabilities with strategic business goals. Furthermore, you will lead technical evaluations of emerging AI tooling, establish model evaluation benchmarks, and oversee secure API integrations across enterprise backend systems.

Key Responsibilities:

• Architect, design, and deploy advanced multi-agent autonomous AI systems and cognitive workflows for enterprise automation.
• Implement complex LLM orchestration pipelines, retrieval-augmented generation (RAG) systems, and prompt engineering frameworks.
• Integrate autonomous agents with enterprise backend systems, microservices, and RESTful APIs for automated tool execution.
• Establish rigorous security guardrails, evaluation benchmarks, and governance frameworks for hallucination mitigation and compliance.
• Lead technical R&D and evaluations of emerging generative AI models, agent frameworks (LangChain, AutoGen, CrewAI), and vector databases.
• Collaborate with cross-functional data science, engineering, and product teams to transition AI proofs-of-concept into production.
• Optimize inference latency, token management, and compute cost efficiency across cloud-native AI deployments.
• Mentor engineering teams and evangelize best practices in agentic AI design and ethical artificial intelligence.

Required Qualifications & Skills:

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical discipline.
• Minimum of 12+ years of professional software engineering experience, with 4+ years dedicated to artificial intelligence and machine learning.
• Proven hands-on experience designing and deploying agentic AI systems, autonomous agents, and multi-agent orchestration frameworks.
• Expert practical proficiency in Large Language Models (LLMs), RAG architectures, embeddings, and vector databases (Pinecone, Chroma, Milvus).
• Strong programming proficiency in Python, asynchronous processing, and modern AI development frameworks (LangChain, LlamaIndex, AutoGen).
• Comprehensive understanding of enterprise security, API integration, data privacy, and cloud infrastructure (AWS/Azure/GCP).
• Exceptional analytical, problem-solving, architectural design, and executive communication capabilities.
• Mandatory eligibility to work in the United States and availability for mandatory in-person interviews in Iselin, NJ.

Nice-to-Have Skills:

• Ph.D. or advanced postgraduate degree in Artificial Intelligence, Machine Learning, or Cognitive Computing.
• Prior professional experience leading AI transformation initiatives within Fortune 500 enterprises.
• Contributions to open-source AI projects or published research papers in generative AI and autonomous agents.
• Experience with reinforcement learning from human feedback (RLHF) and fine-tuning open-source LLMs (Llama 3, Mistral).
• Strong background in enterprise DevOps, MLOps pipelines, and model monitoring tools.

Application Information:

• Salary/Rate: Market Competitive / Executive Consulting Rate
• Deadline: Open until filled
• Notice Period: Immediate to 30 Days
• Contract Duration: Long-Term Contract / On-Site with Mandatory In-Person Interview (Iselin, NJ)