Predictive & Agentic AI Engineer

Bright MLS, Inc.; North Bethesda, Northern (MD, KY); On-site; USD 155,000 - 175,000; Full time

Benefits offered by this job

Health insurance

401(k) plan with employer matching

Paid time off (PTO)

Performance-based bonuses

Job summary

Bright MLS, Inc. seeks an experienced Predictive & Agentic AI Engineer to bridge traditional predictive modeling with generative AI. Lead development of data-driven models and autonomous multi-agent workflows for MLS subscribers.

Responsibilities include building AI agentic architectures, MLOps pipelines, and evaluating model performance while collaborating with product, engineering, and research teams. Requires 5+ years in data science and strong AWS expertise.

Qualifications

• 5+ years hands-on data science, analytics, ML, and AI engineering.
• Strong SQL skills and production-grade Python expertise.
• Experience with ML frameworks: TensorFlow, PyTorch, scikit-learn.
• Proven work building multi-agent, stateful AI workflows.
• Experience with AWS SageMaker/Bedrock and enterprise agent platforms.

Responsibilities

• Work with large real estate data to extract insights using ML/LLM approaches.
• Develop predictive analyses to guide product, reporting, and research teams.
• Prototype autonomous multi-agent AI systems aligned to roadmap.
• Design and deploy AI agentic workflows for real estate processes.
• Develop end-to-end MLOps/LLMOps including data curation, training, prompts, evaluation, deployment.
• Refine ML models and agent architectures to improve accuracy and reduce hallucinations.
• Evaluate model performance and agent compliance with A/B testing and validation.
• Collaborate with Product, Engineering, Research to translate needs into scalable AI solutions.
• Stay current with MLOps, LLMOps, and agentic AI tech.

Skills

SQL

Python

TensorFlow

PyTorch

scikit-learn

Pandas

Jupyter Notebook

Education

Bachelor's degree in Computer Science, Data Science, Mathematics, Statistics, or related field

Master's degree (plus)

Ph.D. (plus)

Tools

LangChain

LangGraph

CrewAI

LlamaIndex Workflows

Microsoft Agent Framework

Dataiku

Gemini Enterprise Agent Platform

AWS SageMaker

AWS Bedrock

Redshift

Job description

Are you an accomplished AI practitioner with a passion for developing cutting-edge analytics, predictive machine learning, and multi-agent generative AI solutions? If you have at least five years of hands-on experience in data science, combined with proven capabilities in building autonomous agentic workflows within the AWS ecosystem and Enterprise Agent Platforms, we have an exciting opportunity for you!

As a Predictive & Agentic AI Engineer , you will bridge the gap between traditional predictive modeling and state-of-the-art generative AI architecture. You will lead the development of advanced data-driven models and design autonomous, multi-agent workflows that solve complex business challenges, automate intricate workflows, and drive deep insights for our MLS subscribers.

Key Responsibilities:

• Work with large and complex real estate data sets to extract meaningful insights and solve a wide array of challenging problems using advanced statistical, machine learning, and large language model (LLM) approaches.
• Apply predictive and quantitative analysis, data mining, and experimentation to develop strategies for our product, reporting, and research teams.
• Innovate, define, understand, design, and build prototypes of traditional ML models and autonomous, multi-agent AI systems to drive our product roadmap.
• Architect and deploy robust AI Agentic workflows capable of task planning, recursive reasoning, tool usage, and self-reflection to automate complex real estate processes.
• Hands-on development of end-to-end MLOps and LLMOps pipelines , including dataset curation, model training, prompt engineering, agent trace evaluation, testing, and production deployment.
• Continuously refine and optimize traditional ML models and agentic architectures (e.g., via prompt optimization frameworks like DSPy) to maximize accuracy and minimize hallucinations.
• Develop methodologies for evaluating both predictive model performance and generative agent compliance, utilizing A/B testing, cross-validation, and LLM-as-a-judge evaluation frameworks .
• Partner with Product, Engineering, Research, and other cross-functional teams to translate business needs into scalable, secure AI-driven solutions.
• Stay up-to-date with cutting-edge MLOps, LLMOps, and Agentic AI technologies.

Required Skills & Qualifications:

• Experience: 5+ years of hands-on experience in data science, analytics, machine learning, and AI engineering.
• Core Languages: Expert in SQL and advanced SQL, and highly proficient in production-grade Python.
• Traditional ML Ecosystem: Proficient in frameworks, tools, and libraries such as TensorFlow, PyTorch, scikit-learn, Pandas, and Jupyter Notebook.
• Agentic AI Frameworks: Proven experience building stateful, multi-agent workflows using LangChain, LangGraph, CrewAI, LlamaIndex Workflows , or the Microsoft Agent Framework .
• Enterprise Agent Platforms: Hands-on experience using enterprise-grade agent development and orchestration platforms, specifically Dataiku (utilizing Dataiku LLM Mesh & Agent Hub) or Google Cloud's Gemini Enterprise Agent Platform (formerly Vertex AI Agent Builder) to build, run, and govern production-ready AI agents.
• Integrations & Protocols: Solid proficiency with building API integrations, advanced Function Calling, and working with the Model Context Protocol (MCP) to seamlessly connect LLMs to external databases and software tools.
• Data & Knowledge Retrieval: Strong data manipulation, wrangling, and mining skills paired with a deep understanding of Vector Databases (e.g., Pinecone, Qdrant, Milvus) and advanced Retrieval-Augmented Generation (RAG and GraphRAG).
• AI Security: Deep understanding of LLM vulnerabilities, including prompt injection mitigation , jailbreak prevention, and the implementation of safety guardrails (e.g., Guardrails AI, NeMo Guardrails).
• Cloud & Platform Expertise: Expert in AWS artificial intelligence/machine learning services, specifically AWS SageMaker and AWS Bedrock, Bedrock AgentCore , alongside Redshift, Comprehend, and Lex.
• Observability: Familiarity with LLM tracing and observability infrastructure (e.g., LangSmith, Langfuse, or Arize Phoenix) to monitor and debug complex agent loops.
• Soft Skills: Strong analytical mindset with excellent communication skills to convey intricate technical concepts and agent behaviors effectively to both engineering teams and non-technical business stakeholders.

Education:

Bachelor\'s degree in Computer Science, Data Science, Mathematics, Statistics, or a related quantitative field.

Preferred Qualifications:

• Master’s degree or a Ph.D. in a quantitative field is a plus.
• AWS Certified Generative AI Developer – Professional certification or equivalent hands-on experience building autonomous agentic systems using Amazon Bedrock Agents and Bedrock Flows.
• Experience with serverless deployment architectures, including AWS Lambda or Glue jobs.
• AWS Certified Solutions Architect or AWS Certified Machine Learning Specialty is a plus.

The salary range for this position is approximately $155,000 to $175,000, based on experience, skills, and qualifications. This position is also eligible for annual performance-based bonuses. Our comprehensive benefits package includes individual and family health, vision, and dental coverage, 401(k) plan with employer-matching, and Paid Time Off (PTO) and holidays.

It is the company\'s policy to recruit, hire, train and promote individuals, as well as to administer any and all personnel actions, without regard to race, color, religion, age, sex (including gender identity, sexual orientation, and pregnancy), marital status, national origin, disability, genetic information, ancestry, military status or any other unlawfully prohibited characteristic in accordance with applicable laws