AI Architect & RAG Data Science Engineer

Modern Technology Solutions, Inc. (MTSI); Huntsville (AL); Hybrid; USD 120,000 - 200,000; Full time

Job summary

MTSI is seeking a Big Data Scientist and AI Architect to provide technical leadership on an active STRIKE IRAD focused on data taxonomy, meta-tagging, and high-quality data processes for large disorganized test data sets.

You will design secure, full-stack AI/ML architectures, apply retrieval-augmented generation techniques, and collaborate with engineering and test teams to deliver traceable, evidence-based analytics for mission environments.

Qualifications

• 4+ years delivering software, data, analytics, AI/ML in defense-adjacent or mission-critical environments.
• Bachelor's degree in AI/ML/CS/Engineering or related field; equivalent experience.
• Deep understanding of agentic AI and RAG systems, including tool use, orchestration, retrieval design, and responsible-AI controls.
• Knowledge of BM25, TF-IDF, vector embeddings, and hybrid retrieval.
• Proficiency in Python and at least one OO language (Java/C#); familiarity with Git and CI/CD practices.
• Knowledge of SQL, data pipelines, APIs, containers, and secure software development.

Responsibilities

• Translate needs into RAG solution designs with measurable outcomes.
• Design secure, full-stack AI/ML architectures (data ingestion, APIs, model services).
• Implement secure RAG and agent workflows with controlled tool use and local inference where allowed.
• Apply search/retrieval methods to improve recall, precision, and trust in technical knowledge retrieval.
• Develop data-quality metrics, baselines, experiments, and performance dashboards.
• Contribute to secure RESTful APIs, data stores, and observability for enterprise-scale AI products.
• Support DevSecOps/MLOps practices across approved environments.
• Collaborate with engineering and program leadership to resolve complex data problems and communicate solutions.

Skills

Python

Java/C#

Git

Education

Bachelor's degree in AI/ML/CS/Engineering

Tools

llama.cpp

GitHub Actions

Kubernetes

Azure DevOps

Job description

MTSI is looking for a “Big Data” Scientist and AI Architect to deliver key technical leadership on an ongoing and funded MTSI “STRIKE” IRAD. This IRAD is focused on bringing data taxonomy, data meta-tagging and quality data processes to large dis-organized test data sets and tailoring AI Agents to rapidly locate key data packages needed for model development. More details on the IRAD will be provided to qualified candidates in the interview.

MTSI’s core business concept is to take on and solve our countries most challenging defense requirements. Managing data and optimizing AI to maximize operational capability falls into this problem set. This position will provide ley data expertise across our broad DoW customer base as they address these key challenges.

POSITION SUMMARY (as IRAD Technical Lead)

• Serves as an AI Architect and RAG Data Science Engineer supporting the design, delivery, and continuous improvement of a secure Retrieval-Augmented Generation (RAG) capability. The position requires the individual to design secure, full-stack AI/ML architectures spanning data ingestion, APIs, model services, retrieval, applications, and deployment infrastructure.
• The role translates mission needs into governed data products and full-stack AI services that convert distributed technical, engineering, test, and telemetry information into traceable, role-appropriate answers and analytics. Working with technical and program leadership, the incumbent contributes hands-on expertise across AI/ML, software, cloud, cyber, data engineering, systems engineering, and test.

MISSION FOCUS: Deliver trustworthy, secure, and measurable AI-enabled knowledge access and decision support across constrained enterprise and mission environments.

Principal Responsibilities

• Mission and architecture delivery: Translate operational, test, and sustainment needs into RAG solution designs, delivery increments, acceptance criteria, and measurable decision-support outcomes under established program priorities.
• Secure RAG and agent implementation: Design and implement capabilities spanning source onboarding, document parsing and normalization, metadata and taxonomy management, hybrid retrieval, reranking, LLM inference, citations, guardrails, and agentic workflows using controlled tool use and handoffs; apply llama.cpp or comparable local inference runtimes where permitted.
• Search and retrieval engineering: Apply search methods including BM25, TF-IDF, embeddings, hybrid retrieval, metadata filtering, and reranking to improve recall, precision, traceability, and user trust in technical knowledge retrieval.
• Data science and assurance: Develop data-quality, retrieval-relevance, groundedness, faithfulness, latency, usefulness, and safety evaluations; maintain curated test sets, analytic baselines, experiments, and performance dashboards to support evidence-based releases.
• Full-stack delivery: Contribute to secure user experiences, RESTful APIs, application services, workflow orchestration, data stores, vector databases, integration patterns, and observability needed to operate an AI product at enterprise scale.
• Data and telemetry integration: Partner with engineering, test, and data owners to integrate structured and unstructured technical data, test artifacts, logs, sensor or platform telemetry, and operational knowledge while preserving provenance and access controls.
• DevSecOps and MLOps: Apply Git-based development, automated testing, CI/CD, containerization, vulnerability management, model and data versioning, monitoring, auditability, and repeatable deployment across approved environments.
• Collaboration and complex problem resolution: Help decompose ambiguous technical problems involving fragmented data, conflicting sources, constrained networks, evolving requirements, performance tradeoffs, and mission risk; document findings and communicate workable alternatives to technical and program stakeholders.

Required Qualifications

• Four or more years of professional experience delivering software, data, analytics, AI/ML, cloud, or data-platform capabilities in an enterprise, regulated, mission-critical, or defense-adjacent environment.
• Bachelor's degree in artificial intelligence, machine learning, data science, computer science, engineering, applied mathematics, or a related discipline; equivalent relevant experience may be considered where permitted by contract.
• Deep practical understanding of agentic AI and RAG systems, including tool use, multi-step orchestration, retrieval design, prompt and model orchestration, source traceability, evaluation, and responsible-AI controls; experience with llama.cpp and OpenCode or comparable approved tools.
• Working knowledge of search and retrieval algorithms including BM25, TF-IDF, vector embeddings, hybrid retrieval, metadata filtering, and reranking.
• Strong programming and engineering foundation using Python and at least one additional object-oriented language such as Java, C#, or comparable technologies; familiarity with Git, debugging, build workflows, and code review practices.
• Working knowledge of SQL, structured and unstructured data pipelines, APIs, service-oriented architectures, document processing, vector search, web or frontend integration, containers, CI/CD, and secure software development practices.
• Ability to communicate technical designs, delivery risk, test evidence, and operational implications clearly to technical, government, contractor, and nontechnical stakeholders.

Preferred Qualifications

• Master's degree or active graduate-level study in AI, ML, data science, computer science, engineering, or a closely related field.
• Experience with Kubernetes, cloud-native platforms, infrastructure as code, GitLab, GitHub Actions, Azure DevOps, or comparable automated delivery toolchains.
• Experience operating AI, analytics, telemetry, digital engineering, test, or sustainment solutions in Department of Defense, aerospace, aviation, or similarly constrained environments.
• Experience implementing model evaluation, observability, safety or policy guardrails, identity-aware access controls, and data or model provenance for generative-AI systems.
• Experience leading Agile or hybrid delivery teams and integrating AI products with enterprise systems, secure networks, edge deployments, or disconnected operations.

CONTRACTOR, SECURITY, AND WORK CONDITIONS

• Must be a U.S. citizen and able to obtain and maintain the security clearance, base access, and eligibility for classified, controlled, or other restricted environments required by the contract.
• Performs contractor technical support and advisory functions only; command, acquisition, operational, and inherently governmental decisions remain with authorized government officials.
• Preferred location is the Huntsville, AL area but will consider telework with incremental alignment travel for the right candidate.
• Work may require onsite presence at government or company facilities, collaboration across secure and non-secure networks, CONUS or OCONUS travel, surge support, and adjustment to evolving mission priorities.