GenAI Subject Matter Expert (SME) Remote · Washington, DC

Tbwa Chiat/Day Inc; Washington (District of Columbia); Remote; USD 150,000 - 200,000; Full time

Job summary

An innovative government contractor is seeking a Generative AI Subject Matter Expert to spearhead AI-driven solutions for the Department of Defense. This role involves leading technical benchmarking and model evaluation, focusing on retrieval-augmented generation and AI-driven document analysis. The ideal candidate will have extensive experience with LLMs and cloud AI services, particularly AWS Bedrock and Sagemaker. Join a dynamic team dedicated to tackling complex challenges and enhancing the capabilities of federal customers through cutting-edge technology and collaboration. This is a unique opportunity to contribute to impactful projects in the defense sector.

Qualifications

• 7+ years of experience in AI, Machine Learning, or Data Science required.
• AWS certifications highly preferred; AIML and SEC experience is a plus.

Responsibilities

• Lead technical research and benchmarking for GenAI and RAG implementations.
• Develop model performance evaluation metrics to optimize AI-driven workflows.

Skills

Generative AI

Machine Learning

Data Science

Python

SQL

AI evaluation frameworks

Education

Bachelor’s degree

Master’s degree

Tools

AWS Bedrock

AWS Sagemaker

Job description

Barbaricum is a rapidly growing government contractor providing leading-edge support to federal customers, with a particular focus on Defense and National Security mission sets. We leverage more than 17 years of support to stakeholders across the federal government, with established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in 2008, our mission is to transform the way our customers approach constantly changing and complex problem sets by bringing to bear the latest in technology and the highest caliber of talent.

Headquartered in Washington, DC's historic Dupont Circle neighborhood, Barbaricum also has a corporate presence in Tampa, FL, Bedford, IN, and Dayton, OH, with team members across the United States and around the world. As a leader in our space, we partner with firms in the private sector, academic institutions, and industry associations with a goal of continually building our expertise and capabilities for the benefit of our employees and the customers we support. Through all of this, we have built a vibrant corporate culture diverse in expertise and perspectives with a focus on collaboration and innovation. Our teams are at the frontier of the Nation's most complex and rewarding challenges. Join our team.

Barbaricum is seeking a Generative AI (GenAI) Subject Matter Expert (SME) to lead technical benchmarking, model evaluation, and best practices for implementing LLMs and AI-driven solutions in the DoD. This role focuses on retrieval-augmented generation (RAG), model performance monitoring, and AI-driven document analysis using AWS Bedrock, AWS Sagemaker, and other AI frameworks.

Responsibilities:

1. Lead technical research and benchmarking for GenAI and RAG implementations.
2. Develop model performance evaluation metrics to optimize AI-driven workflows.
3. Provide expert guidance on LLM integration for DoD applications.
4. Test, validate, and refine GenAI models, ensuring efficiency and reliability.
5. Recommend best practices for unstructured document and content analysis using AI.

Qualifications:

1. Must be a U.S. Citizen and reside within the United States.
2. AWS certifications highly preferred; AIML and SEC experience is a plus.
3. Bachelor’s degree plus 7+ years of experience, or Master’s degree plus 5+ years of experience in AI, Machine Learning, or Data Science.
4. Experience with LLMs, Generative AI, RAG, and AI-powered knowledge retrieval.
5. Strong expertise in AWS Bedrock, cloud AI services, and AI model benchmarking.
6. Proficiency in Python, SQL, and AI evaluation frameworks.

EEO Commitment

All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law.