Senior AI Engineer: Generative AI & LLM Systems

Credence; Boston (MA); On-site; USD 155,000 - 200,000; Full time

Benefits offered by this job

Health Care Plan

Retirement Plan

Life Insurance

Paid Time Off

Family Leave

Disability Insurance

Training & Development

Wellness Resources

Job summary

Credence seeks a Senior AI Software Engineer to design, develop, and deploy advanced AI-driven solutions for federal clients, including generative AI, LLM-powered apps, and agentic systems. You will mentor engineers, shape technical direction, and ensure secure, scalable AI delivery across cross-functional teams.

The role emphasizes collaboration with data, cloud, and mission stakeholders, adherence to DevSecOps, and continuous improvement in AI engineering practices to deliver mission impact.

Qualifications

• Bachelor’s or Master’s in Computer Science, AI/ML, or related field.
• 7+ years of hands-on software engineering experience, including significant experience delivering AI/ML, generative AI, or LLM-powered solutions in production or production-like environments.
• Experience building generative AI applications, working with LLMs, implementing tool/function calling, and applying model evaluation, prompt/context engineering, or retrieval-augmented generation approaches.
• Experience designing or implementing agentic AI solutions using frameworks or platforms such as Agent2Agent Protocol, Bedrock Agents, Mastra, CrewAI, Strands, AgentCore, LangChain, or LangGraph.
• Strong understanding of leading AI APIs and model platforms such as OpenAI, Anthrop ic, Gemini, Amazon Bedrock, and Google Vertex AI.
• Proficiency in TypeScript and familiarity with key libraries and frameworks such as Nx, Next.js, Mastra, Vercel AI SDK, Playwright, Jest, and Vite.
• Pythonproficiencyand familiarity with librariesand frameworks(uv,Pydantic,FastAPI,CrewAI,LangChain,LangGraph, Unstructured).
• Demonstrated curiosity and practical experimentation with emerging AI technologies, with a strong focus on responsible innovation and measurable mission impact.
• Familiarity with CI/CD pipelines(GitLab CI)
• Experience with VS Code and AI extensionssuch asCline and Claude Code.
• Strong communicationskills and client-oriented mindset.
• U.S. Citizenship with eligibility for DoD Secret clearance.

Responsibilities

• Generative AI & LLM Solution Delivery: Lead the design, development, prototyping, and refinement of AI-powered capabilities using generative AI, large language models, retrieval patterns, prompt/context engineering, and secure API integrations.
• Agentic AI System Development: Own end-to-end agentic AI development lifecycles, including model selection, agent design, tool/function calling, orchestration, response synthesis, evaluation, and deployment of reliable AI agents.
• Senior Software Engineering Leadership: Apply strong software engineering principles to design maintainable, testable, and scalable systems; conduct code reviews, establish technical patterns, and leverage AI-assisted development tools responsibly to accelerate delivery.
• Cross-Functional Technical Collaboration: Partner with data engineers, software engineers, data scientists, cloud engineers, and mission stakeholders to translate business and mission needs into operational AI and automation solutions.
• Cloud Enablement & DevSecOps Integration: Design and automate deployment workflows using Infrastructure as Code (IaC), CI/CD pipelines, containers, and cloud-native services to support secure, repeatable, and scalable AI delivery.
• Production Monitoring & Optimization: Monitor AI systems post-deployment, perform performance tuning, and apply best practices for reliability and scalability.
• Technical Rigor & Documentation: Write clean, well-documented code following industry and federal guidelines; support reproducible development.
• Technical Mentorship & Continuous Improvement: Stay current on emerging AI/ML trends, agentic frameworks, model capabilities, and engineering practices while mentoring team members and contributing to reusable standards, documentation, and technical design reviews.

Skills

TypeScript

Python

CI/CD pipelines

LangChain

LangGraph

Playwright

Jest

Vercel AI SDK

Nx

Next.js

Pydantic

FastAPI

OpenAI API

Bedrock Agents

Education

Bachelor’s or Master’s in Computer Science, AI/ML, or related field

Tools

Agent2Agent Protocol

Bedrock Agents

Mastra

CrewAI

Strands

LangChain

LangGraph

Playwright

Jest

Vercel AI SDK

Nx

OpenAI

Amazon Bedrock

Google Vertex AI

Terraform

AWS CDK

CloudFormation

Job description

Credence seeks a Senior AI Software Engineer to design, develop, and deploy advanced AI-driven solutions for federal clients, including generative AI, LLM-powered apps, and agentic systems. You will mentor engineers, shape technical direction, and ensure secure, scalable AI delivery across cross-functional teams.

The role emphasizes collaboration with data, cloud, and mission stakeholders, adherence to DevSecOps, and continuous improvement in AI engineering practices to deliver mission impact.