Senior AI Solutions Architect: LLM & Enterprise Deployment

Accenture; Columbia (MD); On-site; USD 139,000 - 269,000; Full time

Job summary

Accenture Federal Services is seeking a Senior Manager for Full Stack LLM Development to lead design, development, and deployment of enterprise-grade AI solutions for federal clients. This role oversees cross-functional teams and delivers end-to-end LLM applications from model fine-tuning to production-grade deployment.

You will guide strategic roadmaps, oversee architecture, MLOps, and cost-management while collaborating with product and security teams to ensure compliance and scale.

Qualifications

• 8 years in software engineering or data science with 3 years in leadership roles.
• 3 years hands‑on experience with LLMs and/or generative AI applications.
• Experience deploying production AI/ML systems at scale.
• Experience managing cross‑functional technical teams.
• Proficiency with ML frameworks (PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex).
• Experience with vector databases (Pinecone, Weaviate, ChromaDB), embeddings, and/or semantic search.
• Experience with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes).
• Familiarity with CI/CD, infrastructure‑as‑code, and/or MLOps tools (MLflow, Weights & Biases).

Responsibilities

• Lead and mentor a team of 3 ML engineers and full-stack developers.
• Define technical roadmaps for LLM application development aligned with business objectives.
• Facilitate sprint planning, code reviews, and architecture design sessions.
• Architect full-stack LLM solutions with frontend interfaces, API layers, vector databases, and model orchestration.
• Oversee engineering strategies, retrieval-augmented generation (RAG) implementations, and fine-tuning initiatives.
• Design scalable microservices architectures integrating LLM APIs (OpenAI, Anthropic, AWS Bedrock, Azure OpenAI).
• Implement MLOps pipelines for model versioning, A/B testing, monitoring, and continuous deployment.
• Prototype emerging capabilities including function calling, agents, and multi-modal applications.
• Partner with product managers, external stakeholders, and security teams on requirements and compliance.
• Present technical proposals and demos to executive leadership.
• Establish coding standards, documentation practices, and knowledge-sharing initiatives.
• Manage vendor relationships and evaluate emerging LLM technologies.

Skills

Leadership

Team management

Strategic thinking

Communication

Education

Bachelor's degree in Computer Science, Engineering, or related field

Master's degree or PhD in Computer Science, AI/ML or related discipline

Tools

PyTorch

TensorFlow

Hugging Face

LangChain

LlamaIndex

Pinecone

Weaviate

ChromaDB

OpenAI API

Anthropic

AWS Bedrock

Azure OpenAI

Docker

Kubernetes

MLflow

Weights & Biases

Job description

Accenture Federal Services is seeking a Senior Manager for Full Stack LLM Development to lead design, development, and deployment of enterprise-grade AI solutions for federal clients. This role oversees cross-functional teams and delivers end-to-end LLM applications from model fine-tuning to production-grade deployment.

You will guide strategic roadmaps, oversee architecture, MLOps, and cost-management while collaborating with product and security teams to ensure compliance and scale.