Senior LLM Architect & AI Solutions Leader

Accenture Federal Services; Columbia (MD); On-site; USD 139,000 - 269,000; Full time

Job summary

Accenture Federal Services seeks a Senior AI/ML Leader in Maryland to guide a team of 3 engineers and full-stack developers. You will define roadmaps for LLM applications, align with business goals, and drive architecture, MLOps, and governance across projects.

You will oversee RAG, fine-tuning, and scalable microservices, with hands-on work in Python/TypeScript, React, FastAPI, and cloud platforms. Strong leadership and security posture are essential.

Qualifications

• 8 years in software engineering or data science with 3 years in leadership roles.
• 3 years hands-on experience with LLMs and/or generative AI applications.
• Experience deploying production AI/ML systems at scale.
• Experience managing cross-functional technical teams.
• Proficiency with ML frameworks (PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex).

Responsibilities

• Lead and mentor a team of 3 ML engineers and full-stack developers.
• Define technical roadmaps for LLM application development aligned with business objectives.
• Facilitate sprint planning, code reviews, and architecture design sessions.
• Manage resource allocation, project timelines, and stakeholder communications.
• Architect full-stack LLM solutions including frontend interfaces, API layers, vector databases, and model orchestration.
• Oversee engineering strategies, retrieval-augmented generation (RAG) implementations, and fine-tuning initiatives.
• Design scalable microservices architectures integrating LLM APIs (OpenAI, Anthropic, AWS Bedrock, Azure OpenAI).
• Implement MLOps pipelines for model versioning, A/B testing, monitoring, and continuous deployment.
• Optimize inference performance, cost management, and latency reduction strategies.

Skills

Leadership

Team management

Strategic thinking

Communication skills

Agile/Scrum

LLM applications

AI governance

Cloud platforms

MLOps

Education

Bachelor’s degree in CS or related field

Master’s degree or PhD in CS/AI/ML

DoD 8140 Policy Framework

Certifications in prompt engineering / LLM development / AI ethics

Tools

PyTorch

TensorFlow

Hugging Face

LangChain

LlamaIndex

Pinecone

Weaviate

ChromaDB

AWS Bedrock

Azure OpenAI

Docker

Kubernetes

MLflow

Weights & Biases

Job description

Accenture Federal Services seeks a Senior AI/ML Leader in Maryland to guide a team of 3 engineers and full-stack developers. You will define roadmaps for LLM applications, align with business goals, and drive architecture, MLOps, and governance across projects.

You will oversee RAG, fine-tuning, and scalable microservices, with hands-on work in Python/TypeScript, React, FastAPI, and cloud platforms. Strong leadership and security posture are essential.