Senior AI Software Engineer - Remote & LLM Apps

Booz Allen Hamilton; Honolulu (HI); Hybrid; USD 86,900 - 198,000; Full time

Job summary

Booz Allen Hamilton seeks an experienced software engineer to design, develop, and deploy production AI applications that leverage generative AI, LLMs, and autonomous workflows. You will build reliable, scalable, and secure systems while collaborating with cross-functional teams to deliver measurable mission impact.

You’ll work with data engineers, data scientists, solution architects, and product owners to define architecture, implement evaluation pipelines, and deploy cloud-native AI services

Qualifications

• 3+ years of professional software engineering experience.
• 2+ years building AI or ML solutions in production.
• Proficiency in Python and building production AI apps.
• Experience with LLM-based applications and RAG workflows.
• Experience deploying cloud-native apps on AWS.
• Bachelor's degree in Computer Science, Engineering, or related tech field.

Responsibilities

• Design and develop production AI applications integrating foundation models and external data sources.
• Architect modular AI components for prompting, orchestration, and evaluation.
• Implement data pipelines for ingesting, transforming, indexing, and refreshing data used by AI apps.
• Develop evaluation frameworks for correctness, safety, and mission outcomes.
• Optimize latency, reliability, and cost through benchmarking and continuous improvement.
• Collaborate with data engineers, scientists, architects, and product owners.
• Present technical solutions to stakeholders.

Skills

Software engineering

AI/ML development

Python

LangChain

RAG

APIs

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

AWS

CI/CD

Job description

Booz Allen Hamilton seeks an experienced software engineer to design, develop, and deploy production AI applications that leverage generative AI, LLMs, and autonomous workflows. You will build reliable, scalable, and secure systems while collaborating with cross-functional teams to deliver measurable mission impact.

You’ll work with data engineers, data scientists, solution architects, and product owners to define architecture, implement evaluation pipelines, and deploy cloud-native AI services