AI Software Engineer, Senior

Booz Allen Hamilton; Honolulu (HI); Hybrid; USD 86,900 - 198,000; Full time

Job summary

Booz Allen Hamilton seeks an experienced software engineer to design, develop, and deploy production AI applications that leverage generative AI, LLMs, and autonomous workflows. You will build reliable, scalable, and secure systems while collaborating with cross-functional teams to deliver measurable mission impact.

You’ll work with data engineers, data scientists, solution architects, and product owners to define architecture, implement evaluation pipelines, and deploy cloud-native AI services

Qualifications

• 3+ years of professional software engineering experience.
• 2+ years building AI or ML solutions in production.
• Proficiency in Python and building production AI apps.
• Experience with LLM-based applications and RAG workflows.
• Experience deploying cloud-native apps on AWS.
• Bachelor's degree in Computer Science, Engineering, or related tech field.

Responsibilities

• Design and develop production AI applications integrating foundation models and external data sources.
• Architect modular AI components for prompting, orchestration, and evaluation.
• Implement data pipelines for ingesting, transforming, indexing, and refreshing data used by AI apps.
• Develop evaluation frameworks for correctness, safety, and mission outcomes.
• Optimize latency, reliability, and cost through benchmarking and continuous improvement.
• Collaborate with data engineers, scientists, architects, and product owners.
• Present technical solutions to stakeholders.

Skills

Software engineering

AI/ML development

Python

LangChain

RAG

APIs

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

AWS

CI/CD

Job description

Overview

Your growth matters to us - explore our career development opportunities.

Be empowered to succeed in a people-first culture that values collaboration and ingenuity while supporting your wellbeing and candidate journey.

What You’ll Do

As an experienced software engineer, you know how to design, develop, and deliver production AI applications that demonstrate the practical value of generative AI, large language models (LLMs), and autonomous workflows. You combine strong software engineering fundamentals with modern AI development practices to build reliable, scalable, and secure systems that solve real-world problems.

You’ll design AI applications that leverage prompting, retrieval-augmented generation (RAG), agentic workflows, evaluation pipelines, and human-in-the-loop interactions to deliver measurable mission impact. You’ll build modular, reusable AI capabilities that integrate multiple model providers and external tools while optimizing for performance, cost, observability, and safety.

You’ll rapidly prototype and iterate using AI-assisted development tools, applying eval-driven development and continuous experimentation to validate solutions before deploying them into production.

Working alongside data engineers, data scientists, solution architects, and product owners, you’ll help define the architecture and engineering practices behind mission-critical AI applications while collaborating with a multidisciplinary team to deliver impactful mission solutions.

What You’ll Do:

• Design and develop production AI applications that integrate foundation models, retrieval systems, external tools, and enterprise data sources.
• Architect modular and reusable AI components for prompting, retrieval, orchestration, tool execution, memory, and evaluation.
• Build AI applications that leverage structured outputs, embeddings, RAG, long-context reasoning, and agentic workflows where appropriate.
• Develop data pipelines for ingesting, transforming, indexing, and refreshing structured and unstructured data used by AI applications.
• Implement evaluation frameworks to measure correctness, robustness, safety, and mission outcomes using both automated and human evaluation techniques.
• Optimize AI applications for latency, reliability, scalability, and operational cost through experimentation, benchmarking, and continuous improvement.
• Apply asynchronous programming and event-driven design patterns to support long-running workflows and distributed AI applications.
• Incorporate observability, monitoring, guardrails, access controls, and responsible AI practices throughout the application lifecycle.
• Deploy AI services securely on AWS or equivalent cloud platforms using Docker, Kubernetes, serverless, or other cloud-native deployment patterns.
• Apply modern software engineering practices, including automated testing, CI/CD, prompt and workflow versioning, and safe rollout of AI updates.
• Leverage AI-assisted development tools to accelerate implementation while maintaining engineering rigor, maintainability, and code quality.
• Collaborate with clients and cross-functional teams to identify high-value AI opportunities, rapidly prototype solutions, and transition successful concepts into production.
• Present technical solutions to both technical and non-technical stakeholders.

Join us. The world can’t wait.

You Have

• 3+ years of experience with software engineering in a professional work environment
• 2+ years of experience developing AI or machine learning solutions in a professional environment
• Experience building production AI applications using programming languages such as Python
• Experience designing and implementing generative AI applications using large language models
• Experience building retrieval-augmented generation (RAG) solutions and integrating AI systems with enterprise data
• Experience with AI orchestration frameworks such as LangChain
• Experience developing AI applications that interact with external tools, APIs, or enterprise systems, and evaluating and improving AI application quality through testing, experimentation, or benchmarking
• Experience deploying cloud-native applications using cloud platforms such as AWS
• Bachelor\'s degree in Computer Science, Engineering, or a technology field

Nice If You Have

• Experience building AI applications that incorporate autonomous or agentic workflows
• Experience with multimodal AI applications involving text, images, audio, or documents
• Experience designing AI evaluation, observability, or safety frameworks
• Experience deploying portable, edge, or offline-capable AI applications
• Experience developing user interfaces that enable effective interaction with AI applications
• Experience delivering technical solutions in client-facing environments
• Experience using AI-assisted software development tools to improve engineering productivity
• Master\'s degree in Computer Science, AI, or a related technical field

Clearance

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; Secret clearance is required.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page. Salary at Booz Allen is determined by various factors, including location, education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $86,900.00 to $198,000.00 (annualized USD). This posting will close within 90 days from the Posting Date.

Identity and Usage Policy

Identity Statement: As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You may be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Candidate AI Usage Policy: AI is a part of our daily work at Booz Allen, and we are committed to responsible and ethical use of AI tools. Use of AI or other tools to assist with responses during interviews is prohibited unless permission is explicitly provided.

Work Model: Our people-first culture prioritizes collaboration, whether in person or virtually. Generally, remote teammates should have cameras on during meetings.

• Remote: There may be occasions to work in person at Booz Allen or a customer facility.

• Hybrid: You will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and role needs. You may also be required to work from or visit a customer facility.

• Onsite: Work will primarily be performed at a Booz Allen office or customer facility.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, veteran status, or any other status protected by applicable law.