Senior Context Engineer, Digital Transformation & Innovation

BDO USA, LLP; Grand Rapids (MI); On-site; USD 95,000 - 125,000; Full time

Job summary

BDO USA, LLP's Senior Context Engineer role focuses on building and maintaining reusable context assets powering the AI-native Advantage platform. You will develop skill files, agent-instruction files, prompt patterns, and retrieval-grounding corpora, following team standards and security guidelines.

You will work with AI engineers and product teams, encode domain knowledge into structured formats, participate in reviews, ensure quality and provenance, and support citizen-engineer enablement

Qualifications

• Education in computer science, information systems, or engineering.
• 3+ years in software, data, or AI engineering with knowledge-management systems.
• Experience building LLM context, retrieval (RAG), or knowledge systems preferred.

Responsibilities

• Builds and maintains reusable context assets and prompt patterns.
• Encodes domain knowledge into structured, retrievable formats with metadata.
• Implements retrieval pipelines with embeddings, indexing, and filtering.
• Runs evaluations and collaborates with teams to integrate context into apps.

Skills

Independent work

Problem solving

Communication

Travel up to 10%

Education

High School Diploma/GED

Bachelor's degree in CS/IS/Engineering

Tools

Azure OpenAI

Azure AI Search

Git

Python

.NET/C#

Markdown

Job description

Job Summary:

The Senior Context Engineer is an individual contributor responsible for building and maintaining the reusable context assets that power BDO Advantage's AI-native product and process development. This role develops skill files, agent-instruction files (CLAUDE.md and equivalents), prompt and context patterns, and retrieval-grounding corpora following team standards, and encodes assurance domain knowledge into structured, retrievable, governed formats. The Senior Context Engineer works independently on well-scoped problems with general direction, collaborates with AI engineers and product teams, and contributes to the quality and reuse of the firm's context infrastructure. The role reports to the Context Engineering Manager and operates within the Advantage SDLC, firm policies, and security standards.

Job Duties:

Context & Knowledge Engineering

• Builds and maintains reusable context assets-skill files, agent-instruction files (CLAUDE.md and equivalents), and prompt and context patterns-following team standards
• Encodes BDO domain knowledge into structured, retrievable formats with appropriate metadata and provenance
• Contributes to context-as-code conventions and applies established inheritance and versioning practices
• Participates in code and context reviews and incorporates feedback

Retrieval & Grounding Engineering

• Implements and maintains retrieval pipelines including chunking, embeddings, indexing, and metadata filtering using Azure AI Search and vector stores
• Curates retrieval corpora and helps manage freshness, versioning, and quality
• Writes grounding tests and helps measure retrieval accuracy and quality

Context Quality & Collaboration

• Runs context and grounding evaluations and helps improve quality across features
• Collaborates with AI engineers and product teams to integrate governed context into applications
• Contributes to team documentation and supports citizen-engineer enablement

Risk Management

• Follows firm security, privacy, and compliance standards (SOC 2, PCAOB AS 2201, QC 1000, ISO 27001) when building context assets
• Ensures sensitive or restricted data does not enter prompts or corpora and maintains traceability of grounded knowledge

Performs other duties as assigned

• Willingly accepts share of less desirable assignments

Supervisory Responsibilities:

• Provides informal guidance to junior engineers, as assigned

Qualifications, Knowledge, Skills, and Abilities:

Education:

• High School Diploma/GED, required
• Bachelor's degree with a focus in Computer Science, Information Systems, Engineering, Information Technology, preferred

Experience:

• Three (3) or more years of experience in software, data, or AI engineering, or related technology fields, required
• One (1) or more years of experience building LLM context, retrieval (RAG), or knowledge-management systems, or equivalent project experience, required
• Experience building reusable components or working within established engineering standards, preferred
• Experience in professional services, assurance, or accounting industries, preferred

License/Certifications:

• Microsoft Certified: Azure AI Fundamentals or Azure AI Engineer Associate, or equivalent, preferred

Technology:

• Working knowledge of Microsoft Azure AI services including Azure OpenAI and Azure AI Search, required
• Understanding of LLM prompting, retrieval, and grounding concepts, required
• Experience with retrieval and vector technologies (embeddings, indexing, search), preferred
• Familiarity with agent-instruction and skill systems (CLAUDE.md and equivalents) and Markdown-based knowledge structures, preferred
• Experience with Git-based workflows and .NET/C# and/or Python, preferred

Knowledge, Skills, & Abilities:

• Solid knowledge of context engineering, retrieval, and grounding fundamentals
• Ability to work independently on well-scoped problems with general direction
• Strong problem-solving skills with attention to accuracy and quality
• Good communication skills and willingness to collaborate and give and receive feedback
• Ability to manage multiple tasks and meet deadlines
• Collaborative mindset with the ability to build relationships across teams
• Ability to travel up to 10%, no relocation required

Individual salaries that are offered to a candidate are determined after consideration of numerous factors including but not limited to the candidate's qualifications, experience, skills, and geography.

National Range: $95,000 - $125,000
Maryland Range: $95,000 - $125,000
NYC/Long Island/Westchester Range: $95,000 - $125,000