AI Software Engineer I - LLM Integration

BDO USA, Llp; Nashville (TN); On-site; USD 85,000 - 100,000; Full time

Job summary

BDO USA, LLP is seeking an AI Software Engineer to design, develop, and maintain AI-enabled applications with emphasis on integrating large language models into business workflows. You will partner with stakeholders to understand requirements, implement tested solutions, and support AI services in production.

The role involves contributing to codebases, documentation, and operational support while following secure engineering practices and development standards.

Qualifications

• 2+ years of application development experience.
• Experience with cloud technologies, preferably Microsoft Azure.
• Experience with AI or machine learning, preferred.
• Experience integrating large language models into IT systems, preferred.
• Strong knowledge of secure engineering practices.

Responsibilities

• Develops AI-driven applications and integration points
• Researches and evaluates AI technologies for potential implementation
• Designs and maintains documentation for AI systems and processes
• Collaborates with business units to clarify AI solution requirements
• Coordinates technical efforts related to AI systems issues and optimizations
• Builds and maintains a variety of internally developed and third-party integrated systems documentation
• Implement AI features, including large language model integrations, prompts, and retrieval workflows under guidance
• Proactively monitors and supports existing applications and automations
• Integrates AI functionalities into existing systems to enhance user experience for defined use cases and scoped deliverables
• Supports AI Engineering & IT professionals on responsibilities and provides guidance regarding effective resolution of issues with oversight from team leads
• Escalates critical issues to management and implements strategies for timely resolution based on runbooks and established escalation paths
• Coordinates and organizes efforts and follow-up from items stemming out of team meetings for assigned action items
• Provides Level IV support on specific applications as needed
• Participates in code reviews as a reviewer and author; remediates findings to ensure quality and security in AI applications
• Monitors and supports existing AI applications and automations by reviewing alerts/dashboards and performing routine checks
• Other duties as required

Skills

Verbal and written communication

C# / .NET

Azure

Front-end (React)

CI/CD tooling

Education

Bachelor's degree in Computer Science or Information Systems

High School diploma or GED

Tools

Visual Studio / VS Code

Azure DevOps

Azure / SQL Server (Azure SQL)

Entity Framework

GitHub

Job description

BDO USA, LLP is seeking an AI Software Engineer to design, develop, and maintain AI-enabled applications with emphasis on integrating large language models into business workflows. You will partner with stakeholders to understand requirements, implement tested solutions, and support AI services in production.

The role involves contributing to codebases, documentation, and operational support while following secure engineering practices and development standards.