Senior Software Engineer – Tools and Applications

Neural Solutions; Columbia (MD); On-site; USD 204,000 - 247,000; Full time

Job summary

Neural Solutions in Columbia, MD seeks a Software Engineer - AI Infrastructure to build and maintain the foundation for customer AI capabilities and support a broader ecosystem of AI-enabled applications.

The role emphasizes production software, cloud, and SRE best practices, with strong focus on leading teams and delivering scalable AI tooling. Expect collaboration with cross-functional teams in a fast-paced environment.

Qualifications

• 12 years experience with Bachelor's degree in a technical field, or 16 years without degree.
• Experience building AI infrastructure and production software.
• Experience with cloud providers such as AWS.

Responsibilities

• Develop high-quality AI tools and applications for the workforce to use
• Ensure high availability, reliability, performance, and security of AI tools
• Modify FOSS to accommodate the customer’s use cases
• Regularly engage with customers, eliciting requirements and developing solutions
• Maintain existing customer-facing infrastructure and applications, ensuring reliable services
• Serve as a technical lead for AI Tools and Applications initiatives, coordinating work across teams
• Conduct regular one-on-ones and provide coaching and support for assigned team members
• Act as the team POC for contract administration functions
• Define solutions for complex, underspecified systems and requirements
• Establish new technical policies, standards, and governance frameworks
• Drive adoption of new technologies and practices across engineering teams
• Implement and oversee monitoring, logging, and observability for AI services
• Communicate effectively with stakeholders at multiple levels

Skills

Python

UI/UX principles

LLMs in workflows

Cloud (AWS)

Kubernetes/Helm

Argo CD / CI/CD

Docker

SRE best practices

Team leadership

Production software

Education

Bachelor's degree in a technical field

Tools

Docker

Kubernetes

Argo CD

CI/CD tooling

Job description

Software Engineer - AI Infrastructure

We're seeking a software engineer to support our AI infrastructure team. In this role, you'll help build and maintain the foundation for customer AI capabilities, while supporting a broader ecosystem of AI-enabled applications.

Responsibilities

• Develop high-quality AI tools and applications for the workforce to use
• Ensure high availability, reliability, performance, and security of AI tools
• Modify FOSS (Free and Open-Source Software) to accommodate the customer’s use cases
• Regularly engage with customers, conducting requirements elicitation and developing solutions to address their needs
• Maintain existing customer-facing infrastructure and applications, ensuring reliable services
• Serve as a technical lead for AI Tools and Applications initiatives, coordinating work across integrated teams
• Conduct regular one-on-ones and provide coaching, feedback, and support for assigned team members
• Act as the team point of contact (POC) for contract administration functions
• Navigate ambiguity and define solutions for complex, underspecified systems and requirements
• Establish new technical policies, standards, and governance frameworks where gaps exist
• Drive adoption of new technologies and practices across engineering teams
• Implement and oversee monitoring, logging, and observability solutions for AI services
• Ensure high availability, reliability, performance, and security of components
• Communicate effectively with stakeholders at multiple organizational levels

Required Skills

• Expertise in UI/UX principles
• Significant experience with using LLMs as a part of a code solution workflow
• Ability to learn new technologies quickly
• Strong communication skills and willingness to ask questions
• Mastery of Python
• Demonstrate a willingness to learn, lead a team, and manage multiple junior developers
• Significant experience developing and maintaining production software
• Familiarity with AWS or other cloud service providers
• Experience with Kubernetes/Helm
• Familiarity with Argo CD and/or other CI/CD frameworks
• Experience supporting production software using Site Reliability Engineering (SRE) best practices
• Experience with Docker and containerization

Nice To Have

• Experience with LLM UI Open-Source software such as OpenWebUI
• Proficiency with AWS or other cloud service providers
• Proficiency with Kubernetes/Helm
• Proficiency with Argo CD and/or other CI/CD frameworks
• Extensive experience supporting production software using Site Reliability Engineering (SRE) best practices
• Proficiency with Docker and containerization
• Extensive experience with customer requirements elicitation, an expert in community outreach and integration
• Experience with LLM model hosting

Experience Required: 12 years with Bachelor's degree in a technical field, or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000