Senior Software Engineer – Inference

Neural Solutions; Columbia (MD); On-site; USD 204,000 - 247,000; Full time

Job summary

Neural Solutions in Columbia, MD seeks a Senior Software Engineer to advance AI infrastructure and ensure access to high-quality LLMs across the inference stack. You will lead deployment, mentor engineers, and drive best practices while building in-house services for reliable inference.

Collaborate with cross-functional teams to integrate LLM-powered tools and support surge needs, shaping scalable, production-grade infrastructure in a cloud-native environment.

Qualifications

• 12 years of experience with a Bachelor's degree, or 16 years without a degree.
• Experience with Python and/or other modern programming languages.
• Experience with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Experience with AWS or other cloud providers.
• Strong communication and leadership/mentoring skills.

Responsibilities

• Lead evaluation, configuration, and deployment of inference models for our users.
• Mentor engineers and grow development best practices and standards for the team.
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
• Engage with other teams within our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.

Skills

Python

Leadership

Mentoring

Communication

Education

Bachelor's degree in a technical discipline

Tools

Argo CD

CI/CD frameworks

Kubernetes

Helm

AWS

Job description

Senior Software Engineer

Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. Your focus will be ensuring access to the highest available quality LLMs to users throughout the inference software stack.

Responsibilities

• Lead the evaluation, configuration, and deployment of inference models for our users.
• Mentor engineers and grow development best practices and standards for the team.
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
• Engage with other teams within our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.

Required Skills

• Experience with Python and/or other modern programming languages.
• Experience with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Experience with AWS or other cloud service providers.
• Strong communication skills and ability to mentor other engineers.
• Excellent leadership and stakeholder management skills.

Nice To Have

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Knowledge of and interest in hosting AI capabilities.

Experience Required: 12 years with Bachelor's degree in a technical discipline or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000