Senior AI Inference Engineer

Neural Solutions; Columbia (MD); On-site; USD 204,000 - 247,000; Full time

Job summary

Neuralsolutions in Columbia, MD seeks a Senior Software Engineer to advance AI infrastructure and ensure access to top-quality LLMs across the inference stack.

You will lead model evaluation and deployment, mentor engineers, and build in-house services to sustain high-quality inference for customers, collaborating across teams to integrate LLM tools.

Qualifications

• 12 years of experience with a Bachelor’s degree in a technical discipline, or 16 years without a degree.
• Proficiency in Python or other modern programming languages.
• Experience with CI/CD frameworks and container orchestration (Argo CD, Kubernetes/Helm).
• Strong communication, leadership, and stakeholder management skills.

Responsibilities

• Lead evaluation, configuration, and deployment of inference models for users.
• Mentor engineers and grow development best practices and standards.
• Develop in-house services to guarantee high-quality inference for customers.
• Collaborate with teams to build infrastructure and integrate LLM tools.
• Support surge efforts for short-term, high-priority inference needs.

Skills

Python

Leadership

Mentoring

Communication

Education

Bachelor's degree in a technical discipline

Tools

Argo CD

Kubernetes

Helm

AWS

Job description

Senior Software Engineer

We’re seeking a senior software engineer to support our AI infrastructure team at Columbia, MD. In this role, you’ll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Responsibilities:

• Lead the evaluation, configuration, and deployment of inference models for our users.
• Mentor engineers and grow development best practices and standards for the team.
• Develop in-house services and techniques to ensure high-quality inference service.
• Engage with other teams to establish solid infrastructure for our services.
• Collaborate on surge efforts to support short-term, high-priority inference needs.

Required Skills:

• Experience with Python and/or other modern programming languages.
• Experience with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Experience with AWS or other cloud service providers.
• Strong communication skills and ability to mentor engineers.
• Excellent leadership and stakeholder management skills.

Nice to Have:

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience supporting production software using SRE best practices.
• Knowledge of Elastic, Grafana/Prometheus, and other observability frameworks.

Experience Required: 12 years with Bachelor's degree in technical field, or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000

Questions about this role or want to learn more about Neural Solutions?