Software Engineer — AI Inference

Intezra, Inc.; Columbia (MD); On-site; USD 130,000 - 160,000; Full time

Benefits offered by this job

CareFirst medical plans

Dental and Vision coverage

401(k) 15% contribution

PTO: 160 hours

Floating holidays

Code Red Days

Job summary

Intezra, Inc. is seeking a Software Engineer — AI Inference in Columbia, MD to help build and sustain AI infrastructure and inference services.

You will focus on delivering high-quality LLM access across the inference stack while adapting to evolving technologies and requirements. The role emphasizes collaboration with model vendors, internal teams, and customers to support AI-enabled applications, with a strong emphasis on reliability, scalability, and rapid problem solving in a

Qualifications

• 3+ years with a Bachelor's degree, OR
• 4 additional years of relevant experience in lieu of a degree

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to the user base.
• Develop in-house services and techniques to guarantee continual high-quality inference service for customers.
• Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs.
• Engage with other teams in the organization to establish solid infrastructure for services and integrate LLM-powered tools for user needs.

Skills

Python

Argo CD

Kubernetes

AWS

Learning agility

Communication

Education

Bachelor's degree

Tools

Docker

Helm

CI/CD tooling

Job description

Software Engineer — AI Inference

Columbia, MD | Full Time | TS/SCI with Polygraph Required

Position: Software Engineer — AI Inference (Software Engineer, Level 1) — 2 positions

Location: Columbia, MD (on-site)

Category: Software Engineering / AI Infrastructure / LLM Inference

Clearance Requirement: Active TS/SCI with Polygraph

Compensation: $130,000 – $160,000 (annualized USD)

Experience Requirement

• 3+ years with a Bachelor's degree, OR
• 4 additional years of relevant experience in lieu of a degree

Description

Join us in building the next generation of AI infrastructure that will power innovation across the customer organization. We're seeking software engineers to support our AI infrastructure team — helping build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Your focus will be ensuring access to the highest-quality LLMs for users throughout the inference software stack. Requirements shift quickly as needs evolve and new technologies emerge, so you'll keep sharpening your skills and learning to turn loosely defined problems into working solutions.

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to the user base.
• Develop in-house services and techniques to guarantee continual high-quality inference service for customers.
• Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs.
• Engage with other teams in the organization to establish solid infrastructure for services and integrate LLM-powered tools for user needs.

Skills Requirements

• Experience with Python and/or other modern programming languages.
• Familiarity with Argo CD and/or other CI/CD frameworks.
• Experience with Kubernetes/Helm.
• Familiarity with AWS or other cloud service providers.
• Ability to learn new technologies quickly.
• Strong communication skills and willingness to ask questions.

Nice to Haves

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience with other LLM hosting frameworks and practices.
• Experience supporting production software using Site Reliability Engineering (SRE) best practices.
• Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
• Experience with Docker and containerization.

Compensation & Employment Policy

Salary is determined by multiple factors, including location, education, experience, skills, and organizational requirements. The projected compensation range for this position is $130,000 – $160,000 (annualized USD).

Benefits Overview

At Intezra, Inc., we offer a comprehensive benefits package designed to support long-term career growth and work-life balance:

• Three CareFirst medical plans available; Intezra pays up to 100% of healthcare premiums and up to 100% of deductibles (based on plan selection) for employees and dependents
• Intezra pays 100% for CareFirst Dental and Vision plans for employees and dependents
• 401(k): 15% company contribution (no match required)
• PTO: 160 hours, increasing with seniority
• 12 Floating Holidays
• 4 Code Red Days

EEO Statement

Intezra, Inc. provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any kind without regard to race, color, religion, age, sex, national origin, disability status, genetics, pregnancy, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

About Us

Intezra Inc. is a small business prime contractor for all realms of cyber and AI/ML development, from tactical-level tools and capabilities to enterprise-level infrastructure and operations. Our leadership team and staff have helped solve the most complex challenges for the intelligence community for over 15 years.