AI Model Services Engineer for Production Inference & Pipelines

Kryptauri, Inc; Columbia (MD); On-site; USD 110,000 - 160,000; Full time

Job summary

Kryptauri, Inc. is seeking a Software Engineer to help deliver dependable access to large language models. You will obtain, configure, and test models, then prepare them for use through production inference services.

You will build supporting services, improve model delivery pipelines, and work with vendors to integrate proprietary models reliably. Collaboration with infrastructure and application engineers will help connect model services to user tools.

Qualifications

• Software engineering fundamentals and strong problem-solving abilities.
• Experience with model deployment and inference pipelines is a plus.

Responsibilities

• Obtain, configure, and test large language models for production inference services.
• Build supporting services and improve model delivery pipelines.
• Collaborate with infrastructure and application engineers to connect model services to user tools.
• Respond to urgent requests for inference capacity and adapt services as new models emerge.

Job description

Kryptauri, Inc. is seeking a Software Engineer to help deliver dependable access to large language models. You will obtain, configure, and test models, then prepare them for use through production inference services.

You will build supporting services, improve model delivery pipelines, and work with vendors to integrate proprietary models reliably. Collaboration with infrastructure and application engineers will help connect model services to user tools.