news
11

Spinf-serve is a new open-source inference server for bulk classification and decision-making on a single GPU, reading each piece of content once and scoring all associated questions in the same pass. It is OpenAI-compatible and released under Apache 2.0.

Only full members can comment

Log in to express your opinion.

No comments yet.