news
11
Spinf-serve is a new open-source inference server for bulk classification and decision-making on a single GPU, reading each piece of content once and scoring all associated questions in the same pass. It is OpenAI-compatible and released under Apache 2.0.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.