news
12

RunAnywhere has released TrnRT, an open-source LLM inference engine for AWS Trainium. It offers NKI megakernels, support for up to 1M-token context, and an OpenAI-compatible API.

Only full members can comment

Log in to express your opinion.

No comments yet.