news
12
RunAnywhere has released TrnRT, an open-source LLM inference engine for AWS Trainium. It offers NKI megakernels, support for up to 1M-token context, and an OpenAI-compatible API.
RunAnywhere has released TrnRT, an open-source LLM inference engine for AWS Trainium. It offers NKI megakernels, support for up to 1M-token context, and an OpenAI-compatible API.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.