news
284
YC S25 startup Magnitude has launched an open-source inference engine that automatically compiles and tunes kernels to optimize itself for the user's specific hardware. This self-optimizing approach allows open AI models to run up to twice as fast as llama.cpp across Apple Silicon, NVIDIA, AMD, and standard CPUs.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.