news
284

YC S25 startup Magnitude has launched an open-source inference engine that automatically compiles and tunes kernels to optimize itself for the user's specific hardware. This self-optimizing approach allows open AI models to run up to twice as fast as llama.cpp across Apple Silicon, NVIDIA, AMD, and standard CPUs.

Only full members can comment

Log in to express your opinion.

No comments yet.