Researchers have developed a closed-form polynomial autoencoder that achieves fourfold compression of transformer embeddings while outperforming traditional PCA. By pairing a PCA encoder with a quadratic Ridge decoder, the method delivers superior accuracy without requiring neural networks or iterative training.