CompressionBench asks AI agents to shrink language models and build working inference code. 29 of 36 submissions passed verification. Building smaller models is becoming an agent benchmark.
Source:
#AIResearch #ModelCompression
0007
Post con #ModelCompression
Post pubblici su X che usano #ModelCompression.
Chi-Heng Lin 貓貓🐱 @ChiHengHenry🔥🔥Thrilled to share our work @iclr_conf🔥🔥 🤔 Low-rank decomposition for LLM compression adds significant overhead by splitting 1 matrix into 2. 🔑 Key contribution: ✅ Introduction of decomposition-compression duality: By leveraging the duality, we compress two adjoint matrices within a module, eliminating parameter overhead and achieving state-of-the-art performance! 🚀: w/@jamessealesmith @TuliShikhar 📜: