Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters
Nara Institute of Science and Technology · Nara Institute of Science and Technology, Japan
PDF 由论文原始站点提供，PaperCompass 不保存论文文件。DOI 10.18653/v1/2024.emnlp-main.1178 ↗
摘要
该来源暂未提供摘要。