Hugging Face Papers ↗ · 2026-11-15
新颖性揭示:对40篇开放权重大型语言模型技术报告的消融、可复现性与透明性分析
媒体报道 Hugging Face Papers 原文语言:中文
2025年,Hugging Face新增48种LLM架构,其中大多数复用已有模块。研究抽样40篇技术报告,发现仅19项新颖性声明有对照实验,报告透明度普遍不足,提出七条改进准则。
全文
In 2025 alone, 48 new large language model (LLM) architectures were added to the Hugging Face transformers library, and many of them arrive with a technical report that presents the model as new. What is actually new in these models, and is it tested? We put this question to LLM technical reports. We look at three things: what the reference code shows about how new open-weight architectures differ from earlier ones; what 40 randomly sampled technical reports claim as new and whether they support it with ablation studies; and what they disclose for reproducibility and transparency. In the library, 39 of the 48 architectures added in 2025 take at least two of their three core blocks from another model, most often Llama, although part of this reflects how the library writes code. In the reports, 19 of 73 architectural or training novelty claims come with a controlled with/without comparison; 4 of 40 reports state more than one training run; 8 rerun the models they compare against under one setup; and 1 discloses data mixture, token count, and compute together. We also looked for known components given new names: none of five candidate cases hid its origin, though we did not study model names. We propose seven reporting rules for LLM release reports and apply them to two reports. We do not judge model quality, and an untested claim may still be true.
View arXiv page View PDF Project page GitHub 0 Add to collection
正文以来源语言显示。