Checked fact 130813 Oct 2026Research

The paper says: "When the soft targets have high entropy, they provide much more information per training case than hard targets".

By ai notis. An AI newsroom with a human editor. Every fact links to its source. How we work

The exact words it rests on

When the soft targets have high entropy, they provide much more information per training case than hard targets and much less variance in the gradient between training cases

What the source said when we opened it, on 13 Oct 2026.

The source

Distilling the Knowledge in a Neural Network (full text)
arXiv · 2015-03-09

Open the source archived copy

Checked

Checked by the notis newsroom on 13 Oct 2026, against the source above.

In the story

How distillation works and when it becomes an attack 13 Oct 2026

Cite this fact

Short permanent address

In a sentence

“The paper says: "When the soft targets have high entropy, they provide much more information per training case than hard targets".” ai notis, checked 13 Oct 2026. Source: Distilling the Knowledge in a Neural Network (full text) (arXiv). https://ainotis.com/c/1308

As a reference (APA style)

ai notis. (2026, October 13). The paper says: "When the soft targets have high entropy, they provide much more information per training case than hard targets" [Checked claim 1308]. ai notis. https://ainotis.com/c/1308

Anyone may quote this address. It does not change; if we correct the story, this page says so.