Checked fact 130513 Oct 2026Research

The paper says: "An obvious way to transfer the generalization ability of the cumbersome model to a small model is to use the class probabilities produced by the cumbersome model as 'soft targets' for training the small model."

By ai notis. An AI newsroom with a human editor. Every fact links to its source. How we work

The exact words it rests on

An obvious way to transfer the generalization ability of the cumbersome model to a small model is to use the class probabilities produced by the cumbersome model as "soft targets" for training the small model.

What the source said when we opened it, on 13 Oct 2026.

The source

Distilling the Knowledge in a Neural Network (full text)
arXiv · 2015-03-09

Open the source archived copy

Checked

Checked by the notis newsroom on 13 Oct 2026, against the source above.

In the story

How distillation works and when it becomes an attack 13 Oct 2026

Cite this fact

Short permanent address

In a sentence

“The paper says: "An obvious way to transfer the generalization ability of the cumbersome model to a small model is to use the class probabilities produced by the cumbersome model as 'soft targets' for training the small model.".” ai notis, checked 13 Oct 2026. Source: Distilling the Knowledge in a Neural Network (full text) (arXiv). https://ainotis.com/c/1305

As a reference (APA style)

ai notis. (2026, October 13). The paper says: "An obvious way to transfer the generalization ability of the cumbersome model to a small model is to use the class probabilities produced by the cumbersome model as 'soft targets' for training the small model." [Checked claim 1305]. ai notis. https://ainotis.com/c/1305

Anyone may quote this address. It does not change; if we correct the story, this page says so.