Metalearning with Hebbian Fast Weights

We unify recent neural approaches to one-shot learning with older ideas of associative memory in a model for metalearning. Our model learns jointly to represent data and to bind class labels to representations in a single shot. It builds representations via slow weights, learned across tasks through SGD, while fast weights constructed by a Hebbian learning rule implement one-shot binding for each

[elu_18]

新しいタスクをfew-shotで学習できるように、特徴抽出はタスク間で共有されるSlow Weightで学習し、、タスク毎に特徴とクラスの関係をヘブ則で更新されるFast Weightで学習する。few-shotのSOTA。ヘブ則は各キーが直交していれば