Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4

In this work, we carry out a data archaeology to infer books that are known to ChatGPT and GPT-4 using a name cloze membership inference query. We find that OpenAI models have memorized a wide collection of copyrighted materials, and that the degree of memorization is tied to the frequency with which passages of those books appear on the web. The ability of these models to memorize an unknown set

[dltlt]

GPT-4 に 小説の一節で（隠した）登場人物の名前を当てさせるテストで、学習させた小説がわかるという論文。昨年までのTwitterのデータも学習したとすれば、誰が何をツイートしたかも覚えているのでは……？