“Intuitively, by going in the direction of the gradient, as opposed to the direction away from the gradient (as done while performing weight updates in SGD), one is maximising loss for that example instead of minimising it”
“We will follow with a presentation of the most important aspects of the Transformer family of models as well as an overview of its most recent iterations since the time of this writing”
“Let me introduce ‘Turing Exhaustiveness’, a neologism, in which today’s intelligence is achieved by covering every possible eventuality with a bespoke rule or action”