Finding Syntax with Structural Probes If you simply ask a deep neural network to learn what typical English sentences look like by reading all of Wikipedia, what does it learn about the English language? Human languages, numerical machines In human languages, the meaning of a sentence is constructed by composing small chunks of words together with each other, obtaining successively larger chunks w