Evaluating word embeddings for language acquisition
Stroudsburg, PA : Association for Computational Linguistics (ACL)
InChersoni, E.; Jacobs, C.; Oseki, Y. (ed.), Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pp. 38-42
Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2020) (2020, 19 November)
Article in monograph or in proceedings
Display more detailsDisplay less details
SW OZ DCC PL
SW OZ DCC BO
Chersoni, E.; Jacobs, C.; Oseki, Y. (ed.), Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics
Continuous vector word representations (or word embeddings) have shown success in capturing semantic relations between words, as evidenced by evaluation against behavioral data of adult performance on semantic tasks (Pereira et al., 2016). Adult semantic knowledge is the endpoint of a language acquisition process; thus, a relevant question is whether these models can also capture emerging word representations of young language learners. However, the data for children’s semantic knowledge across development is scarce. In this paper, we propose to bridge this gap by using Age of Acquisition norms to evaluate word embeddings learnt from child-directed input. We present two methods that evaluate word embeddings in terms of (a) the semantic neighbourhood density of learnt words, and (b) convergence to adult word associations. We apply our methods to bag-of-words models, and ﬁnd that (1) children acquire words with fewer semantic neighbours earlier, and (2) young learners only attend to very local context. These ﬁndings provide converging evidence for validity of our methods in understanding the prerequisite features for a distributional model of word learning.
Upload full text
Use your RU credentials (u/z-number and password) tolog in with SURFconextto upload a file for processing by the repository team.