Universal sentence encoder for English

D Cer, Y Yang, S Kong, N Hua, N Limtiaco… - Proceedings of the …, 2018 - aclanthology.org
D Cer, Y Yang, S Kong, N Hua, N Limtiaco, RS John, N Constant, M Guajardo-Cespedes…
Proceedings of the 2018 conference on empirical methods in natural …, 2018aclanthology.org
We present easy-to-use TensorFlow Hub sentence embedding models having good task
transfer performance. Model variants allow for trade-offs between accuracy and compute
resources. We report the relationship between model complexity, resources, and transfer
performance. Comparisons are made with baselines without transfer learning and to
baselines that incorporate word-level transfer. Transfer learning using sentence-level
embeddings is shown to outperform models without transfer learning and often those that …
Abstract
We present easy-to-use TensorFlow Hub sentence embedding models having good task transfer performance. Model variants allow for trade-offs between accuracy and compute resources. We report the relationship between model complexity, resources, and transfer performance. Comparisons are made with baselines without transfer learning and to baselines that incorporate word-level transfer. Transfer learning using sentence-level embeddings is shown to outperform models without transfer learning and often those that use only word-level transfer. We show good transfer task performance with minimal training data and obtain encouraging results on word embedding association tests (WEAT) of model bias.
aclanthology.org