Examples

1. 1.

   For example, consider embeddings of the English word cow. Older embeddings such as word2vec can represent English words such that the distance in the embedding space from cow to bull is similar to the distance from ewe (female sheep) to ram (male sheep) or from female to male. Contextualized language embeddings can go a step further by recognizing that English speakers sometimes casually use the word cow to mean either cow or bull.

Real-world uses

Created for this library

1. 1.

   A bank uses contextualized language embeddings to handle the multiple meanings of the word bank across different customer messages.

2. 2.

   A search team uses contextualized language embeddings so that polysemous query terms are resolved by surrounding context before matching documents.

3. 3.

   A medical NLP team uses contextualized language embeddings on clinical notes because the meaning of a drug abbreviation depends on surrounding tokens.