researchNov 8
Generating Human-level Text with Contrastive Search in Transformers 🤗
Researchers at Hugging Face introduced Contrastive Search, a decoding algorithm that generates human-level text with Transformers. The method uses a combination of likelihood and semantic similarity to select the next token in a sequence. This approach improves text generation quality, reducing repetition and increasing coherence. You can explore the implementation in Hugging Face's Transformers library.
Key takeaways
- Contrastive Search uses likelihood and semantic similarity for decoding.
- Reduces repetition and increases coherence in generated text.
- Implementation available in Hugging Face's Transformers library.