Microsoft released Differential Transformer V2, an updated version of their open-source attention mechanism. The new model improves performance on long-range dependency tasks. You can try it on the Hugging Face Hub. This release targets developers working on natural language processing applications.