tools13h
Lemonade v10.8: auto memory management, cloud offload, Omni improvements, and call your local models as MCP tools
Lemonade v10.8 brings auto memory management, cloud offload, and Omni improvements, allowing for dynamic VRAM management, automatic context sizing, and easier model switching. The update was driven by 20 contributors in 7 days. You can now call local models as MCP tools, streamlining workflows. These changes aim to enhance performance and user experience.
Key takeaways
- 20 contributors in 7 days for v10.8 release
- Dynamic VRAM management auto-unloads idle models
- Automatic context sizing based on available memory and model architecture