We need a 80-160B model urgently. The unified memory device market needs more Models.
The author argues that recent models (e.g. 27B Qwen, 31B Gemma) are not optimized for systems with high RAM capacity (>96GB) and slow memory access. They call for the development of 80-160B models that can utilize unified memory devices. Such models would enable efficient use of available resources on systems with ample RAM. Builders should consider optimizing models for diverse hardware configurations.
Key takeaways
- Recent models (27B Qwen, 31B Gemma) target high-speed, low-capacity systems.
- Users have ample RAM (>96GB) but struggle with slow memory access.
- There is a need for 80-160B models optimized for unified memory devices.
We need a 80-160B model urgently. The unified memory device market needs more Models.
The author argues that recent models (e.g. 27B Qwen, 31B Gemma) are not optimized for systems with high RAM capacity (>96GB) and slow memory access. They call for the development of 80-160B models that can utilize unified memory devices. Such models would enable efficient use of available resources on systems with ample RAM. Builders should consider optimizing models for diverse hardware configurations.
Key takeaways
- Recent models (27B Qwen, 31B Gemma) target high-speed, low-capacity systems.
- Users have ample RAM (>96GB) but struggle with slow memory access.
- There is a need for 80-160B models optimized for unified memory devices.