1sec.ai

Tag

#model-management

Every item tagged model-management, newest first.

2 items

toolsDec 11

New in llama.cpp: Model Management

The llama.cpp project now supports model management features. This allows users to easily switch between different models, track model versions, and manage model dependencies. Builders can use these features to streamline their local LLM development workflows.

Key takeaways
  • llama.cpp now supports model management.
  • Model version tracking and dependency management are included.
  • Streamlines local LLM development workflows.
HHugging Face Blogcovered by 2 sources#local-llm#model-management#llama-cpp
otherSep 19

Rocket Money x Hugging Face: Scaling Volatile ML Models in Production​

Rocket Money partnered with Hugging Face to deploy and manage volatile machine learning models in production. They achieved 99.9% uptime and scaled to handle 1.5M requests per day. The collaboration enabled Rocket Money to efficiently manage complex models and improve customer experience.

Key takeaways
  • 99.9% uptime for volatile ML models
  • 1.5M requests per day
  • managed with Hugging Face
HHugging Face Blog#production-ai#model-management#scalability