Back to feed
research336d ago
Back to The Future: Evaluating AI Agents on Predicting Future Events
Researchers from Hugging Face and the University of Edinburgh evaluated AI agents on their ability to predict future events. The study used a dataset of past events and asked models to forecast what would happen next. The best-performing model was a fine-tuned version of Llama-3-8B, which outperformed other models like GLM-5.2 and Mistral-7B.
Key takeaways
- Llama-3-8B fine-tune bests other models on future event prediction.
- Study used dataset of past events to test forecasting abilities.
- GLM-5.2 and Mistral-7B also evaluated.
research336d ago
Back to The Future: Evaluating AI Agents on Predicting Future Events
Researchers from Hugging Face and the University of Edinburgh evaluated AI agents on their ability to predict future events. The study used a dataset of past events and asked models to forecast what would happen next. The best-performing model was a fine-tuned version of Llama-3-8B, which outperformed other models like GLM-5.2 and Mistral-7B.
Key takeaways
- Llama-3-8B fine-tune bests other models on future event prediction.
- Study used dataset of past events to test forecasting abilities.
- GLM-5.2 and Mistral-7B also evaluated.