ai_models

Table of Contents

AI Modelling
Running workloads on a GTX 1060 6GB:
- CPU centric models
Hordfed AI

AI Modelling

Running workloads on a GTX 1060 6GB:

https://www.virtualizationhowto.com/2025/05/still-worth-it-running-ai-workloads-on-a-gtx-1060-in-2025/

CPU centric models

https://www.kolosal.ai/blog-detail/top-5-best-llm-models-to-run-locally-in-cpu-2025-edition

https://github.com/oobabooga/text-generation-webui/wiki/Low-VRAM-guide/4020468610860ce390d75d642bcbd07db07d6e80

Hordfed AI

https://stablehorde.net/

Platforms / UI

Installs SillyTavern and text-generation-webui https://spacebums.co.uk/sillytavern/

Running Engine

http://192.168.2.134:5000 ws 192.168.2.134:7860

llm sources

https://huggingface.co/

Suggested Models

https://huggingface.co/Qwen/Qwen2.5-7B-Instruct

ai_models.txt · Last modified: 2026/01/24 18:26 by ashley