====== AI Modelling ====== ====== Running workloads on a GTX 1060 6GB: ====== https://www.virtualizationhowto.com/2025/05/still-worth-it-running-ai-workloads-on-a-gtx-1060-in-2025/ ===== CPU centric models ===== https://www.kolosal.ai/blog-detail/top-5-best-llm-models-to-run-locally-in-cpu-2025-edition https://github.com/oobabooga/text-generation-webui/wiki/Low-VRAM-guide/4020468610860ce390d75d642bcbd07db07d6e80 ====== Hordfed AI===== https://stablehorde.net/ ===== Platforms / UI ===== Installs SillyTavern and text-generation-webui https://spacebums.co.uk/sillytavern/ ===== Running Engine===== http://192.168.2.134:5000 ws 192.168.2.134:7860 =====llm sources===== https://huggingface.co/ =====Suggested Models===== https://huggingface.co/Qwen/Qwen2.5-7B-Instruct