run LLM locally
run LLM locally Articles
Browse 3 articles about run LLM locally.
Best GPU for Local LLMs: Fitting 30B Models in 16GB or 24GB VRAM
A practical guide to running 30B local AI models on 16GB and 24GB GPUs, comparing RTX 3090, dual 5060 Ti, AMD and Intel cards.
run LLM locally24GB VRAM GPURTX 3090 local AI
NeoHorse-1-4B: How to Run This Self-Improving 4B Model Locally
NeoHorse-1-4B trains on router decision logs to improve itself. Here's how to install and run this 4B open model locally with vLLM.
NeoHorse 4Brun LLM locallyvLLM local install
What Is Unsloth? Local LLM Fine-Tuning and Inference Explained
Unsloth is a free, open-source tool for fine-tuning and running open LLMs locally with a point-and-click, ChatGPT-like agent UI.
Unslothlocal LLM fine-tuningopen source AI training