NVFP4 quantization
NVFP4 quantization Articles
Browse 4 articles about NVFP4 quantization.
Edge0-145B Benchmarks: Terminal-Bench, GPQA, HLE, and IFBench Explained
Edge0-145B's NVFP4 build hits 86.5 on Terminal-Bench 2.1. Here's how it stacks up on GPQA-Diamond, HLE, and IFBench, and the NVFP4 vs Q3_K tradeoff.
Edge0-145B benchmarksTerminal-Bench 2.1 scoreEdge0 GPQA Diamond
Edge0-145B: How a 145B-Parameter Model Fits on One RTX 5090
Edge0-145B packs 145 billion parameters into 24GB VRAM using native 4-bit quantization and a sparse MoE design. Here's how it works.
Edge0-145BEdge0 NVFP4145B model consumer GPU
How to Run Qwen 3 27B Locally with DeepSeek Harness
Set up Qwen 3 27B on your own hardware with DeepSeek Harness. Covers quantization, MLX vs VLM, reasoning effort, and vision capabilities.
run Qwen locallyQwen 27B Ollama MLXDeepSeek Harness setup
How to Run Nemotron 3.5 Lightning Locally on Your Own GPU
A practical guide to running and fine-tuning NVIDIA's Nemotron 3.5 Lightning MoE model locally, covering hardware needs, NVFP4, and Unsloth.
run Nemotron locallyNVFP4 quantizationDGX Spark