Latest Article
RTX 3060 12GB for Local AI: Which Models Run and How Fast
The RTX 3060 12GB runs 8B models easily and 12B to 14B models at Q4. Here are the VRAM numbers, expected speeds and where its 12 GB runs out.
The RTX 3060 12GB runs 8B models easily and 12B to 14B models at Q4. Here are the VRAM numbers, expected speeds and where its 12 GB runs out.
