Artificial Intelligence

Page 203 of 213 · 6,367 retained trends

6070Artificial IntelligenceGlobalScore 26

I've tested some local LLMs on prosumer hardware, here are some findings

A Hacker News discussion about I've tested some local LLMs on prosumer hardware, here are some findings. The submitted context says: I have been benchmarking local LLMs on a Mac M4 Pro 24 GB RAM using LM Studio. I've tested mostly with 4-bit quantization, both MLX and GGUF, from 4b to 35b models, with speeds of…

Hacker NewsSingle-source evidence
Read the full article