Artificial Intelligence

Page 43 of 53 · 1,564 retained trends

1262Artificial IntelligenceGlobalScore 26

I've tested some local LLMs on prosumer hardware, here are some findings

A Hacker News discussion about I've tested some local LLMs on prosumer hardware, here are some findings. The submitted context says: I have been benchmarking local LLMs on a Mac M4 Pro 24 GB RAM using LM Studio. I've tested mostly with 4-bit quantization, both MLX and GGUF, from 4b to 35b models, with speeds of…

Hacker NewsSingle-source evidence
Read the full article