I've been using this for a while now, and for the price, I believe the Mac Mini M4 Pro makes a fantastic LLM server.
Add some memory, equip it with the 14-core CPU, 20-core GPU, and 16-core Neural Engine, load up LM Studio, and you're good to go!
It is super quiet and very power-efficient.
The perfect small office LLM Server ? Maybe for now.
No comments:
Post a Comment