Skip to main content
Toggle navigation
Friendica
Search
2024-12-13 13:20:34
2024-12-12 00:31:54
2024-12-12 00:31:54
283764
Ben Weinstein-Raun
1 month ago
•
Ben Weinstein-Raun
1 month ago
•
Llama 3.3-70b is quite good; I think it's clearly the best local model I've tried. Not
quite
as good as GPT-4 on things I've tried so far, but I think better than GPT-3.5.
Languages
Search Text
Share via ...
Ben Millwood
likes this.
in reply to Ben Weinstein-Raun
[object Object]
in reply to Ben Weinstein-Raun
•
1 month ago
•
•
How much vram do you need to run it locally?
Languages
Search Text
Share via ...
Ben Millwood
likes this.
in reply to [object Object]
Ben Weinstein-Raun
in reply to [object Object]
•
1 month ago
•
I'm not sure; I have an MBP with 128GiB of unified memory, which is plenty.
Languages
Search Text
Share via ...
2 people
like this
Ben Millwood
likes this.
⇧
[object Object]
in reply to Ben Weinstein-Raun • • •Ben Millwood likes this.
Ben Weinstein-Raun
in reply to [object Object] • •like this
Ben Millwood likes this.