related posts
10 sats \ 0 replies \ @Zepasta 16 Aug 2023
I'm getting around 5 token/sec with i7 + 16GB RAM + RTX 2000 using LLaMa 7B.
It's not fast enough for me to consider it usable.
reply
0 sats \ 0 replies \ @hn OP 15 Aug 2023
This link was posted by birriel 41 minutes ago on HN. It received 64 points and 6 comments.
reply