pull down to refresh

120B param model runs awesome on just 8GB VRAMold.reddit.com/r/LocalLLaMA/comments/1mke7ef/120b_runs_awesome_on_just_8gb_vram/
151 sats \ 0 comments \ @carter 11 Aug 2025 AI
related
VRAM sizes are disappointing in 2025
405 sats \ 5 comments \ @zuspotirko 10 Feb 2025 tech
Making The Smallest And Dumbest LLM With Extreme Quantizationhackaday.com/2025/10/23/making-the-smallest-and-dumbest-llm-with-extreme-quantization/
230 sats \ 0 comments \ @0xbitcoiner 24 Oct 2025 AI
Best small and open instruct models?
607 sats \ 27 comments \ @k00b 28 Jan AI AskSN devs
Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUswww.baseten.co/blog/sota-performance-for-gpt-oss-120b-on-nvidia-gpus/
151 sats \ 0 comments \ @hn 7 Aug 2025 tech
16GB Raspberry Pi 5 On Sale Now At $120www.raspberrypi.com/news/16gb-raspberry-pi-5-on-sale-now-at-120/
125 sats \ 2 comments \ @0xbitcoiner 9 Jan 2025 freedomtech
What if... someone optimized a model for taking action
1915 sats \ 1 comment \ @optimism 3 Jul 2025 AI
Does anyone run a `bitcoind` with increased `mempoolexpiry` params?
2466 sats \ 7 comments \ @hynek 23 May 2023 bitcoin
Jan v3 4B: great in instruction followinghuggingface.co/janhq/Jan-v3-4B-base-instruct
519 sats \ 0 comments \ @optimism 2 Feb AI
Alibaba Qwen-32B - open source ~o1/R1 reasoning that can run on your laptop
208 sats \ 6 comments \ @gmd 6 Mar 2025 AI
Local LLMs are how nerds now justify a big computer they don't needworld.hey.com/dhh/local-llms-are-how-nerds-now-justify-a-big-computer-they-don-t-need-af2fcb7b
948 sats \ 9 comments \ @k00b 25 Nov 2025 AI
MCP-Bench: Benchmarking Tool-Using LLM Agentsarxiv.org/abs/2508.20453
269 sats \ 0 comments \ @optimism 30 Aug 2025 AI
Mistral has released two open-source models for codingmistral.ai/news/devstral-2-vibe-cli
552 sats \ 0 comments \ @lunin 10 Dec 2025 AI
Incentives and coordination to solve hard problems
3325 sats \ 21 comments \ @elvismercury 9 Mar 2024 mostly_harmless
Braiins OS+ on S9 miner - "Do not use cards with capacity greater than 8 GB."
446 sats \ 4 comments \ @Wumbo 14 Mar 2024 bitcoin
Less is More: Recursive Reasoning with Tiny Networksarxiv.org/html/2510.04871v1
65 sats \ 1 comment \ @byzantine 9 Oct 2025 AI
Scalable MatMul-Free Language Modeling — 10x Reduction On LLMs Computationarxiv.org/abs/2406.02528
110 sats \ 1 comment \ @0xbitcoiner 10 Jun 2024 science freebie
Evaporative cooling and social softwareweb.archive.org/web/20101014093452/http://blog.bumblebeelabs.com/tag/social-software-sunday
3159 sats \ 0 comments \ @elvismercury 5 Nov 2023 meta
Microsoft developed a hyper-efficient AI model that can run on CPUstechcrunch.com/2025/04/16/microsoft-researchers-say-theyve-developed-a-hyper-efficient-ai-model-that-can-run-on-cpus/
179 sats \ 0 comments \ @co574 17 Apr 2025 AI
DeepSeek’s $6 million AI model just blew a $1 trillion hole in the market.sherwood.news/tech/deepseek-china-ai-model-stock-market-explainer-gpus-openai/
255 sats \ 7 comments \ @NovaRift 27 Jan 2025 Stacker_Stocks
My Bitaxe Gamma 601 Swarm So Far
412 sats \ 14 comments \ @metadavid 10 May 2025 bitcoin_Mining
The Best Way of Running GPT-OSS Locally - KDnuggetswww.kdnuggets.com/the-best-way-of-running-gpt-oss-locally
148 sats \ 0 comments \ @optimism 25 Aug 2025 AI