pull down to refresh

120B param model runs awesome on just 8GB VRAMold.reddit.com/r/LocalLLaMA/comments/1mke7ef/120b_runs_awesome_on_just_8gb_vram/
121 sats \ 0 comments \ @carter 11 Aug 2025 AI
related
No More Floating Points, The Era of 1.58-bit Large Language Modelsmedium.com/ai-insights-cobet/no-more-floating-points-the-era-of-1-58-bit-large-language-models-b9805879ac0a
100 sats \ 1 comment \ @0xbitcoiner 11 Mar 2024 science freebie
New Nvidia AI chips overheating in servers, the Information reportsfinance.yahoo.com/news/nvidia-ai-chips-face-issue-141200900.html
12 sats \ 0 comments \ @ch0k1 17 Nov 2024 news
The AMD Radeon Instinct MI300A's Giant Memory Subsystemchipsandcheese.com/p/inside-the-amd-radeon-instinct-mi300as
13 sats \ 0 comments \ @hn 18 Jan 2025 tech
Running Stable Diffusion XL 1.0 in 298MB of RAMgithub.com/vitoplantamura/OnnxStream/tree/846da873570a737b49154e8f835704264864b0fe
10 sats \ 1 comment \ @hn 3 Oct 2023 tech
Alibaba Qwen-32B - open source ~o1/R1 reasoning that can run on your laptop
198 sats \ 6 comments \ @gmd 6 Mar 2025 AI
Underclocking Bitmain’s S19J Pro to see what it is capable of 🧵nitter.at/CathedraBitcoin/status/1624086205485707264
142 sats \ 3 comments \ @BTCMiner 10 Feb 2023 bitcoin
Gemma3 – The current strongest model that fits on a single GPUollama.com/library/gemma3
46 sats \ 0 comments \ @hn 12 Mar 2025 tech
My Bitaxe Gamma 601 Swarm So Far
391 sats \ 14 comments \ @metadavid 10 May 2025 bitcoin_Mining
What is your hardware setup (and why)?
1190 sats \ 9 comments \ @zuspotirko 15 Jun 2023 tech
Local LLMs are how nerds now justify a big computer they don't needworld.hey.com/dhh/local-llms-are-how-nerds-now-justify-a-big-computer-they-don-t-need-af2fcb7b
648 sats \ 9 comments \ @k00b 25 Nov 2025 AI
NVIDIA "Project DIGITS" new era of Personal Computer
260 sats \ 1 comment \ @zuspotirko 7 Jan 2025 tech
Nvidia DGX Spark: When Benchmark Numbers Meet Production Realitypublish.obsidian.md/aixplore/Practical+Applications/dgx-lab-benchmarks-vs-reality-day-4
21 sats \ 0 comments \ @hn 26 Oct 2025 tech
Mistral has released two open-source models for codingmistral.ai/news/devstral-2-vibe-cli
522 sats \ 0 comments \ @lunin 10 Dec 2025 AI
Meet PowerInfer: A Fast LLM on a Single Consumer-Grade GPUwww.marktechpost.com/2023/12/23/meet-powerinfer-a-fast-large-language-model-llm-on-a-single-consumer-grade-gpu-that-speeds-up-machine-learning-model-inference-by-11-times/
10 sats \ 2 comments \ @ch0k1 24 Dec 2023 AI
Making The Smallest And Dumbest LLM With Extreme Quantizationhackaday.com/2025/10/23/making-the-smallest-and-dumbest-llm-with-extreme-quantization/
200 sats \ 0 comments \ @0xbitcoiner 24 Oct 2025 AI
M3 Ultra Mac Studio Review. 512GB of RAM?!www.youtube.com/watch?v=J4qwuCXyAcU&ab_channel=Dave2D
121 sats \ 1 comment \ @zuspotirko 11 Mar 2025 tech
Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUswww.baseten.co/blog/sota-performance-for-gpt-oss-120b-on-nvidia-gpus/
121 sats \ 0 comments \ @hn 7 Aug 2025 tech
The bitaxe v2.2 Open Source Miner produces ~400GH/s at only 12.5Wnitter.it/skot9000/status/1636949041421459457
304 sats \ 4 comments \ @phantom 25 Mar 2023 bitcoin freebie
AMD debuts Radeon Pro GPU for AI workloads — Radeon Pro W7900 Dual Slotwww.tomshardware.com/pc-components/gpus/amd-debuts-radeon-pro-gpu-for-ai-workloads-radeon-pro-w7900-dual-slot-brings-6144-shaders-and-48gb-ecc-gddr6-for-dollar3499
21 sats \ 0 comments \ @zuspotirko 6 Jun 2024 tech
Hybrid AMD Graphics and VM with GPU Passthrough - Can actually run faster!
120 sats \ 0 comments \ @l0k18 20 Jun 2023 tech
Apple’s M4 Max Is The First Non-Ultra Chipset Witt 500GB/s Memory Bandwidthwccftech.com/m4-max-first-non-ultra-apple-silicon-to-exceed-500gb-s-memory-bandwidth/
20 sats \ 0 comments \ @ch0k1 1 Nov 2024 news