pull down to refresh

What If We Remove Tokenization In LLMs?www.youtube.com/watch?v=G7ryb91BDG8
143 sats \ 0 comments \ @carter 2 Jul 2025 AI
related
TOON (Token-Oriented Object Notation) — The Smarter, Lighter JSON for LLMsdev.to/abhilaksharora/toon-token-oriented-object-notation-the-smarter-lighter-json-for-llms-2f05
192 sats \ 2 comments \ @0xbitcoiner 17 Nov 2025 AI
If you think LLMs produce overly defensive code, you're not alone
100 sats \ 0 comments \ @tonyaldon 21 Dec 2025 devs
Attack vector using LLM’s against software developers
21 sats \ 0 comments \ @9 8 Jan 2024 security freebie
Context Rot: How Increasing Input Tokens Impacts LLM Performanceresearch.trychroma.com/context-rot
304 sats \ 2 comments \ @Scoresby 14 Jul 2025 AI
Could any form of “tokenization” make sense?
192 sats \ 5 comments \ @m0wer 30 May 2025 AskSN
The Bitter Lesson is coming for Tokenizationlucalp.dev/bitter-lesson-tokenization-and-blt/
110 sats \ 0 comments \ @carter 25 Jun 2025 AI
Show HN: Wordllama – Things you can do with the token embeddings of an LLMgithub.com/dleemiller/WordLlama
131 sats \ 0 comments \ @hn 15 Sep 2024 tech
the tokenization nonsense is going too far
57 sats \ 1 comment \ @bitcoinerRealista 5 Sep 2023 bitcoin
Lessons learned from programming with LLMscrawshaw.io/blog/programming-with-llms
120 sats \ 1 comment \ @m0wer 5 Jul 2025 AI
Should you use "you" in your LLM prompts?x.com/BrianRoemmele/status/1998068828295877011
786 sats \ 10 comments \ @Scoresby 9 Dec 2025 AI
LLMs in Programmingwww.thecodedmessage.com/posts/llm-in-programming
167 sats \ 0 comments \ @kehiy 11 Aug 2025 AI
Learning the Wrong Lessons: Syntactic-Domain Spurious Correlations in LLMsarxiv.org/abs/2509.21155
415 sats \ 6 comments \ @optimism 2 Dec 2025 AI
Things we learned about LLMs in 2024simonwillison.net/2024/Dec/31/llms-in-2024/
370 sats \ 0 comments \ @Rsync25 31 Dec 2024 tech
Apertus: Democratizing Open and Compliant LLMs for Global Language Environmentsarxiv.org/abs/2509.14233
294 sats \ 1 comment \ @optimism 21 Sep 2025 AI
LRC-20 - a new approach to tokenization on Lightningx.com/akitamiabtc/status/1780253181425205586
38.9k sats \ 33 comments \ @anon 16 Apr 2024 lightning
LLMs generate slop because they avoid surprises by design - Dan Fabulichdanfabulich.medium.com/llms-tell-bad-jokes-because-they-avoid-surprises-7f111aac4f96
343 sats \ 2 comments \ @Scoresby 19 Aug 2025 AI
LLMs don’t do formal reasoning - and that is a HUGE problemgarymarcus.substack.com/p/llms-dont-do-formal-reasoning-and
200 sats \ 0 comments \ @Rsync25 11 Oct 2024 tech
LLMs aren’t world modelsyosefk.com/blog/llms-arent-world-models.html
121 sats \ 0 comments \ @carter 13 Aug 2025 AI
Sampling and structured outputs in LLMsparthsareen.com/blog.html#sampling.md
157 sats \ 0 comments \ @carter 23 Sep 2025 AI
LLMs are getting better at character-level text manipulationblog.burkert.me/posts/llm_evolution_character_manipulation/
157 sats \ 0 comments \ @carter 14 Oct 2025 AI
What instruction do you use to tell LLMs to be concise?
110 sats \ 4 comments \ @tonyaldon 11 Dec 2025 AI