pull down to refresh

Crawling a billion web pages in just over 24 hours, in 2025andrewkchan.dev/posts/crawler.html
85 sats \ 1 comment \ @Scoresby 17 Jul tech
related
Starlink - the end of the free internet? Or a new birth?
22.1k sats \ 55 comments \ @davidw 18 Oct 2023 tech
Cryptographers Are Getting Closer to Enabling Fully Private Internet Searcheswww.wired.com/story/cryptographers-fully-private-internet-searches-cybersecurity-databases-privacy/
2587 sats \ 5 comments \ @jakoyoh629 21 Jan 2024 crypto
Blastr: A nostr cloudflare worker proxy relay that publishes to all known relaysgithub.com/MutinyWallet/blastr
37.1k sats \ 29 comments \ @TonyGiorgio 18 Feb 2023 nostr
Building a new Web Search Engine. Just for you, Stackers!
4376 sats \ 47 comments \ @brugeman 5 Dec 2022 bitcoin
They Are Scrubbing the Internet Right Nowopen.substack.com/pub/quoththeraven/p/they-are-scrubbing-the-internet-right?r=9bii2&utm_campaign=post&utm_medium=email
1345 sats \ 14 comments \ @siggy47 1 Nov 2024 news
Google just updated its algorithm. The Internet will never be the samewww.bbc.com/future/article/20240524-how-googles-new-algorithm-will-shape-your-internet
458 sats \ 13 comments \ @ch0k1 25 May 2024 news
Cloudflare 1.1.1.1 incident on June 27, 2024blog.cloudflare.com/cloudflare-1111-incident-on-june-27-2024
392 sats \ 1 comment \ @Rsync25 5 Jul 2024 security
Reddit blocks Internet Archive to end sneaky AI scrapingwww.theverge.com/news/757538/reddit-internet-archive-wayback-machine-block-limit
359 sats \ 7 comments \ @Coinsreporter 12 Aug news
Imagine a Land Where Algorithms Don't Ruin The Internet 🤔www.theregister.com/2024/11/25/china_algorithm_transparency/
336 sats \ 5 comments \ @0xbitcoiner 26 Nov 2024 security
Perplexity is using stealth, undeclared crawlers to evade website no-crawl direcblog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/
177 sats \ 2 comments \ @0xbitcoiner 4 Aug AI
L402: internet-native paywallsl402.org
3279 sats \ 10 comments \ @fewsats 1 Jul 2024 builders
Cloudflare Accused of Blocking Niche Browsers - Slashdottech.slashdot.org/story/25/03/15/236215/cloudflare-accused-of-blocking-niche-browsers
357 sats \ 3 comments \ @StillStackinAfterAllTheseYears 15 Mar security
The three types of AI bot traffic and how to handle them - Vercelvercel.com/blog/the-three-types-of-ai-bot-traffic-and-how-to-handle-them
324 sats \ 2 comments \ @Scoresby 15 Aug AI
Show HN: A web debugger an ex-Cloudflare team has been working on for 4 yearsnews.ycombinator.com/item?id=40318542
278 sats \ 1 comment \ @hn 10 May 2024 tech
The people who ruined the internetwww.theverge.com/features/23931789/seo-search-engine-optimization-experts-google-results
2039 sats \ 1 comment \ @0fje0 1 Nov 2023 tech
Web Browser telemetry - 2025 editionsizeof.cat/post/web-browser-telemetry-2025-edition/
430 sats \ 2 comments \ @k00b 21 Apr privacy
Defending the Internet: How Cloudflare blocked a monumental 7.3 Tbps DDoS attackblog.cloudflare.com/defending-the-internet-how-cloudflare-blocked-a-monumental-7-3-tbps-ddos/
222 sats \ 2 comments \ @jakoyoh629 20 Jun security
The strain on scientific publishingdirect.mit.edu/qss/article/5/4/823/124269/The-strain-on-scientific-publishing
2619 sats \ 17 comments \ @south_korea_ln 17 Jan science
How Parzzix Blog Works: Nostr, Caching, and Lightning-Fast Loadsparzzix.com/post.html?slug=how-parzzix-blog-works-nostr-caching-and-lightning-98c468fd1e829e817a287f92029cfa0195a3272ccef173efca19665c296d67b5
322 sats \ 1 comment \ @parzzix 9 Aug nostr
The Internet Archive’s Fight to Save Itselfwww.wired.com/story/internet-archive-memory-wayback-machine-lawsuits/
432 sats \ 1 comment \ @south_korea_ln 27 Sep 2024 BooksAndArticles
This Day on SN: December 26
335 sats \ 0 comments \ @sn 26 Dec 2024 meta bot