@anon
sign up
@anon
sign up
pull down to refresh
Perplexity is using stealth, undeclared crawlers to evade website no-crawl direc
blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/
177 sats
\
2 comments
\
@0xbitcoiner
4 Aug
AI
related
What kind of bot would you like to see on SN?
1116 sats
\
28 comments
\
@south_korea_ln
17 May 2024
meta
The three types of AI bot traffic and how to handle them - Vercel
vercel.com/blog/the-three-types-of-ai-bot-traffic-and-how-to-handle-them
324 sats
\
2 comments
\
@Scoresby
15 Aug
AI
shreddit: Delete your Reddit data
github.com/andrewbanchich/shreddit
1296 sats
\
27 comments
\
@kepford
23 Apr 2024
meta
A deeper look at AI crawlers: breaking down traffic by purpose and industry
blog.cloudflare.com/ai-crawler-traffic-by-purpose-and-industry/
100 sats
\
0 comments
\
@jakoyoh629
29 Aug
AI
f banks
749 sats
\
7 comments
\
@cryotosensei
5 May
econ
What makes a Stacker?
2218 sats
\
87 comments
\
@Undisciplined
12 Jul
AskSN
The Fox
200 sats
\
0 comments
\
@bitcoingraffiti
18 Oct 2024
art
Perplexity, Not Google, Is Now The Best Search Engine
www.theregister.com/2024/12/16/opinion_column_perplexity_vs_google/
52 sats
\
3 comments
\
@0xbitcoiner
19 Dec 2024
alter_native
Perplexity AI Rolls Out Comet Browser for Free Worldwide... Anyone Tried it???
www.cnbc.com/2025/10/02/perplexity-ai-comet-browser-free-.html
239 sats
\
1 comment
\
@Cje95
16h
AI
Just fucking use HTML
justfuckingusehtml.com/
2674 sats
\
32 comments
\
@k00b
14 May
devs
The Open-Source Solution Replicating Billion Dollar Perplexity 4 AI Search Tools
www.marktechpost.com/2024/06/09/perplexica-the-open-source-solution-replicating-billion-dollar-perplexity-for-ai-search-tools/
21 sats
\
0 comments
\
@ch0k1
11 Jun 2024
news
Will AI Platforms Pay Creators?
1683 sats
\
21 comments
\
@kr
29 Jan 2024
tech
Crawling a billion web pages in just over 24 hours, in 2025
andrewkchan.dev/posts/crawler.html
85 sats
\
1 comment
\
@Scoresby
17 Jul
tech
Reddit blocks Internet Archive to end sneaky AI scraping
www.theverge.com/news/757538/reddit-internet-archive-wayback-machine-block-limit
359 sats
\
7 comments
\
@Coinsreporter
12 Aug
news
[SN Feature Request] Follow feature
358 sats
\
16 comments
\
@jerry
16 Jul 2022
bitcoin
The base layer is cheap and quiet...
1423 sats
\
12 comments
\
@catdaddysoprano
1 Feb
AskSN
Perplexity (hopes to) join US government discount AI fest
www.theregister.com/2025/09/08/perplexity_us_govt_ai_discount/
132 sats
\
0 comments
\
@0xbitcoiner
8 Sep
AI
Measuring minrelaytxfee across the Bitcoin network
delvingbitcoin.org/t/measuring-minrelaytxfee-across-the-bitcoin-network/1989
1627 sats
\
8 comments
\
@0xbitcoiner
18 Sep
bitcoin
How do Search Engines Work?
521 sats
\
2 comments
\
@Azik
11 Apr 2024
devs
Six OFAC-sanctioned transactions missing
b10c.me/observations/08-missing-sanctioned-transactions/
35.1k sats
\
26 comments
\
@0xB10C
21 Nov 2023
bitcoin
The Penal Preserve, Chapter 23
1335 sats
\
1 comment
\
@cleophas
18 Aug 2024
BooksAndArticles
more