pull down to refresh

Perplexity is using stealth, undeclared crawlers to evade website no-crawl direcblog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/
207 sats \ 2 comments \ @0xbitcoiner 4 Aug 2025 AI
related
DuckDuckGo now lets you hide AI-generated images in search results | TechCrunchtechcrunch.com/2025/07/18/duckduckgo-now-lets-you-hide-ai-generated-images-in-search-results/?ref=thediff.co
359 sats \ 11 comments \ @Scoresby 21 Jul 2025 AI
Introducing Pay per crawl - Content owners can charge AI crawlers for accessblog.cloudflare.com/introducing-pay-per-crawl/
206 sats \ 3 comments \ @carter 1 Jul 2025 devs
Block all AI browsers for the foreseeable futurewww.theregister.com/2025/12/08/gartner_recommends_ai_browser_ban/
233 sats \ 0 comments \ @0xbitcoiner 8 Dec 2025 AI
Pay-per-output? AI firms blindsided by beefed up robots.txt instructions.arstechnica.com/tech-policy/2025/09/pay-per-output-ai-firms-blindsided-by-beefed-up-robots-txt-instructions/
259 sats \ 2 comments \ @0xbitcoiner 10 Sep 2025 AI
Publishers say no to AI scrapers, block bots at server levelwww.theregister.com/2025/12/08/publishers_say_no_ai_scrapers/
407 sats \ 3 comments \ @0xbitcoiner 9 Dec 2025 AI
Reddit blocks Internet Archive to end sneaky AI scrapingwww.theverge.com/news/757538/reddit-internet-archive-wayback-machine-block-limit
384 sats \ 7 comments \ @Coinsreporter 12 Aug 2025 news
VPN Chrome Browser Extension Caught Intercepting Millions of Users' AI Chatsthehackernews.com/2025/12/featured-chrome-browser-extension.html
130 sats \ 0 comments \ @winteryeti 15 Dec 2025 tech
AI’s ‘original sin’: how it eats a world of datawww.thetimes.com/uk/technology-uk/article/ai-language-learning-model-creative-industries-data-m8sbfsz7w
392 sats \ 1 comment \ @k00b 28 Feb 2025 AI
OpenAI's AI Browser Atlas Suffers Same Crit. Flaw As Perplexity’s Comet & Fellouneuraltrust.ai/blog/openai-atlas-omnibox-prompt-injection
187 sats \ 0 comments \ @Cje95 28 Oct 2025 AI
Search-capable AI agents may cheat on benchmark testswww.theregister.com/2025/08/23/searchcapable_ai_agents_may_cheat
267 sats \ 2 comments \ @Coinsreporter 23 Aug 2025 AI
Proof of Humanity: Certifying Human-Originated Content in an AI Internetarxiv.org/abs/2504.03752
212 sats \ 10 comments \ @0xbitcoiner 13 Oct 2025 AI
The week in AI, August 4-10, 2025
2353 sats \ 12 comments \ @optimism 11 Aug 2025 AI
Perplexity’s Origin Story: Scraping Twitter With Fake Academic Accountswww.404media.co/perplexitys-origin-story-scraping-twitter-with-fake-academic-accounts/
142 sats \ 2 comments \ @Rsync25 27 Jun 2024 news
Crawling a billion web pages in just over 24 hours, in 2025andrewkchan.dev/posts/crawler.html
115 sats \ 1 comment \ @Scoresby 17 Jul 2025 tech
Researchers Secretly Ran Massive Unauthorized AI Persuasion Experiment on Redditarchive.is/UdVpX
407 sats \ 1 comment \ @StillStackinAfterAllTheseYears 28 Apr 2025 tech
Deep Research on the identity of Satoshi Nakamoto
107 sats \ 3 comments \ @gmd 27 Feb 2025 AI
Scamlexity: When Agentic AI Browsers Get Scammedguard.io/labs/scamlexity-we-put-agentic-ai-browsers-to-the-test-they-clicked-they-paid-they-failed
733 sats \ 6 comments \ @optimism 23 Aug 2025 AI
Perplexity is building a browser to track everything users do online to sell adstechcrunch.com/2025/04/24/perplexity-ceo-says-its-browser-will-track-everything-users-do-online-to-sell-hyper-personalized-ads/
127 sats \ 5 comments \ @k00b 26 Apr 2025 AI
How Perplexity optimized 1T parameter AI models for AWS EFAwww.theregister.com/2025/11/05/perplexity_1t_parameter_models_aws_efa/
130 sats \ 0 comments \ @0xbitcoiner 6 Nov 2025 AI
AI Bot Traffic to Sites Is Rising Rapidly and Could Change the Nature of the Webwww.inc.com/chris-morris/ai-bot-traffic-to-websites-is-rising-rapidly-it-could-change-the-nature-of-the-web/91298801
153 sats \ 0 comments \ @co574 14 Feb tech
Perplexity (hopes to) join US government discount AI festwww.theregister.com/2025/09/08/perplexity_us_govt_ai_discount/
162 sats \ 0 comments \ @0xbitcoiner 8 Sep 2025 AI