pull down to refresh

GET HTTP/1.098765432 robots.txt
0 sats \ 7 comments \ @adlai 9 Jan meta
related
Google wants to explore alternatives to robots.txtblog.google/technology/ai/ai-web-publisher-controls-sign-up/
10 sats \ 0 comments \ @shadowymartian 9 Jul 2023 tech
Reddit blocks Internet Archive to end sneaky AI scrapingwww.theverge.com/news/757538/reddit-internet-archive-wayback-machine-block-limit
359 sats \ 7 comments \ @Coinsreporter 12 Aug 2025 news
What creative ideas have you been rambling on?
417 sats \ 24 comments \ @deSign_r 2 Sep 2025 Design
Weirdest vending machine you ever saw
156 sats \ 4 comments \ @cryotosensei 24 Mar 2025 AskSN
Website Search Hurts My Feelingswww.openmymind.net/Your-Website-Search-Hurts-My-Feelings/
22 sats \ 1 comment \ @hn 26 Dec 2023 tech
The Internet Archive is under a DDoS attackmastodon.archive.org/@internetarchive/112513905401989149
213 sats \ 8 comments \ @beorange 27 May 2024 security
You can now use the 'Leta' search engine by Mullvad VPN for free
117 sats \ 0 comments \ @NovaRift 9 Mar 2025 tech
Onion link for Reddit
186 sats \ 0 comments \ @cointastical 25 Oct 2022 bitcoin
What creative ideas have you been rambling on?
426 sats \ 11 comments \ @deSign_r 30 Sep 2025 Design
Non-Google search engines blocked from showing recent Reddit resultsarstechnica.com/gadgets/2024/07/non-google-search-engines-blocked-from-showing-recent-reddit-results/
163 sats \ 1 comment \ @beorange 25 Jul 2024 tech
Learn how to OWN The Internet from the Roots Up! Proceed to perma.therootzone/perma.therootzone.hns.to/
26 sats \ 1 comment \ @InnerINetwork 1 Oct 2023 meta
Nostr Web Search Engine
27 sats \ 0 comments \ @Tjacten 24 Aug 2023 nostr
robotechy.com is now BITCOIN ONLYx.com/robotechyshop/status/1809590005003624557
188 sats \ 1 comment \ @Rsync25 6 Jul 2024 bitcoin
Google Chrome has a special hidden API accesible only from *.google.comtwitter.com/lcasdev/status/1810696257137959018
31 sats \ 0 comments \ @hn 9 Jul 2024 tech
New website for tracking robosats stats
3895 sats \ 39 comments \ @supertestnet 30 Jul 2024 bitcoin
Brave Browser blocked robosats today!
203 sats \ 12 comments \ @denationalized 19 Mar 2024 privacy
Reccomend tools and ways for scraping info from the internet
222 sats \ 1 comment \ @03c7134a6d 14 May 2024 tech
The HTTP status code for a web server's default “hello” front pageutcc.utoronto.ca/~cks/space/blog/web/WebServerDefaultNotThere
46 sats \ 1 comment \ @hn 9 Jul 2023 tech
Scraping Bitcoin Addresses with SpiderFoot CLI [Tutorial]www.youtube.com/watch?v=Z2zmvA-ieQc
20 sats \ 0 comments \ @random_ 24 Mar 2023 bitcoin
Anyone else getting 404 page when accessing Robosats?
21 sats \ 3 comments \ @Fiatrevelation 13 Feb 2025 bitcoin
Another simple online DNS query toolnstoolbox.com
19 sats \ 0 comments \ @nym 10 Nov 2024 devs