WebsiteShowBot

WebsiteShowBot is the crawler of website.show, a directory of software products. It identifies itself as Mozilla/5.0 (compatible; WebsiteShowBot/0.1; +https://www.website.show/bot).

Only sites that someone has entered into our submit form or that are listed in the directory. It does not follow links or crawl the web.

• The homepage and up to five icon files, when someone enters the site’s address in the submit form.
• The homepage, when someone asks for an AI draft or submits the listing.
• The homepage, when someone checks the badge: from the submit form, from the listing’s management page, or a moderator.
• The homepage once a day, while the listing uses our badge.
• The homepage once a week, while the listing has a dofollow link.
• The homepage, /robots.txt, /llms.txt and /sitemap.xml for the site check shown on the listing page: when the listing is published, then once a week, and when its owner asks for a new check, at most three times an hour.

It never requests pages behind a login. Requests started from the submit form are limited to 20 an hour to any one site, however many people make them.

The daily and weekly checks stop when the listing is removed. To have it removed, email hello@website.show from an address on your domain. We remove the listing within 72 hours and, if you ask, block the domain from being submitted again. You can also block the user agent above at your server.