4 Commits

Author	SHA1	Message	Date
Timur Ismagilov	cfc985a0f0	Disallow: /admin/ too	2021-10-01 09:51:06 +03:00
Umar Getagazov	1101784230	Replace Disallow: / with a more specific list	2021-09-29 22:20:30 +07:00
Timur Ismagilov	153430194b	Allow crawling /help/	2021-07-31 19:33:15 +05:00
handlerug	190a1d6ba8	Extract robots.txt into a file, simplify MIMEs	2021-06-23 22:44:27 +07:00