6 Commits

Author	SHA1	Message	Date
Timur Ismagilov	2a1e6409c8	robots.txt: Allow /list, disallow /orphans	2022-05-07 02:00:40 +05:00
Timur Ismagilov	303ad8380f	Update robots.txt	2022-02-26 16:27:20 +03:00
Timur Ismagilov	cfc985a0f0	Disallow: /admin/ too	2021-10-01 09:51:06 +03:00
Umar Getagazov	1101784230	Replace Disallow: / with a more specific list	2021-09-29 22:20:30 +07:00
Timur Ismagilov	153430194b	Allow crawling /help/	2021-07-31 19:33:15 +05:00
handlerug	190a1d6ba8	Extract robots.txt into a file, simplify MIMEs	2021-06-23 22:44:27 +07:00