mirror of
https://codeberg.org/streams/streams.git
synced 2024-09-22 05:35:15 +00:00
9 lines
123 B
Text
9 lines
123 B
Text
---
|
|
---
|
|
|
|
# www.robotstxt.org/
|
|
|
|
# Allow crawling of all content
|
|
User-agent: *
|
|
Disallow:
|
|
Sitemap: {{ site.url }}/sitemap.xml
|