| 1 | # See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file |
| 2 | User-agent: * |
| 3 | Allow: / |
| 4 | |
| 5 | # Private and transactional areas — no SEO value, keep them out of the index. |
| 6 | Disallow: /auth |
| 7 | Disallow: /settings |
| 8 | Disallow: /billing |
| 9 | Disallow: /new |
| 10 | Disallow: /api/ |
| 11 | |
| 12 | # Raw file endpoints serve bytes, not pages. |
| 13 | Disallow: /*/raw/ |
| 14 | |
| 15 | Sitemap: https://sigit.si/sitemap.xml |