diff options
| author | Fuwn <[email protected]> | 2024-10-08 21:30:02 -0700 |
|---|---|---|
| committer | Fuwn <[email protected]> | 2024-10-08 21:30:02 -0700 |
| commit | 3fcd2c61bfab59db5dc8cd42aacfc2ba9818be8a (patch) | |
| tree | b87f0e2c06135f7b5de9b72f0811f2c80f00faec /content/meta | |
| parent | format(flake): move overlays into nixpkgs (diff) | |
| download | locus-3fcd2c61bfab59db5dc8cd42aacfc2ba9818be8a.tar.xz locus-3fcd2c61bfab59db5dc8cd42aacfc2ba9818be8a.zip | |
feat(robots.txt): disallow archive.org
Diffstat (limited to 'content/meta')
| -rw-r--r-- | content/meta/robots.txt | 5 |
1 files changed, 4 insertions, 1 deletions
diff --git a/content/meta/robots.txt b/content/meta/robots.txt index a1b4bdf..5be4278 100644 --- a/content/meta/robots.txt +++ b/content/meta/robots.txt @@ -29,4 +29,7 @@ Disallow: /proxy User-agent: DataForSeoBot Disallow: /x -Disallow: /proxy
\ No newline at end of file +Disallow: /proxy + +User-agent: ia_archiver +Disallow: |