Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | ui-tree,ui-blame: bail from blame if blob is binary | June McEnroe | 2023-07-21 | 1 | -0/+1 |
| | | | | | | | This avoids piping binary blobs through the source-filter. Also prevent robots from crawling it, since it's expensive. Signed-off-by: Jason A. Donenfeld <[email protected]> | ||||
* | robots.txt: disallow access to snapshots | Jason A. Donenfeld | 2013-08-12 | 1 | -0/+3 |
My dmesg is filled with the oom killer bringing down processes while the Bingbot downloads every snapshot for every commit of the Linux kernel in tar.xz format. Sure, I should be running with memory limits, and now I'm using cgroups, but a more general solution is to prevent crawlers from wasting resources like that in the first place. Suggested-by: Natanael Copa <[email protected]> Suggested-by: Julius Plenz <[email protected]> Signed-off-by: Jason A. Donenfeld <[email protected]> |