Page MenuHomeFreeBSD

D52550.1789784148.diff
No OneTemporary

Size
599 B
Referenced Files
None
Subscribers
None

D52550.1789784148.diff

diff --git a/www/py-robot-detection/pkg-message b/www/py-robot-detection/pkg-message
new file mode 100644
--- /dev/null
+++ b/www/py-robot-detection/pkg-message
@@ -0,0 +1,8 @@
+You can download a new version of the Robot Database from http://www.robotstxt.org/dbexport.html.
+
+Download the database dump, and run the file robot_detection.py with the file as first argument.
+
+ $ fetch http://www.robotstxt.org/db/all.txt
+ $ python robot_detection.py all.txt
+
+If the database has changed, it'll print out the new version of robot_useragents variable that you need to put into the source code.

File Metadata

Mime Type
text/plain
Expires
Sat, Sep 19, 2:15 AM (7 h, 47 m)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
29768401
Default Alt Text
D52550.1789784148.diff (599 B)

Event Timeline