From Teknologisk videncenter

Revision as of 06:06, 11 May 2009 by Heth (talk | contribs) (New page: Robots.txt is a file you can put in the root folder of your homepage. In this file you can tell WEB robots (crawlers) like Goggle bot which folders or homepages you done want indexed. ro...)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Jump to: navigation, search

Robots.txt is a file you can put in the root folder of your homepage. In this file you can tell WEB robots (crawlers) like Goggle bot which folders or homepages you done want indexed.

robots.txt on mars.tekkom.dk

User-agent: *
Disallow: /cisco/
Disallow: /sw/
Disallow: /TCExam/
Disallow: /fs/

Links

Retrieved from "http://mars.merhot.dk/w/index.php?title=Robots.txt&oldid=5613"