next message in archive
next message in thread
previous message in archive
Index of Subjects
This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. Send mail to mime@docserver.cac.washington.edu for more info. --1920162272-1333332435-856886524=:12656 Content-Type: TEXT/PLAIN; charset=US-ASCII I've cobbled up a distribution version of robots.txt based on info located at: http://info.webcrawler.com/mak/projects/robots/norobots.html contents of (attached) file follows.... #================ begin ========================= # # Robots.txt for CSuite distribution Beta 1.0 Version # Disallow:/Local # local documents Disallow:/csuite # webcrawlers should point to Chebucto for current version of these Disallow:/Policy # these document picked up under /Help Disallow:/Services # these document picked up under /Help Disallow:/adm # restricted processes Disallow:/donors # local Disallow:/recent # changes Disallow:/Copyright # webcrawlers should point to Chebucto for this Disallow:/Home.html~ # backup Disallow:/Home.tmpl # template Disallow:/Memopts.html # local document Disallow:/ips.html # rebuilt regularly Disallow:/jumps.html # changes ocassionally Disallow:/motd # changes #================= end ========================== --------------------------------------------------------------------- David Potter http://chebucto.ns.ca/CSuite/CSuite.html Documentation Team Chebucto Community Net ============== CSuite - Community Network Software ================== --1920162272-1333332435-856886524=:12656 Content-Type: TEXT/PLAIN; charset=US-ASCII; name="robots.txt" Content-Transfer-Encoding: BASE64 Content-ID: <Pine.SUN.3.91.970225120204.12656B@chebucto.ns.ca> Content-Description: Iw0KIyBSb2JvdHMudHh0IGZvciBDU3VpdGUgZGlzdHJpYnV0aW9uIEJldGEg MS4wIFZlcnNpb24gDQojDQpEaXNhbGxvdzovTG9jYWwJCSMgbG9jYWwgZG9j dW1lbnRzDQpEaXNhbGxvdzovY3N1aXRlCSMgd2ViY3Jhd2xlcnMgc2hvdWxk IHBvaW50IHRvIENoZWJ1Y3RvIGZvciBjdXJyZW50IHZlcnNpb24gb2YgdGhl c2UgDQpEaXNhbGxvdzovUG9saWN5CSMgdGhlc2UgZG9jdW1lbnQgcGlja2Vk IHVwdW5kZXIgL0hlbHANCkRpc2FsbG93Oi9TZXJ2aWNlcwkjIHRoZXNlIGRv Y3VtZW50IHBpY2tlZCB1cHVuZGVyIC9IZWxwDQpEaXNhbGxvdzovYWRtCQkj IHJlc3RyaWN0ZWQgcHJvY2Vzc2VzDQpEaXNhbGxvdzovZG9ub3JzCSMgbG9j YWwNCkRpc2FsbG93Oi9yZWNlbnQJIyBjaGFuZ2VzDQpEaXNhbGxvdzovQ29w eXJpZ2h0ICAgCSMgd2ViY3Jhd2xlcnMgc2hvdWxkIHBvaW50IHRvIENoZWJ1 Y3RvIGZvciB0aGlzDQpEaXNhbGxvdzovSG9tZS5odG1sfiAJIyBiYWNrdXAN CkRpc2FsbG93Oi9Ib21lLnRtcGwgCSMgdGVtcGxhdGUNCkRpc2FsbG93Oi9N ZW1vcHRzLmh0bWwJIyBsb2NhbCBkb2N1bWVudA0KRGlzYWxsb3c6L2lwcy5o dG1sICAgCSMgcmVidWlsdCByZWd1bGFybHkNCkRpc2FsbG93Oi9qdW1wcy5o dG1sCSMgY2hhbmdlcyBvY2Fzc2lvbmFsbHkNCkRpc2FsbG93Oi9tb3RkCQkj IGNoYW5nZXMNCg== --1920162272-1333332435-856886524=:12656--
next message in archive
next message in thread
previous message in archive
Index of Subjects