The Reverse Search Engine
[ start | index | login ]
home > SnipSnap > config > robots

robots

Created by mfranken. Last edited by mfranken, 4 years and 122 days ago. Viewed 752 times. #1
[edit] [rdf]
labels
attachments
# This file contains User-Agent mappings for robots
#
# WWW Search Engines
Googlebot http://www.googlebot.com/bot.html
FAST-WebCrawler http://fast.no/support/crawler.asp
Slurp http://www.inktomi.com/slurp.html
Teoma http://www.teoma.com/
#
# Syndication Crawler
Syndic8 http://www.syndic8.com
organica http://organica.us 
Popdexter http://www.popdex.com
#
# Robots and crawler to be ignored
#
ZyBorg http://www.WISEnutbot.com IGNORE
larbon liston@cc.gatech.edu IGNORE
Baiduspider http://www.baidu.com/search/spider.htm IGNORE
Infoseek http://www.infoseek.com/ IGNORE
TurnitinBot http://www.turnitin.com/robot/crawlerinfo.html IGNORE
NIF http://www.newsisfree.com/robot.php IGNORE
NPBot http://www.nameprotect.com/botinfo.html IGNORE
Robot ??? IGNORE
Scooter ??? IGNORE
Mercator ??? IGNORE
EvilBot ??? IGNORE
BlogBot ??? IGNORE
no comments | post comment

Zilverline
Visit Zilverline for Agile Coaching and Training

News

I've just released version 1.5.0
This version adds security and allows you to
upload documents to collections.

Get Zilverline

Zilverline is free of charge for personal and
R&D use. For commercial use you will have to
pay or contribute.

See Getting Zilverline.

Source

The source code can be found at Source Code

Build Information

All build reports generated with Maven
are accessible >>here

Installation

If you're upgrading from a previous version,
I advice you to follow the installation,
and copy your existing configuration
(collectionManager.xml and
searchService.xml) in your
Home Directory (user.home).
See also Quick start.

Screenshot

Here is one: screenshot

FAQ

Read the FAQ before getting started.

Best viewed with Get Firefox!

Made with Spring Framework

Built with MaviClipse

Powered by lucene

AgileHolland AgileHolland member.



< August 2008 >
SunMonTueWedThuFriSat
12
3456789
10111213141516
17181920212223
24252627282930
31
Powered by SnipSnap 1.0b1-mfranken
snipsnap.org | Copyright 2000-2002 Matthias L. Jugel and Stephan J. Schmidt