Crawler

Buscadores, indexadores, index, Crawler

• http://nutch.apache.org/
• https://github.com/FriendsOfPHP/Goutte
• http://sourceforge.net/projects/methabot/
• http://www.openwebspider.org/
• https://osf.io/share
• http://iweb.dl.sourceforge.net/project/openwebspider/OpenWebSpider/0.7/openwebspider-0.7.tar.tar.bz2
• http://ufpr.dl.sourceforge.net/project/openwebspider/openwebspiderjs/openwebspider_js_0.2.3.zip
• http://www.grepsr.com/
• http://www.diffbot.com/
• https://import.io/
• https://cartodb.com/
• http://scrapy.org/doc/
• http://bigdata-madesimple.com/top-50-open-source-web-crawlers-for-data-mining/
• http://xapian.org/
• Solr

• https://github.com/petercrlane/ferret
• http://lucene.apache.org/solr/
• https://github.com/aol/moloch
• http://www.opensearchserver.com/
• http://www.austlii.edu.au/techlib/software/sino/
• http://www.htdig.org/
• http://docfetcher.sourceforge.net/en/more.html
• http://nutch.apache.org/
• http://sphinxsearch.com/
• http://www.devmedia.com.br/buscas-na-web-com-apache-solr-e-nutch-revista-java-magazine-107-parte-2/25648
• http://blogs.ambientelivre.com.br/marcio/doug-cutting-criador-do-hadoop-no-brasil/
• http://projinf.estig.ipb.pt/~a25805/relatorio.pdf