yacy:rc1.git
4 years agoRelease 1.6 Release_1.6
orbiter [Sat, 27 Jul 2013 09:26:14 +0000 (11:26 +0200)]
Release 1.6

4 years agowe should not do too much greedylearning at this time as we don't have
orbiter [Sat, 27 Jul 2013 09:22:40 +0000 (11:22 +0200)]
we should not do too much greedylearning at this time as we don't have
enough experience with it. set greedylearning.limit.doccount to a much
lower limit.

4 years agowait a bit longer before doing the first peer ping
orbiter [Sat, 27 Jul 2013 09:00:35 +0000 (11:00 +0200)]
wait a bit longer before doing the first peer ping

4 years agore-try to fetch url after a soft commit
orbiter [Sat, 27 Jul 2013 08:56:02 +0000 (10:56 +0200)]
re-try to fetch url after a soft commit

4 years agodon't be noisy when doing background tasks that may be allowed to fail
orbiter [Sat, 27 Jul 2013 08:51:58 +0000 (10:51 +0200)]
don't be noisy when doing background tasks that may be allowed to fail

4 years agoapply load limitation also to dht-in
orbiter [Sat, 27 Jul 2013 08:42:38 +0000 (10:42 +0200)]
apply load limitation also to dht-in

4 years agoFix for NPE:
Roland Haeder [Sat, 27 Jul 2013 08:19:46 +0000 (10:19 +0200)]
Fix for NPE:
E 2013/07/26 20:29:29 BUSYTHREAD Runtime Error in
serverInstantThread.job, thread
'net.yacy.search.Switchboard.cleanupJob': null; target exception: null
java.lang.NullPointerException
        at
net.yacy.search.schema.CollectionConfiguration.convergenceStep(CollectionConfiguration.java:1116)
        at
net.yacy.search.schema.CollectionConfiguration.postprocessing(CollectionConfiguration.java:897)
        at net.yacy.search.Switchboard.cleanupJob(Switchboard.java:2296)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at
net.yacy.kelondro.workflow.InstantBusyThread.job(InstantBusyThread.java:107)
        at
net.yacy.kelondro.workflow.AbstractBusyThread.run(AbstractBusyThread.java:165)

Conflicts:
source/net/yacy/search/schema/CollectionConfiguration.java

4 years agoSome cleanups:
Roland Haeder [Fri, 26 Jul 2013 17:51:34 +0000 (19:51 +0200)]
Some cleanups:
- added SKINS_PATH_DEFAULT as same as LISTS_PATH_DEFAULT was added
- Added 'final' keyword to a string

4 years agoUse SwitchboardConstants.LISTS_PATH_DEFAULT instead of 'DATA/LISTS'
Roland Haeder [Sat, 27 Jul 2013 08:12:58 +0000 (10:12 +0200)]
Use SwitchboardConstants.LISTS_PATH_DEFAULT instead of 'DATA/LISTS'

Conflicts:
htroot/api/blacklists_p.java

4 years agoRemoved another duplicate occurance of Blacklist.BLACKLIST_FILENAME_FILTER
Roland Haeder [Fri, 26 Jul 2013 17:17:31 +0000 (19:17 +0200)]
Removed another duplicate occurance of Blacklist.BLACKLIST_FILENAME_FILTER

4 years agoFix for blacklist export, also applied the filename filter here
Roland Haeder [Fri, 26 Jul 2013 17:09:38 +0000 (19:09 +0200)]
Fix for blacklist export, also applied the filename filter here

4 years agoRemoved superfluous check for files ending '.black' as the previous commit already...
Roland Haeder [Fri, 26 Jul 2013 17:09:00 +0000 (19:09 +0200)]
Removed superfluous check for files ending '.black' as the previous commit already excluded all other files (e.g. .ser dumps), added logging in catch-all block

4 years agoReuse Blacklist.BLACKLIST_FILENAME_FILTER
Roland Haeder [Fri, 26 Jul 2013 17:07:42 +0000 (19:07 +0200)]
Reuse Blacklist.BLACKLIST_FILENAME_FILTER

4 years agoPossible fix for ticket http://bugs.yacy.net/view.php?id=270, the filter for only...
Roland Haeder [Fri, 26 Jul 2013 16:32:04 +0000 (18:32 +0200)]
Possible fix for ticket bugs.yacy.net/view.php?id=270, the filter for only including *.black must be applied

4 years agoFix for NPE on shutdown:
Roland Haeder [Thu, 25 Jul 2013 10:02:11 +0000 (12:02 +0200)]
Fix for NPE on shutdown:
java.lang.NullPointerException
        at net.yacy.search.Switchboard.storeDocumentIndex(Switchboard.java:2732)
        at net.yacy.search.Switchboard.access00(Switchboard.java:207)
        at net.yacy.search.Switchboard.run(Switchboard.java:3049)

4 years agoLog this exception better
Roland Haeder [Sat, 27 Jul 2013 07:54:51 +0000 (09:54 +0200)]
Log this exception better

Conflicts:
source/net/yacy/kelondro/blob/Tables.java

4 years agodo not write an empty failreason in case that there is no fail. Because
orbiter [Fri, 26 Jul 2013 15:53:28 +0000 (17:53 +0200)]
do not write an empty failreason in case that there is no fail. Because
of the lazy instantiation rule this value was not actually written, but
if lazy instantiation is switched on, then this causes that all crawl
starts delete all crawl-start-hosts completely because this looks for
filled error reasons.

4 years agofix in forced deletion: forced commit needed
Michael Peter Christen [Thu, 25 Jul 2013 07:53:19 +0000 (09:53 +0200)]
fix in forced deletion: forced commit needed

4 years agonew test case for http://bugs.yacy.net/view.php?id=141
Michael Peter Christen [Thu, 25 Jul 2013 07:31:48 +0000 (09:31 +0200)]
new test case for bugs.yacy.net/view.php?id=141

4 years agofix for http://bugs.yacy.net/view.php?id=267
Michael Peter Christen [Thu, 25 Jul 2013 07:26:24 +0000 (09:26 +0200)]
fix for http://bugs.yacy.net/view.php?id=267

4 years agofix for http://bugs.yacy.net/view.php?id=268
Michael Peter Christen [Thu, 25 Jul 2013 07:21:37 +0000 (09:21 +0200)]
fix for http://bugs.yacy.net/view.php?id=268

4 years ago- small adjustment to make sure genericParser is tried last
reger [Tue, 23 Jul 2013 18:24:13 +0000 (20:24 +0200)]
- small adjustment to make sure genericParser is tried last
  -- for some documents genericParser grabs document instead of specific available parser due to unordered pick of 1st to try parser
      (like .ps .rdf files and other)
- remove redundant file extension registration

4 years agoMerge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
orbiter [Tue, 23 Jul 2013 17:33:07 +0000 (19:33 +0200)]
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git

4 years agodo not run dht ditribution if system load is over 2.5
orbiter [Tue, 23 Jul 2013 17:32:32 +0000 (19:32 +0200)]
do not run dht ditribution if system load is over 2.5

4 years agoadded segment sizes, postprocessing status and cpu load to crawler
orbiter [Tue, 23 Jul 2013 17:10:11 +0000 (19:10 +0200)]
added segment sizes, postprocessing status and cpu load to crawler
monitor

4 years agoadded load info to status_p.xml
orbiter [Tue, 23 Jul 2013 16:20:07 +0000 (18:20 +0200)]
added load info to status_p.xml

4 years ago- added information about segment count to status_p.xml
orbiter [Tue, 23 Jul 2013 16:03:33 +0000 (18:03 +0200)]
- added information about segment count to status_p.xml
- also moved this information from the old index structure, which is
still in use for the RWI/DHT index to that front-end

4 years agofixes for problems with remote solr and non-activated webgraph index
orbiter [Tue, 23 Jul 2013 14:46:44 +0000 (16:46 +0200)]
fixes for problems with remote solr and non-activated webgraph index

4 years agochanged optimization to a segment-size of index-size/5.000.000
sixcooler [Tue, 23 Jul 2013 12:21:12 +0000 (14:21 +0200)]
changed optimization to a segment-size of index-size/5.000.000
+ one if not idle
+ one (and force) if postprocessing

4 years agoreplaced StringBuffer with StringBuilder
Michael Peter Christen [Tue, 23 Jul 2013 10:21:27 +0000 (12:21 +0200)]
replaced StringBuffer with StringBuilder

4 years agoreplaced more containsKey() -> get() usages by a simple get(), followed
Michael Peter Christen [Tue, 23 Jul 2013 10:16:51 +0000 (12:16 +0200)]
replaced more containsKey() -> get() usages by a simple get(), followed
by a test for NULL. This should increase the application speed and
reduces the lookup time for the affected methods by 50%

4 years agodelayed first peer-ping to send the first ping out after the http got
orbiter [Mon, 22 Jul 2013 16:21:37 +0000 (18:21 +0200)]
delayed first peer-ping to send the first ping out after the http got
up; if the ping comes before the http is up, it cannot be recognized as
senior peer (if at all). See also: http://bugs.yacy.net/view.php?id=266

4 years agoadded the property federated.service.solr.indexing.timeout to yacy.init
orbiter [Mon, 22 Jul 2013 15:45:12 +0000 (17:45 +0200)]
added the property federated.service.solr.indexing.timeout to yacy.init
to provide a configurable time-out for solr; see also:
http://bugs.yacy.net/view.php?id=254

4 years agoremoved forced non-soft commits to prevent index fragmentation
orbiter [Mon, 22 Jul 2013 15:28:20 +0000 (17:28 +0200)]
removed forced non-soft commits to prevent index fragmentation

4 years agofixed problem with remote luke requests
Michael Peter Christen [Mon, 22 Jul 2013 13:55:20 +0000 (15:55 +0200)]
fixed problem with remote luke requests

4 years agoremoved failreason_t removal patch because that causes too much
Michael Peter Christen [Mon, 22 Jul 2013 12:17:38 +0000 (14:17 +0200)]
removed failreason_t removal patch because that causes too much
confusion using an external solr. to clean up the index after a schema
change, use the index cleaner function from the online servlet

4 years agoextend content type detection on file extension for .tif .tiff .htm
reger [Sun, 21 Jul 2013 20:57:21 +0000 (22:57 +0200)]
extend content type detection on file extension for .tif .tiff .htm

5 years agoadded a getSegmentCount method and use it to disable optimize if wanted
Michael Peter Christen [Thu, 18 Jul 2013 12:31:42 +0000 (14:31 +0200)]
added a getSegmentCount method and use it to disable optimize if wanted
current segment count is below optimization level

5 years ago- used reger's LukeRequest to generalize the index info in
Michael Peter Christen [Thu, 18 Jul 2013 11:26:07 +0000 (13:26 +0200)]
- used reger's LukeRequest to generalize the index info in
SolrServerConnector
- used the LukeRequest in SolrServerConnector to replace the index size
method by a getNumDocs request to a LukeRequest result

5 years agofix for NPE & bug #264
Michael Peter Christen [Thu, 18 Jul 2013 10:37:32 +0000 (12:37 +0200)]
fix for NPE & bug #264

5 years agoenhancements to crawler
Michael Peter Christen [Thu, 18 Jul 2013 10:29:04 +0000 (12:29 +0200)]
enhancements to crawler

5 years agoremoved double-ocurring value assignments
orbiter [Wed, 17 Jul 2013 17:09:25 +0000 (19:09 +0200)]
removed double-ocurring value assignments

5 years agoRemoved trailing spaces + some more final
Roland Haeder [Mon, 15 Jul 2013 16:22:35 +0000 (18:22 +0200)]
Removed trailing spaces + some more final

5 years agoFixes and avoid of catching bad exceptions (some):
Roland Haeder [Wed, 17 Jul 2013 16:37:34 +0000 (18:37 +0200)]
Fixes and avoid of catching bad exceptions (some):
- Rewrote usage of HashMap/Map to concurrent versions (to avoid a
CME=ConcurrentModificationException)
- Rewrote ConnectionInfo (as an example) to use a synchronized iterator
instead of synchronizing an
  already synced HashSet (see Collections call)
- This avoids catching CMEs again
- Commented out noisy ConcurrentLog.logException() call

Conflicts:
source/net/yacy/repository/LoaderDispatcher.java

5 years agoAdded 'final' for all exception blocks as this helps the Java compiler
Roland Haeder [Wed, 17 Jul 2013 16:31:30 +0000 (18:31 +0200)]
Added 'final' for all exception blocks as this helps the Java compiler
to optimize memory usage

Conflicts:
source/net/yacy/search/Switchboard.java

5 years agoAdded some cora package loggers
Roland Haeder [Sun, 14 Jul 2013 07:01:10 +0000 (09:01 +0200)]
Added some cora package loggers

5 years agoRecommended cleanup (please, one day, execute this cleanup)
Roland Haeder [Sun, 14 Jul 2013 06:04:10 +0000 (08:04 +0200)]
Recommended cleanup (please, one day, execute this cleanup)

5 years agoFixed (?i) appearing in entries, fixed multiple equal lines in file.
Felix Ableitner [Wed, 17 Jul 2013 14:42:10 +0000 (16:42 +0200)]
Fixed (?i) appearing in entries, fixed multiple equal lines in file.

5 years agoMerge branch 'master' of git://gitorious.org/yacy/rc1 into blacklist_structure
Felix Ableitner [Wed, 17 Jul 2013 13:58:09 +0000 (15:58 +0200)]
Merge branch 'master' of git://gitorious.org/yacy/rc1 into blacklist_structure

5 years agoadded collection_sxt to error documents
Michael Peter Christen [Wed, 17 Jul 2013 13:20:56 +0000 (15:20 +0200)]
added collection_sxt to error documents

5 years agoMerge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
Michael Peter Christen [Wed, 17 Jul 2013 10:42:06 +0000 (12:42 +0200)]
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git

5 years agofixes using the embedded connector
Michael Peter Christen [Wed, 17 Jul 2013 10:41:54 +0000 (12:41 +0200)]
fixes using the embedded connector

5 years agologging of deadlocks (if any) during cleanup process
orbiter [Wed, 17 Jul 2013 10:38:58 +0000 (12:38 +0200)]
logging of deadlocks (if any) during cleanup process

5 years agoadded cpu load information to status page
orbiter [Wed, 17 Jul 2013 10:38:12 +0000 (12:38 +0200)]
added cpu load information to status page

5 years agofix for crawl stack domain counter
Michael Peter Christen [Tue, 16 Jul 2013 16:18:55 +0000 (18:18 +0200)]
fix for crawl stack domain counter

5 years agodo a more frequent optimization, reduces IO after optimization
Michael Peter Christen [Tue, 16 Jul 2013 15:16:48 +0000 (17:16 +0200)]
do a more frequent optimization, reduces IO after optimization

5 years agoMerge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
orbiter [Tue, 16 Jul 2013 08:49:36 +0000 (10:49 +0200)]
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git

5 years agoadded load and deadlock detector in Memory util
orbiter [Tue, 16 Jul 2013 08:49:20 +0000 (10:49 +0200)]
added load and deadlock detector in Memory util

5 years agoMerge branch 'master' of git://git.gitorious.org/yacy/rc1.git
Lotus [Sun, 14 Jul 2013 16:53:29 +0000 (18:53 +0200)]
Merge branch 'master' of git://git.gitorious.org/yacy/rc1.git

5 years agopartly revert latest windows changes:
Lotus [Sun, 14 Jul 2013 16:43:32 +0000 (18:43 +0200)]
partly revert latest windows changes:
YaCy has to be installed to a directory with write access for the
running user.
DATA folder is now used in the YaCy folder again.
For using another location, the start script has to be heavily modified
for loading proper start parameters after YaCy has been started once.

5 years agoMerge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
orbiter [Sun, 14 Jul 2013 15:41:32 +0000 (17:41 +0200)]
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git

5 years agofix for bug 260
orbiter [Sun, 14 Jul 2013 15:40:28 +0000 (17:40 +0200)]
fix for bug 260

5 years agogrr
Michael Peter Christen [Sun, 14 Jul 2013 08:15:47 +0000 (10:15 +0200)]
grr

5 years agoautomatically running optimize on solr if user/search is idle for some
Michael Peter Christen [Sun, 14 Jul 2013 08:02:08 +0000 (10:02 +0200)]
automatically running optimize on solr if user/search is idle for some
time

5 years agodo a light optimization at the end of a crawl postprocessing
orbiter [Sat, 13 Jul 2013 17:09:46 +0000 (19:09 +0200)]
do a light optimization at the end of a crawl postprocessing

5 years agoMerge branch 'master' of git://gitorious.org/~quix0r/yacy/quix0rs-yacy-rc1
orbiter [Sat, 13 Jul 2013 16:54:18 +0000 (18:54 +0200)]
Merge branch 'master' of git://gitorious.org/~quix0r/yacy/quix0rs-yacy-rc1

5 years agoreplaced type of solr schema object sku of text_en_splitting_tight by
orbiter [Sat, 13 Jul 2013 16:54:09 +0000 (18:54 +0200)]
replaced type of solr schema object sku of text_en_splitting_tight by
string

5 years agoMerge remote-tracking branch 'upstream/master'
Roland Haeder [Sat, 13 Jul 2013 13:12:51 +0000 (15:12 +0200)]
Merge remote-tracking branch 'upstream/master'

5 years agostealth mode shall only be available for authorized users, because
orbiter [Sat, 13 Jul 2013 12:49:36 +0000 (14:49 +0200)]
stealth mode shall only be available for authorized users, because
unauthorized users can otherwise be monitored by authorized users

5 years agoFixed CHMOD on many files + added missing loggers (e.g. jena) and made some noisy... 16
Roland Haeder [Sat, 13 Jul 2013 11:12:36 +0000 (13:12 +0200)]
Fixed CHMOD on many files + added missing loggers (e.g. jena) and made some noisy loggers quiet

5 years agonpe fix
orbiter [Sat, 13 Jul 2013 09:10:05 +0000 (11:10 +0200)]
npe fix

5 years agorefactoring of load_delay: this is a matter of client identification
Michael Peter Christen [Fri, 12 Jul 2013 14:24:56 +0000 (16:24 +0200)]
refactoring of load_delay: this is a matter of client identification

5 years agoactivate api actions after postprocessing of crawls
orbiter [Fri, 12 Jul 2013 14:05:48 +0000 (16:05 +0200)]
activate api actions after postprocessing of crawls

5 years agofix for http://bugs.yacy.net/view.php?id=255
orbiter [Fri, 12 Jul 2013 12:38:30 +0000 (14:38 +0200)]
fix for http://bugs.yacy.net/view.php?id=255

5 years agoadded a postprocessing field into api/status_p.xml to show if the
orbiter [Fri, 12 Jul 2013 12:29:22 +0000 (14:29 +0200)]
added a postprocessing field into api/status_p.xml to show if the
postprocessing task is running at that time (status: busy) or not
(status:idle)

5 years agoMerge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
orbiter [Fri, 12 Jul 2013 12:17:13 +0000 (14:17 +0200)]
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git

5 years agoadded list of crawls to status_p.xml
orbiter [Fri, 12 Jul 2013 12:16:51 +0000 (14:16 +0200)]
added list of crawls to status_p.xml

5 years agoadded files to uninstall
Lotus [Thu, 11 Jul 2013 20:04:01 +0000 (22:04 +0200)]
added files to uninstall

5 years agoDo not allow automatic update in case YaCy is installed to the Program
Lotus [Thu, 11 Jul 2013 19:50:06 +0000 (21:50 +0200)]
Do not allow automatic update in case YaCy is installed to the Program
Files folder on Windows. There are no permissions to write that folder
and update would fail.

5 years agoRevert "Revert "Windows installer: update logo""
Lotus [Thu, 11 Jul 2013 19:48:49 +0000 (21:48 +0200)]
Revert "Revert "Windows installer: update logo""

This reverts commit c66631d407758b2157001ec5abcf98a2fc36c9ad.

5 years agoRevert "Windows installer: update logo"
Lotus [Thu, 11 Jul 2013 19:48:13 +0000 (21:48 +0200)]
Revert "Windows installer: update logo"

This reverts commit 41cc9be62babcea4c4fecb7c0eac8e624f394b70.

5 years agoWindows installer: update logo
Lotus [Thu, 11 Jul 2013 19:46:46 +0000 (21:46 +0200)]
Windows installer: update logo

5 years agoadapt windows start script parameters to linux start script parameter
Lotus [Thu, 11 Jul 2013 19:46:17 +0000 (21:46 +0200)]
adapt windows start script parameters to linux start script parameter

5 years agominimum access time has a tight connection to ClientIdentification,
orbiter [Thu, 11 Jul 2013 15:04:24 +0000 (17:04 +0200)]
minimum access time has a tight connection to ClientIdentification,
therefore it is defined there.

5 years agoFixed problems with blacklist entry insertion.
Felix Ableitner [Thu, 11 Jul 2013 11:10:23 +0000 (13:10 +0200)]
Fixed problems with blacklist entry insertion.

5 years agoanother patch to prevent CLOSE_WAIT status on solr connections
Michael Peter Christen [Thu, 11 Jul 2013 10:53:39 +0000 (12:53 +0200)]
another patch to prevent CLOSE_WAIT status on solr connections

5 years agofixed parsing of peer flags
Michael Peter Christen [Thu, 11 Jul 2013 10:53:16 +0000 (12:53 +0200)]
fixed parsing of peer flags

5 years agoadded Connection:close to all http requests in our http client to
Michael Peter Christen [Thu, 11 Jul 2013 09:54:11 +0000 (11:54 +0200)]
added Connection:close to all http requests in our http client to
prevent CLOSE_WAIT states (as seen in lsof)

5 years agoMerge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
orbiter [Thu, 11 Jul 2013 08:22:55 +0000 (10:22 +0200)]
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git

5 years agore-insert this file - was deleted by mistake
sixcooler [Wed, 10 Jul 2013 16:32:12 +0000 (18:32 +0200)]
re-insert this file - was deleted by mistake
+ correct an other case-typo

5 years agometager whitelist update
orbiter [Wed, 10 Jul 2013 13:13:04 +0000 (15:13 +0200)]
metager whitelist update

5 years agoreplaced usage of log4j by ConcurrentLog where possible
Michael Peter Christen [Tue, 9 Jul 2013 12:42:39 +0000 (14:42 +0200)]
replaced usage of log4j by ConcurrentLog where possible

5 years ago- refactoring of log to ConcurrentLog:
Michael Peter Christen [Tue, 9 Jul 2013 12:28:25 +0000 (14:28 +0200)]
- refactoring of log to ConcurrentLog:
jdk-based logger tend to block
at java.util.logging.Logger.log(Logger.java:476) in concurrent
environments. This makes logging a main performance issue. To overcome
this problem, this is a add-on to jdk logging to put log entries on a
concurrent message queue and log the messages one by one using a
separate process.
- FTPClient uses the concurrent logging instead of the log4j logger

5 years agoMerge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
Michael Peter Christen [Tue, 9 Jul 2013 09:52:20 +0000 (11:52 +0200)]
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git

5 years agoenhanced the network scanner: find more hosts automatically by removal
orbiter [Tue, 9 Jul 2013 09:42:13 +0000 (11:42 +0200)]
enhanced the network scanner: find more hosts automatically by removal
of common subdomains before application of protocol-specific prefix

5 years agobetter handling of time-out at solrj in case that a commit is done in a
orbiter [Tue, 9 Jul 2013 09:01:37 +0000 (11:01 +0200)]
better handling of time-out at solrj in case that a commit is done in a
fail-over case during add

5 years agofix for bug #252
orbiter [Tue, 9 Jul 2013 08:50:47 +0000 (10:50 +0200)]
fix for bug #252
the naming of the servlet was wrong, the bug may not be present on
systems where upper/lowercase matching is lazy (windows)

5 years agoincrease crawler speed by reduction if the busysleep time
Michael Peter Christen [Mon, 8 Jul 2013 21:40:31 +0000 (23:40 +0200)]
increase crawler speed by reduction if the busysleep time

5 years agoMerge remote-tracking branch 'nutomics/blacklist_structure'
Michael Peter Christen [Mon, 8 Jul 2013 21:32:15 +0000 (23:32 +0200)]
Merge remote-tracking branch 'nutomics/blacklist_structure'

5 years ago- better concurrency for network scanner
Michael Peter Christen [Mon, 8 Jul 2013 14:29:30 +0000 (16:29 +0200)]
- better concurrency for network scanner
- network scanner can now start from the list of all hosts in the search
index