Update auf v4.0.4
Ab sofort steht v4.0.4 von OpenAcoon zum Download zur Verfügung.
Diese Version ist eine Entwicklerversion! Wir setzen diese Version selber ein und daher sollte sie
eigentlich funktionieren, ist aber noch nicht SOOO gründlich getestet.
Die Robot/Parser-Kombination ist jetzt
erheblich schneller und erzeugt gleichzeitig viel
weniger Plattenzugriffe. Es war genau diese Reduktion der Plattenzugriffe, die die Performance
so erheblich verbessert.
Hier geht's zum Download
ChangeLog:
- GenDb.dpr: Added: DoPass1 now writes information about the
URL-length to filter.dat. This is to be used for better
ranking in ServerMain.pas.
- RobotMain.pas: Bugfix: IncCurConnections was called via
Synchronize from the context of the main thread. This MUST NOT
happen! Now fixed.
- RobotMain.pas: Modified: Increased the maximum number of new
connections per second to 500, and the maximum number of
simultanious connections to 1000.
- RobotMain.pas: Modified: StartNewConnection now also counts new
requests for robots.txt as new connections.
- RobotsTxt.pas: Modified: RobotsTxtStartCheckingFor now returns
TRUE if it must start a GET-request for robots.txt. This is used
by the robot to count new outgoing connections.
- Parser.dpr: Modified: Introduced changes to reflect the changes
to RobotMain.pas.
- RobotMain.pas Modified: Changes to tGetUrl to massively improve
performance. Previously every web-page was saved to a separate
file. Now every second only one file is written containing all
the web-pages whose download completed in that second.
- Parser.dpr: Modified: Merged OpenOutFile and OpenCatchemFiles
procedures into a single OpenOutputFiles procedure.
