Geoff Hutchison (ghutchis@wso.williams.edu)
Sat, 13 Mar 1999 14:30:54 -0500
Hi,
I just tried out the new database changes. First, off the changes seem to
really speed up HTTP access. I'm running it with debugging code in and it's
noticably faster.
But... I tested it by trying to index the htdig.org site.
New server: www.htdig.org, 80
0:2:0:http://www.htdig.org/: ++ size = 373
1:3:1:http://www.htdig.org/contents.html: *++++++++++++++++++++++- size = 3396
2:4:1:http://www.htdig.org/main.html: *-----*-*+ size = 7062
3:5:2:http://www.htdig.org/require.html: *--* size = 4227
..
28:5:2:http://www.htdig.org/require.html: not changed
This is a big bug--it's trying to reindex the same URLs. Shouldn't it be
realizing that it's indexed those URLs and toss them before it makes a new
DocID, sends the HTTP request to find out that it's "not changed?"
-Geoff
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
htdig3-dev@htdig.org containing the single word "unsubscribe" in
the SUBJECT of the message.
This archive was generated by hypermail 2.0b3 on Sat Mar 13 1999 - 12:02:25 PST