(blog ‘lucindo)

um dia eu aprendo a programar

Arquivo de 2 de Novembro de 2007

Indexando com CL, segundo round

Fiz umas mudanças mínimas no programa teste:

  • Adicionei :external-format :latin-1 no with-open-file.
  • Mudei a declaração do índice para:
    (defparameter *index*
      (make-instance ‘montezuma:index
                     :path “/tmp/montezuma-test”
                     :analyzer (make-instance
                                ‘montezuma:whitespace-analyzer)
                     :min-merge-docs 500
                     :default-field “*”
                     :fields ‘(“file” “content”)))


Indexando apenas o /Documentation do source do Linux:

$ pwd
/linux-2.6.23.1/Documentation
$ find . -type f | wc -l
993
$ du -hs .
11M .
$ cd ~/Documents/Lisp/search
$ sbcl --noinform --no-linedit
* (load (compile-file "montezuma-test2.lisp"))
....
; compilation finished in 0:00:05
T
* (time (montezuma-test:add-dir-to-index "/linux-2.6.23.1/Documentation"))

Evaluation took:
31.639 seconds of real time
28.463371 seconds of user run time
2.271331 seconds of system run time
[Run times include 1.967 seconds GC run time.]
0 calls to %EVAL
0 page faults and
885,615,248 bytes consed.
* (time (montezuma-test:search-index "linux"))
/linux-2.6.23.1/Documentation/kbuild/00-INDEX score: 0.22367968
/linux-2.6.23.1/Documentation/video4linux/README.ir score: 0.11622737
/linux-2.6.23.1/Documentation/fujitsu/frv/README.txt score: 0.11183984
/linux-2.6.23.1/Documentation/scsi/scsi-generic.txt score: 0.11183984
/linux-2.6.23.1/Documentation/usb/auerswald.txt score: 0.11183984
/linux-2.6.23.1/Documentation/filesystems/befs.txt score: 0.09685614
/linux-2.6.23.1/Documentation/scsi/ChangeLog.arcmsr score: 0.09489925
/linux-2.6.23.1/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt score: 0.08947187
/linux-2.6.23.1/Documentation/basic_profiling.txt score: 0.08947187
/linux-2.6.23.1/Documentation/isdn/README.pcbit score: 0.08947187
Evaluation took:
0.307 seconds of real time
0.249204 seconds of user run time
0.034769 seconds of system run time
[Run times include 0.011 seconds GC run time.]
0 calls to %EVAL
0 page faults and
11,145,488 bytes consed.
79
* (time (montezuma-test:search-index "net"))
/linux-2.6.23.1/Documentation/networking/spider_net.txt score: 0.24094483
/linux-2.6.23.1/Documentation/video4linux/se401.txt score: 0.15144332
/linux-2.6.23.1/Documentation/networking/dmfe.txt score: 0.1325129
/linux-2.6.23.1/Documentation/networking/ewrk3.txt score: 0.1325129
/linux-2.6.23.1/Documentation/networking/framerelay.txt score: 0.11358249
/linux-2.6.23.1/Documentation/networking/pt.txt score: 0.09465207
/linux-2.6.23.1/Documentation/isdn/README.hysdn score: 0.09370077
/linux-2.6.23.1/Documentation/networking/DLINK.txt score: 0.09370077
/linux-2.6.23.1/Documentation/networking/ray_cs.txt score: 0.07572166
/linux-2.6.23.1/Documentation/input/xpad.txt score: 0.06625645
Evaluation took:
0.083 seconds of real time
0.070906 seconds of user run time
0.008872 seconds of system run time
[Run times include 0.021 seconds GC run time.]
0 calls to %EVAL
0 page faults and
2,154,208 bytes consed.
23
* (quit)
$ du -hs /tmp/montezuma-test
27M /tmp/montezuma-test

Fonte: montezuma-test2.lisp

Sem comentários »