Performance decreases exponentially with files found.
When displaying many results, the bulk of the time by far is spent updating the GUI, and increases dramatically with respect to matches found.
On a dataset of 45,000+ files:
- Searching takes <0.5 sec
- Adding to model takes >100 additional sec
- Displaying results takes >250 additional sec
These measurements were taken by searching with no files found, all files found but filtered out, and all file found and displayed, consecutively.
With all results found and displayed, it takes increasingly longer to display each additional 5000 matches.
In these results, the average match rate decreases from 1000 files/sec for the 1st 5000 to 65 files/sec for the 9th 5000.
| Cumulative File Count | Cumulative Search Time |
|---|---|
| 5000 files | 5 (+5) sec |
| 10000 files | 13 (+8) sec |
| 15000 files | 29 (+16) sec |
| 20000 files | 53 (+24) sec |
| 25000 files | 88 (+35) sec |
| 30000 files | 132 (+44) sec |
| 35000 files | 186 (+54) sec |
| 40000 files | 248 (+62) sec |
| 45000 files | 323 (+75) sec |