-
Breaking changes Stable
ProfessionalUwU released this
2023-07-04 00:34:42 +02:00 | 2 commits to main since this releaseRedis
I am now using redis to overcome the limitations of SQLite.
This also means that any setup before will be broken by this update.
If you want to save the hashes to a database then you can use the saveToSqlite option.New features
New hashing algorithms
MurmurHash is considerably faster than MD5 and XxHash is even faster than MurmurHash when tested on mixed file sizes.
Buffer size
The buffer size of the two new hashing algorithms can be configured with a commandline option.
The default value is 4096 bytes. Higher values are recommended for faster drives.Progress bar
The program finally has a progress bar so one will know how far along the checksumming process is.
Downloads
-
Logging Stable
2023-06-29 19:04:19 +02:00 | 11 commits to main since this releaseMore information for users
With this release we will be adding logging to the program with the help of Serilog.
Defaults
By default only error and fatal event will be written to the console.
The program also now create a log file which logs debug information by default.Changing the behavior of logging
You can change this behavior by altering the logger configuration.
A guide is now available in the readme.Downloads
-
Multi-threading Stable
2023-06-29 02:15:53 +02:00 | 14 commits to main since this releaseMulti-threading
Speed
While testing with a variety of workloads we found that the program was up to 3 times faster than before.
It took about 6 minutes to checksum 700Gb of varying data. Which is just impressive.CPU load and drive speed
Chksum is now fast enough that your hardware will most certainly be the bottleneck. We maxes out our 2.5Gbs SSD no problem. It also used about 50-60% of the CPU.
If the SSD was faster we would probably hit a CPU bottleneck.Scaling
With this update the space and time complexity of the program is now linear with file count.
Chksum will try to checksum all files at the same time so be careful with how many files you have.
Memory also grows with how many files are put into the Dictionary.Downloads
-
First release of chksum Stable
2023-06-26 18:23:09 +02:00 | 25 commits to main since this releaseChksum
What does it do?
Chksum checksums every file in the underlying directories and records them inside a SQLite database.
Is there anything else it can do?
Yes. It can detect if you moved files around, check for duplicate files and even notice when you deleted files. And if you backup your data like you should it even can compare the two separate databases and tell you what is different.
Why should I use it?
- You can copy it the whole directory where your files reside and just take the database and executable with you.
Downloads