ProfessionalUwU/chksum
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 4 Wiki Activity

feature/NewHashingAlgorithms #6

Merged
ProfessionalUwU merged 8 commits from feature/NewHashingAlgorithms into main 2023-07-04 00:34:15 +02:00
Conversation 0 Commits 8 Files Changed 4 +214 -38
ProfessionalUwU commented 2023-07-04 00:32:46 +02:00
Owner
Copy Link

Breaking changes

Redis

I am now using redis to overcome the limitations of SQLite.
This also means that any setup before will be broken by this update.
If you want to save the hashes to a database then you can use the saveToSqlite option.

New features

New hashing algorithms

  1. MurmurHash
  2. XxHash

MurmurHash is considerably faster than MD5 and XxHash is even faster than MurmurHash when tested on mixed file sizes.

Buffer size

The buffer size of the two new hashing algorithms can be configured with a commandline option.
The default value is 4096 bytes. Higher values are recommended for faster drives.

Progress bar

The program finally has a progress bar so one will know how far along the checksumming process is.

# Breaking changes ## Redis I am now using [redis](https://stackexchange.github.io/StackExchange.Redis/) to overcome the limitations of SQLite. This also means that any setup before will be broken by this update. If you want to save the hashes to a database then you can use the saveToSqlite option. # New features ## New hashing algorithms 1. [MurmurHash](https://github.com/odinmillion/MurmurHash.Net) 2. [XxHash](https://github.com/uranium62/xxHash) MurmurHash is considerably faster than MD5 and XxHash is even faster than MurmurHash when tested on mixed file sizes. ## Buffer size The buffer size of the two new hashing algorithms can be configured with a commandline option. The default value is 4096 bytes. Higher values are recommended for faster drives. ## Progress bar The program finally has a progress bar so one will know how far along the checksumming process is.
ProfessionalUwU added the
Kind/Breaking
Kind/Enhancement
Kind/Feature
 labels 2023-07-04 00:32:46 +02:00
ProfessionalUwU self-assigned this 2023-07-04 00:32:46 +02:00
ProfessionalUwU added 8 commits 2023-07-04 00:32:46 +02:00 
Add XxHash
Code cleanup
New options
Switched to wal (Write ahead log)
Now using redis to cache filehashes
New option to dump redis data into sqlite database
# Add progress bar
Added a progress bar so that one can see how far along the program is.

Reviewed-on: #4
Co-authored-by: ProfessionalUwU <andre.fuhry@hopeless-cloud.xyz>
Co-committed-by: ProfessionalUwU <andre.fuhry@hopeless-cloud.xyz>
Reviewed-on: #5
ProfessionalUwU merged commit 7b00a87620 into main 2023-07-04 00:34:15 +02:00
ProfessionalUwU deleted branch feature/NewHashingAlgorithms 2023-07-04 00:34:15 +02:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
Kind/Breaking
Breaking change that won't be backward compatible
Kind/Bug
Something is not working
Kind/Documentation
Documentation changes
Kind/Enhancement
Improve existing functionality
Kind/Feature
New functionality
Kind/Security
This is security issue
Kind/Testing
Issue or pull request related to testing
Priority
Critical
The priority is critical
Priority
High
The priority is high
Priority
Low
The priority is low
Priority
Medium
The priority is medium
Reviewed
Confirmed
Issue has been confirmed
Reviewed
Duplicate
This issue or pull request already exists
Reviewed
Invalid
Invalid issue
Reviewed
Won't Fix
This issue won't be fixed
Status
Abandoned
Somebody has started to work on this but abandoned work
Status
Blocked
Something is blocking this issue or pull request
Status
Need More Info
Feedback is required to reproduce issue or to continue work
No Label
Kind/Breaking
Kind/Enhancement
Kind/Feature
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees ProfessionalUwU
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ProfessionalUwU/chksum#6
No description provided.
Delete Branch "feature/NewHashingAlgorithms"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?