Questions tagged [data-integrity]
78 questions
45
votes
1 answer
How do I fix "WARNING: message was not integrity protected" when using GPG symmetrical encryption?
I've encrypted a file using symmetric encryption like this:
gpg --symmetric myfile
which results in a file myfile.gpg.
Alright. Now let's decrypt the file again:
gpg -o myfile --decrypt myfile.gpg
I'm being asked for the passphrase I've put on,…
gertvdijk
- 3,636
41
votes
3 answers
Does Git prevent data degradation
I read that ZFS and Btrfs use checksums to prevent data degradation and I read that Git has integrity through hashing essentially everything with each commit.
I was going to use a Git server on a Linux NAS with Btrfs RAID 1 for storage, but if Git…
32
votes
3 answers
Can data on a hard disk degrade without Windows warning me that this has happened when I attempt to access the data?
Is it likely that a physical degradation of a hard disk could cause bits to 'flip' in file contents without the OS 'noticing' and telling you about it when reading the file? e.g. could a 'p' in an ASCII text file (binary 01110000) change to a 'q'…
Нет войне
- 423
24
votes
6 answers
How to transfer a file over pen and paper, with error correction
I'm looking for a way to transfer a file using only a pen and paper.
This is somewhat similar to paperbak, except the density I'm looking for is much, much lower, and I don't want to use a printer or a scanner.
Obviously, the first answer is Base64…
Jeremy Salwen
- 487
15
votes
1 answer
Which file system automatically stores hashes of files?
Which file system automatically computes and stores hashes of files and later checks them at access to detect corruption?
Adrian Panasiuk
- 1,165
13
votes
6 answers
How do I efficiently generate and validate file checksums?
I'd like to be able to capture and validate checksums for large-scale collections of files, typically nested within a complex directory hierarchy.
Does every single file need a checksum? Are there ways to leverage the existing directory structure…
Aaron Rubinstein
- 131
- 1
- 3
13
votes
1 answer
How to get Btrfs verify checksum for one file?
Btrfs offers these commands to verify data integrity/checksums:
btrfs scrub start |
btrfs check --check-data-csum
However, AFAIK those always verify whole filesystems; the path argument is to identify a filesystem on a device, not…
Greendrake
- 901
12
votes
5 answers
Do we really need to check the integrity of downloaded files?
I downloaded a huge amount of files, but discovered the use of md5 and sha as integrity checkers quite recently. From then I always prefer to check it for big downloaded files, even if I never found them to be corrupted.
Do we really need to check…
maxpesa
- 251
12
votes
3 answers
Is it possible to use NAS hard drives in a desktop?
Is it a good idea to use a hard drive that was made for use in NAS as a desktop system drive?
I am particularly concerned about error recovery.
The following post claims that NAS drives do not try as hard to fix disk errors, compared to normal…
mcu
- 353
- 5
- 13
11
votes
1 answer
Is ECC mandatory in SSD technology?
While shopping for an SSD I have noticed that some manufacturers promote their "Pro" models as the ones sporting ECC data protection. Those manufacturers do not mention ECC in their budget models descriptions.
However, Wikipedia article on flash…
10
votes
1 answer
Does Windows calculate CRCs to check every file operation?
When Windows encounters a file corruption on a file system, it may return the following error message:
Data error (cyclic redundancy check).
This suggests Windows checks every file operation (copy, move, etc.) by calculating CRCs. Does Windows…
bwDraco
- 46,683
8
votes
3 answers
Can Robocopy ensure file integrity?
I am trying to copy a large file, around 10G size, over Internet using Robocopy, but I am a bit concerned about the file integrity. Can I just trust Robocopy to ensure file integrity or I need to calculate and verify the MD5 myself?
iceagle
- 181
7
votes
3 answers
High "wasted" on a torrent download, with no hashfails
Recently I have downloaded a game patch from a torrent. The total patch size was ~528 MB and the torrent has shown 235 MB as "wasted", with 0 hashfails. Some other things I remember about the download:
my client is uTorrent 2.2.1
While downloading,…
Suma
- 1,484
7
votes
3 answers
Can ZFS cope with sudden power loss? (What events cause a pool to be irrecoverable if the disk itself hasn't failed or become unreliable)
All the resources say ZFS doesn't have fsck, or recovery tools, use battery backed SSD for ZIL, etc.
If the plug is suddenly somehow pulled (total power loss despite UPS etc, but assuming no physical damage, no head crashes etc), the SSDs will…
Stilez
- 1,825
6
votes
2 answers
Is there any reason to verify a download checksum over HTTPS
Assuming that both the page linking the download, and the download itself are on trusted domains over HTTPS, is there any reason to worry about checking the hash/checksum of the downloaded file (especially executables/installers, which are also not…
Fire Lancer
- 1,413