And additionnaly, isn’t there a way to exploit this so we can store more stuff on PCs?
Edit: can’t thank you all individually but thanks to everyone, I learnt something today, appreciate all of your replies!
IIRC: Data has not been overwritten yet; it is just shown to be open to being rewritten.
It can still be recovered with minimal corruption if the device was not used too much, where open storage would be eriten over.
eriten
Because of how filesystems work. There’s basically an index that tells the OS what files are stored where on the disk. The quickest way of deletion simply removes the entry in that table. The data is still there, though. So a data recovery program would read the entire disk and try to rebuild the file allocation table or whatever by detecting the beginning and ends of files. This worked better on mechanical drives than SSDs.
Yup, and many security suites will include a tool that writes all 0s or garbage to those sectors so the data can’t be recovered as easily (you really need multiple passes for it to be gone for good).
right, i’m super out of date but you;d want to do shred or some dd dev/random > device thing to securely erase them.
A file comes in two parts: the actual blocks of data that hold the file itself, and a directory entry with the name of the file, and the location of the first block.
When you delete a file, it only scrubs out the directory entry, and re-lists the data blocks as available for use.
On ext4 drives 5% is reserved for the system in emergencies. Since disks are getting larger over the year, 5% is a pretty big chunk. It’s possible to tell the system to use a lower reserve. It’s the only instance I know where you can seemingly gain more storage out of thin air. I’ve used it in moments of emergencies when a servers’ disk was too full to function.
From my limited understanding deleting something on a hard drive is just letting your computer know that that space is now available for other data to be stored there. Until something is actually stored there the data isn’t changed.
You can’t use this to increase storage in a computer because the total amount of data allowed on a hard drive doesn’t change when data is deleted. It just moves that stored data to the available section.
Often times when you delete something off a computer, the computer simply deletes the address of the data, but doesn’t overwrite the data.
Think of a map for a city. If you delete a house off the map, you may not be able to find it anymore, but the house is still there. It’s the same for computer storage
Generally speaking, writing new data is what actually erases old data. So no, you can’t exploit it for extra storage space.
It’s because hard drives don’t turn every written bit into a 0. Instead it tells the operating system that the region you deleted is free for writing again.
At some point in the future through usage that region will either be corrupted or have something completely different in it (from our perspective though it may read as corrupt it will still work as expected when written into)
The only way to truly securely delete data is disc destruction. Remove the drive and drill through the hard disk platter or the SSD memory chips.
Even a single overwrite process is sufficient to stop most attempts at recovery- the only people who might be able to reconstruct that data are… like top FBI forensic labs, and similar.
Even then, most of the data would be coming back corrupted and mostly useless.
2 or 3 overwrites are sufficient to prevent that as well.
For SSD’s, a single overwrite renders it impossible, simply based on how the data is physically stored- there’s no residual “footprint” or “ghost”- the NAND flash memory used floating-gate transistors to store the data. Either the gate is flipped or it’s not, there’s no way to know if it was previously flipped, only what its current state is.
Physical destruction is usually only recommended for extreme cases, where that drive held extremely sensitive data- where the consequences of any amount of that data being recovered would be catastrophic, even then the process begins with overwriting data. (Also keep in mind just breaking the platers aren’t enough- they have to be shattered into ittybitties.)
Think the best analogy I can give you is this:
If you write a check and give it to someone, the money has not yet been taken out of your account until they turn that check into cash or deposit it into their bank account.
Until that time, it is something you are keeping a record of to say “I wrote a check for $700 so I am down $700 in my checking account.” Even though the total balance today says $1700, you know that it really is supposed to be $1000 that is available to be used for other expenses.
If you wanted to recover that $700, all you need to do is shred the check before it gets to the bank or check cashing place or contact your bank to tell them to not process this check. Thereby, you have essentially “recovered” the $700 you intended to give to someone else.
This is similar to how your hard drive works. When you tell your computer to delete a file, your computer’s operating system basically tells you that it’s been deleted and no longer lets you access it by normal methods, but that data still exists in a form awaiting an actual deletion. Once you create a new file, your operating system remembers that it had deleted 100MB earlier in the day, so it can now use 25MB of that 100MB it reserved to overwrite some of that file that was deleted, in a sense. However, this whole time, your operating system told you that you had an extra 100MB immediately after you deleted that file, even though it was really being reserved to eventually be replaced.
Your operating system speaks in binary language of 1’s and 0’s and this file existed as a bunch of 1’s and 0’s. When something else got overwritten, it took some of these 1’s and 0’s from the old file to be turned into space for the new file that is to be created.
So as long as it’s recent, no new data has been written to the drive, and the computer hasn’t been restarted, the file is still effectively there in the binary language, just not in plain text to you. However, as time goes on, new data is written, or the computer is restarted, then it becomes much more difficult to restore the file. This is mainly because data is always being written to the drive due to the computer doing other things in the background in addition to the things you do on the computer.
But there isn’t any way to exploit this as this is all due to how much data is available. You have a 1TB drive in your computer and your computer will only ever report 1TB of available storage. It will never report to you that you have more storage unless you’ve done some trickery and even then, it’s just playing with the numbers that you see. Fake USB drives do this where someone sells you what they tell you is 2TB but is actually 16GB and the file has been written to trick the operating system into thinking it has 2TB. If you try to copy more than the actual 16GB of available space, you get an error.
Storage forensics can look into variations in charge to suggest “this used to be a 1” or “this used to be a 0”
To store more data that way, it’d have to be analog data in reality, as otherwise data loss due to charge decay would be immense so you’d need so much error checking you’d lose most of the storage savings
No, there is no way to store more stuff on PCs.
Hard drives are devices that store 1’s and 0’s. There’s a bit more complication, but the short answer is that you can wipe a file system, but the files are still there.
Because you’re operating system is lying to you, for efficiency sake.
Imagine an old school library, books on the shelves, and a Dewey decimal card catalog index in the center.
You want to delete a book, to make room for future books, so you tell the librarian delete this book. And she removes the card from the card catalog index, and turns to you and says the book is gone!
In this scenario the book is still on the shelf, but the index no longer points to it.
Clearly the book isn’t gone, but from your perspective you don’t have to wait for the book to disappear, and the librarian knows eventually she’s going to clean the shelf, and remove whatever isn’t in the index.
That’s more or less, with a lot of hand wave in, what operating systems do for file systems.
Great analogy!
Thanks for taking the time to explain it in such a way!
In this analogy, when you add a new book, only then is that “deleted” book actually removed and replaced with the new one. Until then, it just sits there waiting, but since nothing is pointing to it, it’s hard to find.
When someone recovers a file, what they’re doing is going book by book and reconciling the index to see if there’s anything missing. Since this book still exists, it can be recovered.
To extend this a little further, computers also don’t actually store books, they store blocks.
For example, you have a computer that can store 50 blocks of information. You store “Moby Dick”, taking up 20 blocks & “Tom Sawyer”, taking another 20 blocks.
Next you decide you don’t like “Moby Dick”, so you delete it. You also decide you want to store an ice cream menu, taking up just 1 block.
That menu will be stored based on where the computer thinks the block fits best. So you might have 20 blocks that still contain “Moby Dick”, or you might have only 19 blocks that contain most of “Moby Dick”, but it might be missing the beginning, middle or end.
If I were doing data recovery I might not be able to provide you with the complete “Moby Dick” story. I might only be able to give you part of it.
Looking into why blocks, let’s say you’re writing up the first draft of a book report, it might take up 4 blocks. Then later you edit, improve and add to that that book report, and now it takes 5 blocks. The computer took care of making space, even though your report got larger. It didn’t know if you were going to add 1 new block of information, or 1000 new blocks of information, it figured it out and did the rearranging for you.
However when it comes time for you to look at it, it automatically knows how to put it together. (And usually it does group things together if it can).
This is important to keep in mind when it comes to data recovery because the more you use your computer the more likely blocks are allocated and data gets moved around.
If you delete important photos, then spend the weekend surfing the Internet, those photos might be gone. Or if they are available, might only be partially available.
If you remember the VCR days, imagine your hard drive is a copy of Bambi. You, in preparation for a family event need a tape to store footage of the event on. You decided that you haven’t watched or wanted to watch Bambi in a long time so you designate that tape as the one you’re gonna use when the party day comes.
At this point your hard drive (the copy of Bambi) has been designated as useable space for new data to be written in the future.
Bambi is not lost yet and wont be until you write to that tape, therefore if you wanted to you could watch Bambi in the time between now and the party even though you plan to overwrite it. Once Bambi is overwritten, its no longer recoverable but the interim between now when you designate it as useable space and when the space is used, the data persists.
Cos ur computer is lying to u. When u delete a file it doesnt actually delete it it just marks that section of disk as deleted that will eventually be overwritten at some point in a future.
