Over the years, I’ve downloaded a lot of old emails to my laptop, which I saved as .eml files and then converted to .docx, .odt, and .txt files (mostly the last two).
The unfortunate habit of almost everyone (including myself, but no longer!) of quoting the original message as part of an email exchange has left me with text file(s) full of repeated sentences and paragraphs. What I’ve tended to do is to dump all the text from a one on one correspondence into a single file (“Dad-Erinaceus Complete Correspondence.odt,” for example) and then try cleaning it up and re-ordering the messages by date.
Apart from the emails, I have I guess what you’d call a “journal” which is a very long .odt file that runs to about 300 pages or so. Much of this has the same sentences and paragraphs over and over again, but sometimes with slight variations that I would like to keep. So far, in either .odt or .txt files, I’ve started by searching for the first sentence, deleting subsequent appearances of it, and then going on to the next sentence, and so forth. Very time consuming! Is there a faster (and safe) way to do this?
There is quite possibly a very simple solution to this that I haven’t thought of, but I’d be much obliged for any suggestions.
Text, as far as I know (?) doesn’t take up that much space memory-wise, but on the other hand can you imagine the amount of server space that gets taken up by redundant text from people’s emails (just for starters)?
Some of my approaches to the apparently much-hated “Inbox Zero” are to be diligent about emptying the trash, not keeping copies of emails in my sent folder, and most importantly, to download messages, personal or professional ones (mostly the former) that I find personally valuable, and then delete the original email so it isn’t floating around forever in cyberspace. This leaves me with lots of txt files, which, as I said above, I then merge all together into one file and then edit. You’d think that there’d be a tool that cleans up the contents of email messages; there do appear to be some online ones, but I don’t trust them. While researching this problem, I found out about “(g)awk” and am now fiddling around with it to see if I can successfully clean up my files without completely messing them up, as in
awk '!seen[$0]++' input.txt > output.txtmaking sure that I experiment on a duplicated file and not on the original. I barely know what I’m doing here, but I’ll see what I can come up with . . .
Inbox zero doesn’t mean deleting all your emails lol. It just means getting them out of your inbox. I do this myself. For each email in my inbox I “do something” with it instead of just leaving it there. Put it in a folder, tag it, spam, delete, archive, anything. Personally I use 3 zones:
🙂👍