• kescusay@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    15 hours ago

    Yes, it’s base64. And what’s behind it could be anything that can be attached to an email.

    In this case, it’s a PDF. If the base64 text can be extracted accurately, then the PDF that was attached to the email can be recreated.

    The challenge is basically twofold:

    1. There’s a lot of text, and it needs to be extracted perfectly. Even one character being wrong corrupts it and makes it impossible to decode.
    2. As the article points out, there are lots of visual problems with the encoded text, including the shitty font it’s displayed with, which makes automating the extraction damn near impossible. OCR is very good these days, but this is kind of a perfect example of text that it has trouble with.

    As for my approach, I’m basically just slowly and painstakingly running several OCR tools on small bits at a time, merging the resulting outputs, and doing my best to correct mistakes manually.

    • trolololol@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      13 hours ago

      Ah yes pdf is a clusterfuck where anything is valid I think, so minimal redundancy.

      Text and image formats are way more lenient and are full of redundancies.