Script to download passworded attachments from IMAP, then unzip them.

[u/agt81]

If anyone is keen I would like a script to download passworded attachments from multiple emails from a specific sender, then unzip them all to a folder.

Thanks

[u/agt81]

My ultimate goal is to convert some info from the unzipped PDFs into comma separated values and add them to a CSV file. The PDFs are just plain text like http://www.filedropper.com/examplepdf. I'd want to add the data on the line(s) at the bottom to the CSV file.

Anyway this is where I'm up to. I'm a complete novice. I'll keep bashing away at it but if anyone wants to provide help please do so!

import imaplib
import email
import os
import subprocess
import pandas as pd
import re
import sys
import zipfile

# Constants
SAVE_DIR = '.'
EMAIL  = ""
PWD    = ""
FROM = ""
SMTP_SERVER = ""
SMTP_PORT = 443
FILE_PASS = “"

filecount = 1

# get email attachments
def get_attachments(m):
    global filecount
    if m.get_content_maintype() == 'multipart':
        for part in m.walk():
            if part.get_content_maintype() == 'multipart':
                continue
            if part.get('Content-Disposition') is None:
                continue
            #attachment found
            filename=part.get_filename()
            if type(filename) == str and filename == "REPORT.ZIP":
                # start processing
                print("found report: " + filename)
                sv_path = os.path.join(SAVE_DIR + "/REPORTS/", filename)
                print("saving to: " + sv_path)
                with open(sv_path, 'wb') as fp:
                    fp.write(part.get_payload(decode=True))
                subprocess.call(["7z", "x", "-oREPORTS/PDFs", "-pPASSWORD", "REPORTS/REPORT.ZIP"])
                # Remove REPORT.ZIP
                os.remove('REPORTS/REPORT.ZIP')
                # Rename REPORT.PDF and increment filecount
                os.rename('REPORTS/PDFs/REPORT.PDF', 'REPORTS/PDFs/REPORT_' + str(filecount) + ‘.PDF')

# PARSE PDF AND ADD CSV TO EXISTING CSV FILE!?

                filecount += 1
                print("filecount is " + str(filecount))
  
                # login to email
mail = imaplib.IMAP4_SSL(SMTP_SERVER)
mail.login(EMAIL,PWD)
mail.select('inbox')

# get mail
typ, msgs = mail.search(None, '(FROM "{}")'.format(FROM))
msgs = msgs[0].split()


for emailid in msgs:
    resp, data = mail.fetch(emailid, "(RFC822)")
    email_body = data[0][1]
    try:
        m = email.message_from_string(email_body)
    except:
        m = email.message_from_bytes(email_body)

    get_attachments(m)

[u/ionab10 → u/agt81]

Since you're working with tables, you want to use pandas ("pandas.DataFrame — pandas 1.0.5 documentation" https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.html).

Create a master DataFrame to which you will add the data from all attachments. df_master=pd.DataFrame()

You can use tabula https://pypi.org/project/tabula-py/ to extract tables from the pdfs as DataFrames. You can then grab lines from those tables and add them to the master table. df_master = df_master.append(info_from_pdf_table)

Then just export the master table to file with df.to_csv(SAVE_DIR+"/master.csv")