Sample Bank Statements

[flywire]

Include Sample Bank Statements for testing

[marlanperumal]

Thanks - these will be useful to add some sample configs for

[flywire]

Citibank Loan:
https://www.citibank.com.au/readmystatement/views/images/page1.jpg
https://www.citibank.com.au/readmystatement/views/images/page2.jpg

[flywire]

Mock bank statement template set up in LibreOffice Calc with Tools, Option, LibreOffice Calc, General, Measurement unit: point. Checked in SumatraPDF using m to show cursor coordinates.

    "layout": {
        "default": {
            "area": [280, 27, 763, 576],
            "columns": [83, 264, 344, 425, 485, 570]
        },
        "first": {
            "area": [480, 27, 763, 576],
            "columns": [83, 264, 344, 425, 485, 570]
        }
    },

[Edit: Updated following files:]

MockTemplate.xlsx
MockTemplate.pdf

---

Note: For scaling measurements - A4 is 210mm x 297mm and there are 72 points/inch so A4 is 595.275 x 841.8892 points

[flywire]

json file comments allow new config to be setup quickly and easily in text editor.

Draft config follows. Year is given as first word of first Transaction.

config\cba\saving.json

{
    "$schema": "https://raw.githubusercontent.com/marlanperumal/pdf_statement_reader/develop/pdf_statement_reader/config/psr_config.schema.json",
    "//": "Describe layout for pages to be scanned",
    "layout": { 
        "//": "Default layout for all pages not otherwise defined",
        "default": {
            "//": "Page coordinates containing table in pts",
            "//": "[top, left, bottom, right]",
            "area": [143, 58, 760, 546],
            "//": "Right x coordinate of each column in table",
            "columns": [93, 344, 402, 460, 546]
        },
        "//": "Layout for first page",
        "first": {
            "area": [385, 58, 760, 546],
            "columns": [93, 344, 402, 460, 546]
        }
    },

    "//": "Statement column names exactly as they appear",
    "columns": {
        "trans_date": "Date",
        "trans_type": "Transaction",
        "debit": "Debit",
        "credit": "Credit",
        "balance": "Balance"
    },

    "//": "csv column output order",
    "order": [
        "trans_date",
        "trans_type",
        "debit",
        "credit",
        "balance"
    ],

    "//": "Specify required cleaning operations",
    "cleaning": {
        "//": "Convert these columns to numeric",
        "numeric": ["debit", "credit", "balance"],
        "//": "Convert these columns to date",
        "date": ["trans_date"],
        "//": "Use this date format to parse any date columns",
        "date_format": "%d mmm",
        "//": "Only keep the rows where these columns are populated",
        "dropna": ["balance"]
    }
}

Edit: Column mistakenly entered at left margin removed.

[marlanperumal]

The config file is documented in the json schema file. I don't like the use of the duplicate "//" keys as that could use unforeseen bugs in the parsing. I might be open to looking at using the jsonc format if I can find a stable python library that supports it properly.