The statements from some banks provide transaction details with line breaks (at times the parsing from tabula might result in splitting one transaction entry as two transactions with either NaN or empty cells) - e.g. when tabula-py is used for parsing Canadian TD bank CC statements, it results in dummy rows with invalid data.
It would be helpful if there was a way to provide a validation function at row level (optionally column level) to identify if the row can be considered for further processing or dropped (could be logged to the console as an error or warning or info).
While this can be made part of the library for consumers of library, for command line tool, need to figure out how can they provide the validation function (via config? if so assume they can provide python functions, that can accept the dataframe or the row entry? and return a boolean)
The statements from some banks provide transaction details with line breaks (at times the parsing from tabula might result in splitting one transaction entry as two transactions with either NaN or empty cells) - e.g. when tabula-py is used for parsing Canadian TD bank CC statements, it results in dummy rows with invalid data.
It would be helpful if there was a way to provide a validation function at row level (optionally column level) to identify if the row can be considered for further processing or dropped (could be logged to the console as an error or warning or info).
While this can be made part of the library for consumers of library, for command line tool, need to figure out how can they provide the validation function (via config? if so assume they can provide python functions, that can accept the dataframe or the row entry? and return a boolean)