The input text needs to be lemmatized, i.e. 'running' -> 'run'. Careful consideration needs to be applied here because some words still won't be converted successfully. During my initial testing, words of length four or less seemed to have the greatest inaccuracy. For example, using the NLTK package, 'us' gets lemmatized to 'u'.
The input text needs to be lemmatized, i.e. 'running' -> 'run'. Careful consideration needs to be applied here because some words still won't be converted successfully. During my initial testing, words of length four or less seemed to have the greatest inaccuracy. For example, using the NLTK package, 'us' gets lemmatized to 'u'.