In Java7, the factorie tokenizer fails when a single token has 2000 characters

[dirkgr]

[schmmd]

Doesn't strike me as a huge problem ;-)

On Thu, Aug 14, 2014 at 5:54 PM, Dirk Groeneveld notifications@github.com
wrote:

—
Reply to this email directly or view it on GitHub
#72.

[dirkgr]

I didn't properly find out what the lower limit is, but nobody has found it yet.