Memory corruption with slighthly bigger alphabets.

[c4f3a0ce]

When I try to use Trie with larger alphabet I start to experience different memory related issue. Details differ from Python version to Python version, and environment, but in general following:

import datrie

xs = [chr(i) for i in range(500)]

datrie.Trie(xs[:250])  # Works fine
datrie.Trie(xs[250:])  # Works fine

datrie.Trie(xs)  # Fails miserably 

fails when executed as script with:

malloc(): invalid size (unsorted)
[1]    19260 abort      python foo.py

In IPython I got:

corrupted double-linked list                                                                                                                                                    
[1]    19270 abort      ipython

or

malloc(): invalid size (unsorted)
[1]    19364 abort      ipython

and some other, less common failures.

This specific outcomes tested with

• datrie==0.8
• Python 3.7.3
• IPython 7.10.1

Is this something expected?

[c4f3a0ce]

After further investigation it seems it might be related to tlwg/libdatrie#6.

I've updated and rebuild the package from fa3cfc3 by updating libdatrie submodule to tlwg/libdatrie@6ef4485 and the problem disappears.

[BarnabasSzabolcs]

Hi @superbobry , can you please merge this improvement?