Use primitive collections for optimize pass

Currently optimization uses standard Collections in the data structures, this could be optimized (avoiding auto-boxing/unboxing) by using suitable primitive variants, for example from https://fastutil.di.unimi.it/