Error in some files

[akomaty]

Hi Srikanth,

I am experiencing some errors with some AMIcorpus meetings. I have two types of errors:

1. Error aborting the process of the meeting, that is, I am getting only one output file named for example: EN2002b.out
   The error I am getting is below:

*** Error in `/idiap/temp/msrikanth/repo/idiap-aib-diarization-dimseng/src/diarization/cmake/diarizeme': free(): invalid next size (normal): 0x0000000000a42450 ***
scripts/run.diarizeme.qsub.sh: line 23: 31727 Aborted                 $diarizeme_bin --mfcc $fname 1.0 --recid $fileid --outdir $opdir --tmpdir $opdir -s $scpfile --beta $beta_val --nthread 1 > $opdir/$fileid.out

And the content of the file EN2002b.out is as follows

AIB diarization started at 412620 
 MFCC:   /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2002b/audio/EN2002b.fea  weight MFCC  1 

 Maximum Segment Duration 250 

 AIB is running with the following parameters

 Maximum number of clusters possible: 		10
 Normalized Mutual Information threshold: 		0.5
 Beta value: 		10
 Number of threads: 		1
 Reading and Processing the scp file 
number of segments inside = 411

2. The other type of errors is not resulting the job to fail, but resulting in very bad results (DER close to 50%). An example of this type of errors is below:

AIB diarization started at 412620 


 MFCC:   /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea  weight MFCC  1 

 Maximum Segment Duration 250 


 AIB is running with the following parameters

 Maximum number of clusters possible: 		10
 Normalized Mutual Information threshold: 		0.5
 Beta value: 		10
 Number of threads: 		1


 Reading and Processing the scp file 
number of segments inside = 1046
Number of vectors = 459253
Feat file /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea of type 0
Reading feature file /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea
frame dim: 60
num_vec = 459253
Attempting memory allocation.
Memory successully allocated.
Reading file ... 
all segments read 
Number of segments in the file = 2386
num_vec = 459253  idx = 0
compute features after: 360.412


 The matrix seems ok
 Final Matrix size after zero removal 2386 2347  
 The initial MI values are: 2.42627 7.77737 6.6303 
 Initializing the Delta -- Computing 2386 times 2386 Distances 
Running time 2120  


 Now Clustering 

 Size: 9 Ity: 0.40674 Ht: 1.795 Ity_div_Itx:  0.16764  Ht_div_Hx:   0.230797
 Size: 8 Ity: 0.391269 Ht: 1.73898 Ity_div_Itx:  0.161264  Ht_div_Hx:   0.223595
 Size: 7 Ity: 0.362831 Ht: 1.56077 Ity_div_Itx:  0.149543  Ht_div_Hx:   0.200681
 Size: 6 Ity: 0.346579 Ht: 1.52719 Ity_div_Itx:  0.142845  Ht_div_Hx:   0.196363
 Size: 5 Ity: 0.329093 Ht: 1.4868 Ity_div_Itx:  0.135638  Ht_div_Hx:   0.19117
 Size: 4 Ity: 0.304532 Ht: 1.37854 Ity_div_Itx:  0.125514  Ht_div_Hx:   0.17725
 Size: 3 Ity: 0.27046 Ht: 1.25452 Ity_div_Itx:  0.111472  Ht_div_Hx:   0.161304
 Size: 2 Ity: 0.225623 Ht: 1.07816 Ity_div_Itx:  0.0929918  Ht_div_Hx:   0.138628
 Size: 1 Ity: 0.142102 Ht: 0.566667 Ity_div_Itx:  0.0585682  Ht_div_Hx:   0.072861

 Size: 0 Ity: 4.7339e-10 Ht: 4.83391e-13 Ity_div_Itx:  1.9511e-10  Ht_div_Hx:   6.21535e-14
Saving this solution 
0  4.7339e-10  2.42627  1.9511e-10  
1  0.142102  2.42627  0.0585682  
2  0.225623  2.42627  0.0929918  
3  0.27046  2.42627  0.111472  
4  0.304532  2.42627  0.125514  
5  0.329093  2.42627  0.135638  
6  0.346579  2.42627  0.142845  
7  0.362831  2.42627  0.149543  
8  0.391269  2.42627  0.161264  
9  0.40674  2.42627  0.16764  
Key to solution 10 NMI value0.5  
 The clustering has finished. Now saving the solution in /idiap/temp/akomaty/AMI_prep_feat/result.dir/EN2005a.clust.out
 ...and saying goodbye 


last speech frame = 529794 total number of speech frames = 459253
training the rkl hmm 
ERROR!!!!
ERROR!!!!
ERROR!!!!
ERROR!!!!
.
.
.
ERROR!!!!
ERROR!!!!
Segmentation Over with Viterbi score = -2514638.750000
The htk file sample rate 100000 
Diarization stopped at 412622  
Running time 5886 seconds  
compute features after: 360.412
aib clustering after: 4198.59
realignment after: 145.14

P.S.: The number of lines mentioning ERROR!!!! is: 378898

[mrsrikanth]

Hi Alain,

I need the scp files to be able to reproduce it. Perhaps you could point me to them in a private e-mail?

Srikanth