FileBase	PeterP-2013-10-10_dataset1.kwik
ElecNo	15
UseFeatures	
DropLastNFeatures	0
UseDistributional	1
MaskStarts	100
MinClusters	100
MaxClusters	110
MaxPossibleClusters	500
nStarts	1
StartCluFile	
SplitEvery	100
SplitFirst	20
PenaltyK	0.000000
PenaltyKLogN	1.000000
Subset	1
FullStepEvery	10
MaxIter	10000
RandomSeed	654
Debug	0
SplitInfo	1
Verbose	1
DistDump	0
DistThresh	6.907755
ChangedThresh	0.050000
Log	1
Screen	1
PriorPoint	1
SaveSorted	0
SaveCovarianceMeans	0
UseMaskedInitialConditions	1
AssignToFirstClosestMask	1
RamLimitGB	0.000000
help	0
help	0
Setting RAM limit to total physical memory, 16.00 GB.
WARNING: Not all physical memory will be available, but on Macs it is not possible
         to get the available physical memory.
-------------------------------------------------------------------------
Using Distributional EM with Maskstarts
NOTE: Maskstarts overides above values of MinClusters and MaxClusters                 
MinClusters = 100 
MaxClusters = 100 
 This run is expected to use between 0.01 and 0.02 GB of RAM.
Memory request: 0.01 GB would take us to total of 0.01 GB.
----------------------------------------------------------
Loaded 843 data points of dimension 25.
MEMO: A lower score indicates a better clustering 
 Masked EM: Computing Noise Means and Variances 
 -----------------------------------------
Starting from 100 clusters...
------ Clustering full data set of 843 points ------
Starting initial clusters from distinct float masks 
 Not enough masks (26) to generate starting clusters (100), so starting with (27) clusters instead.
Assigned 27 initial classes from 26 unique masks.
Deleting Class 21 (1 points): Lose 5.062533 but Gain 1052.239042
Iteration 0F (0.027581 sec): 26 clusters Score: Raw -15061.466814 + Penalty 14569.178125 = -492.288689 nChanged 53
Deleting Class 15 (4 points): Lose 46.761329 but Gain 935.256865
Iteration 1F (0.038473 sec): 25 clusters Score: Raw -15122.780014 + Penalty 13761.750683 = -1361.029331 nChanged 11
Deleting Class 24 (1 points): Lose 5.259080 but Gain 844.784127
Iteration 2Q (0.040999 sec): 24 clusters Score: Raw -15155.146466 + Penalty 12906.427793 = -2248.718673 nChanged 3
Deleting Class 26 (1 points): Lose 6.915247 but Gain 828.317336
Iteration 3Q (0.043345 sec): 23 clusters Score: Raw -15152.584034 + Penalty 12095.316469 = -3057.267565 nChanged 4
Deleting Class 18 (2 points): Lose 16.482394 but Gain 836.525284
Iteration 4Q (0.045671 sec): 22 clusters Score: Raw -15143.054566 + Penalty 11339.923473 = -3803.131092 nChanged 6
Deleting Class 16 (2 points): Lose 18.783542 but Gain 802.798059
Iteration 5Q (0.047957 sec): 21 clusters Score: Raw -15160.350655 + Penalty 10555.680729 = -4604.669926 nChanged 4
Deleting Class 14 (1 points): Lose 5.102417 but Gain 741.163681
Iteration 6Q (0.050128 sec): 20 clusters Score: Raw -15165.476450 + Penalty 9822.791293 = -5342.685157 nChanged 5
Deleting Class 17 (1 points): Lose 0.788979 but Gain 677.696182
Iteration 7Q (0.052294 sec): 19 clusters Score: Raw -15174.749082 + Penalty 9134.620425 = -6040.128657 nChanged 5
Deleting Class 20 (1 points): Lose 3.232953 but Gain 667.765803
Iteration 8Q (0.054474 sec): 18 clusters Score: Raw -15177.352228 + Penalty 8472.773636 = -6704.578593 nChanged 4
Deleting Class 6 (11 points): Lose 96.517899 but Gain 726.033137
Iteration 9Q (0.056557 sec): 17 clusters Score: Raw -15085.271796 + Penalty 7809.642262 = -7275.629535 nChanged 13
Deleting Class 12 (8 points): Lose 60.068770 but Gain 679.587597
Iteration 10F (0.065210 sec): 16 clusters Score: Raw -15076.347180 + Penalty 7157.811860 = -7918.535320 nChanged 8
Deleting Class 22 (4 points): Lose 33.180376 but Gain 651.630015
Iteration 11Q (0.067495 sec): 15 clusters Score: Raw -15059.822550 + Penalty 6525.551022 = -8534.271528 nChanged 4
Deleting Class 3 (19 points): Lose 77.297433 but Gain 671.094707
Iteration 12Q (0.069610 sec): 14 clusters Score: Raw -14993.415692 + Penalty 5927.608271 = -9065.807421 nChanged 21
Deleting Class 9 (10 points): Lose 83.209394 but Gain 635.863691
Iteration 13Q (0.071776 sec): 13 clusters Score: Raw -14952.784232 + Penalty 5302.290776 = -9650.493456 nChanged 12
Deleting Class 19 (1 points): Lose 1.788181 but Gain 544.095924
Iteration 14Q (0.074022 sec): 12 clusters Score: Raw -14973.085809 + Penalty 4766.270473 = -10206.815336 nChanged 3
Deleting Class 23 (1 points): Lose 2.829505 but Gain 530.179516
Iteration 15Q (0.076031 sec): 11 clusters Score: Raw -14973.288870 + Penalty 4235.506955 = -10737.781915 nChanged 2
Deleting Class 13 (4 points): Lose 26.625790 but Gain 539.820347
Iteration 16Q (0.078044 sec): 10 clusters Score: Raw -14949.422637 + Penalty 3705.953911 = -11243.468727 nChanged 6
Deleting Class 8 (16 points): Lose 110.715301 but Gain 618.480639
Iteration 17Q (0.079949 sec): 9 clusters Score: Raw -14846.511950 + Penalty 3099.706931 = -11746.805019 nChanged 18
Deleting Class 25 (1 points): Lose 2.145067 but Gain 483.813408
Iteration 18Q (0.081831 sec): 8 clusters Score: Raw -14887.073541 + Penalty 2621.858286 = -12265.215254 nChanged 6
Deleting Class 2 (43 points): Lose 155.129626 but Gain 616.682911
Iteration 19Q (0.083617 sec): 7 clusters Score: Raw -14758.089179 + Penalty 2056.752105 = -12701.337074 nChanged 50
Writing temp clu file 
Memory request: 0.01 GB would take us to total of 0.01 GB.
Compute initial score before splitting: Score: Raw -14758.089179 + Penalty 2056.752105 = -12701.337074Memory request: 0.01 GB would take us to total of 0.02 GB.

 Trying to split cluster 1 (763 points) 
	SP: Assigned 2 initial classes randomly.
		SP:Iteration 0F (0.093363 sec): 2 clusters Score: Raw -14109.769703 + Penalty 268.260585 = -13841.509118 nChanged 0
	SP: Assigned 3 initial classes randomly.
		SP:Iteration 0F (0.095244 sec): 3 clusters Score: Raw -13696.236851 + Penalty 549.236535 = -13147.000316 nChanged 310
		SP:Iteration 1F (0.096938 sec): 3 clusters Score: Raw -13988.282631 + Penalty 557.104682 = -13431.177949 nChanged 79
		SP:Iteration 2F (0.098577 sec): 3 clusters Score: Raw -14089.258628 + Penalty 553.203296 = -13536.055332 nChanged 58
		SP:Iteration 3F (0.100196 sec): 3 clusters Score: Raw -14162.166137 + Penalty 549.772808 = -13612.393330 nChanged 41
		SP:Iteration 4F (0.101820 sec): 3 clusters Score: Raw -14225.776517 + Penalty 544.995125 = -13680.781392 nChanged 34
		SP:Iteration 5Q (0.103353 sec): 3 clusters Score: Raw -14308.558002 + Penalty 543.593995 = -13764.964007 nChanged 25
		SP:Iteration 6Q (0.104838 sec): 3 clusters Score: Raw -14352.252872 + Penalty 543.312239 = -13808.940633 nChanged 13
		SP:Iteration 7Q (0.106272 sec): 3 clusters Score: Raw -14364.359305 + Penalty 544.013375 = -13820.345930 nChanged 4
		SP:Iteration 8Q (0.107686 sec): 3 clusters Score: Raw -14369.621162 + Penalty 544.024037 = -13825.597126 nChanged 2
		SP:Iteration 9Q (0.109103 sec): 3 clusters Score: Raw -14372.448207 + Penalty 544.307585 = -13828.140623 nChanged 1
		SP:Iteration 10F (0.110724 sec): 3 clusters Score: Raw -14373.277364 + Penalty 544.307585 = -13828.969780 nChanged 0
Memory request: 0.00 GB would take us to total of 0.02 GB.

 Trying to split cluster 4 (10 points) 
	SP: Assigned 2 initial classes randomly.
		SP:Iteration 0F (0.111306 sec): 2 clusters Score: Raw -253.506430 + Penalty 163.286573 = -90.219857 nChanged 0
	SP: Assigned 3 initial classes randomly.
		SP:Iteration 0F (0.111536 sec): 3 clusters Score: Raw -264.690829 + Penalty 326.573146 = 61.882317 nChanged 0
Memory request: 0.00 GB would take us to total of 0.02 GB.

 Trying to split cluster 5 (10 points) 
	SP: Assigned 2 initial classes randomly.
		SP:Iteration 0F (0.111994 sec): 2 clusters Score: Raw -210.856255 + Penalty 127.628899 = -83.227356 nChanged 0
	SP: Assigned 3 initial classes randomly.
		SP:Iteration 0F (0.112224 sec): 3 clusters Score: Raw -230.000939 + Penalty 250.254647 = 20.253708 nChanged 0
Memory request: 0.00 GB would take us to total of 0.02 GB.

 Trying to split cluster 7 (44 points) 
	SP: Assigned 2 initial classes randomly.
		SP:Iteration 0F (0.112867 sec): 2 clusters Score: Raw -1046.578659 + Penalty 149.700677 = -896.877983 nChanged 0
	SP: Assigned 3 initial classes randomly.
		SP:Iteration 0F (0.113161 sec): 3 clusters Score: Raw -1041.287936 + Penalty 305.780828 = -735.507109 nChanged 7
		SP:Iteration 1F (0.113483 sec): 3 clusters Score: Raw -1047.573543 + Penalty 305.768239 = -741.805304 nChanged 2
		SP:Iteration 2Q (0.113766 sec): 3 clusters Score: Raw -1048.888694 + Penalty 309.913550 = -738.975144 nChanged 2
		SP:Iteration 3F (0.114052 sec): 3 clusters Score: Raw -1051.594618 + Penalty 314.844372 = -736.750246 nChanged 1
		SP:Iteration 4F (0.114337 sec): 3 clusters Score: Raw -1052.320407 + Penalty 317.566552 = -734.753856 nChanged 1
		SP:Iteration 5F (0.114624 sec): 3 clusters Score: Raw -1052.617343 + Penalty 317.566552 = -735.050792 nChanged 0
Memory request: 0.00 GB would take us to total of 0.02 GB.

 Trying to split cluster 10 (9 points) 
	SP: Assigned 2 initial classes randomly.
		SP:Iteration 0F (0.115081 sec): 2 clusters Score: Raw -181.335430 + Penalty 57.275704 = -124.059726 nChanged 0
	SP: Assigned 3 initial classes randomly.
		SP:Iteration 0F (0.115307 sec): 3 clusters Score: Raw -186.532735 + Penalty 116.120269 = -70.412467 nChanged 0
Memory request: 0.00 GB would take us to total of 0.02 GB.

 Trying to split cluster 11 (7 points) 
	SP: Assigned 2 initial classes randomly.
		SP:Iteration 0F (0.115757 sec): 2 clusters Score: Raw -193.070043 + Penalty 141.869137 = -51.200906 nChanged 0
	SP: Assigned 3 initial classes randomly.
		SP:Iteration 0F (0.115978 sec): 3 clusters Score: Raw -190.385927 + Penalty 264.904444 = 74.518516 nChanged 0
Deleting Class 11 (7 points): Lose 35.580283 but Gain 491.167430
Iteration 20F (0.119662 sec): 6 clusters Score: Raw -14815.514225 + Penalty 1554.283512 = -13261.230713 nChanged 15
Deleting Class 4 (10 points): Lose 26.607893 but Gain 477.748357
Iteration 21Q (0.121401 sec): 5 clusters Score: Raw -14815.691812 + Penalty 1076.364728 = -13739.327083 nChanged 22
Deleting Class 5 (9 points): Lose 54.409187 but Gain 374.564684
Iteration 22Q (0.123118 sec): 4 clusters Score: Raw -14795.828904 + Penalty 719.501428 = -14076.327476 nChanged 22
Deleting Class 10 (9 points): Lose 40.086658 but Gain 175.614514
Iteration 23Q (0.124663 sec): 3 clusters Score: Raw -14786.886249 + Penalty 539.778543 = -14247.107706 nChanged 17
Deleting Class 7 (87 points): Lose 244.569897 but Gain 263.815486
Iteration 24Q (0.126171 sec): 2 clusters Score: Raw -14561.412582 + Penalty 276.411117 = -14285.001465 nChanged 82
Iteration 25F (0.127596 sec): 2 clusters Score: Raw -14672.835082 + Penalty 276.411117 = -14396.423965 nChanged 0
Writing temp clu file 
Memory request: 0.01 GB would take us to total of 0.01 GB.
Compute initial score before splitting: Score: Raw -14672.835082 + Penalty 276.411117 = -14396.423965Memory request: 0.01 GB would take us to total of 0.02 GB.

 Trying to split cluster 1 (843 points) 
	SP: Assigned 2 initial classes randomly.
		SP:Iteration 0F (0.133851 sec): 2 clusters Score: Raw -15456.708870 + Penalty 276.411117 = -15180.297753 nChanged 0
	SP: Assigned 3 initial classes randomly.
		SP:Iteration 0F (0.135672 sec): 3 clusters Score: Raw -14985.603928 + Penalty 552.192316 = -14433.411612 nChanged 324
		SP:Iteration 1F (0.137462 sec): 3 clusters Score: Raw -15236.480333 + Penalty 544.868989 = -14691.611345 nChanged 107
		SP:Iteration 2F (0.139248 sec): 3 clusters Score: Raw -15313.530569 + Penalty 538.387232 = -14775.143337 nChanged 46
		SP:Iteration 3F (0.141073 sec): 3 clusters Score: Raw -15343.327034 + Penalty 535.647869 = -14807.679165 nChanged 26
		SP:Iteration 4Q (0.142928 sec): 3 clusters Score: Raw -15368.221274 + Penalty 534.906359 = -14833.314915 nChanged 29
		SP:Iteration 5Q (0.144878 sec): 3 clusters Score: Raw -15390.434820 + Penalty 536.672909 = -14853.761910 nChanged 30
		SP:Iteration 6Q (0.146770 sec): 3 clusters Score: Raw -15432.937130 + Penalty 538.163336 = -14894.773795 nChanged 44
		SP:Iteration 7F (0.148603 sec): 3 clusters Score: Raw -15518.938609 + Penalty 540.162396 = -14978.776213 nChanged 41
		SP:Iteration 8Q (0.150461 sec): 3 clusters Score: Raw -15593.151877 + Penalty 541.607782 = -15051.544095 nChanged 23
		SP:Iteration 9Q (0.152121 sec): 3 clusters Score: Raw -15611.502685 + Penalty 541.521332 = -15069.981353 nChanged 10
		SP:Iteration 10F (0.153921 sec): 3 clusters Score: Raw -15618.384872 + Penalty 541.575385 = -15076.809487 nChanged 9
		SP:Iteration 11Q (0.155573 sec): 3 clusters Score: Raw -15631.464638 + Penalty 541.842767 = -15089.621871 nChanged 10
		SP:Iteration 12Q (0.157204 sec): 3 clusters Score: Raw -15638.930284 + Penalty 542.442907 = -15096.487377 nChanged 5
		SP:Iteration 13Q (0.158824 sec): 3 clusters Score: Raw -15640.838264 + Penalty 542.938789 = -15097.899475 nChanged 3
		SP:Iteration 14Q (0.160456 sec): 3 clusters Score: Raw -15642.079833 + Penalty 542.938789 = -15099.141045 nChanged 0
		SP:Iteration 15F (0.162244 sec): 3 clusters Score: Raw -15642.079833 + Penalty 542.938789 = -15099.141045 nChanged 0
Time taken for this iteration:0.147218 seconds.
 100->2 Clusters: Score -14396.423965, best is 100000000000000005366162204393472.000000
THE BEST YET!

Main iterations: 26 (time per iteration =6.275192 ms)
Total iterations: 70 (time per iteration =2.330786 ms)

Def. Iteration metric 2:
Iteration_metric2 += (scalar)(nDims*nDims)*(scalar)(nPoints)
Iterations metric 2: 28615625.000000 (time per metric unit =5.701605ns)

Def. Iteration metric 3:
Iteration_metric3 += (scalar)(nDims*nDims)*(scalar)(nDims*nPoints)
Iterations metric 3: 715390625.000000 (time per metric unit=228.064213ps)

That took 0.163155 seconds.