FileBase PeterP-2013-10-10_dataset1.kwik ElecNo 16 UseFeatures DropLastNFeatures 0 UseDistributional 1 MaskStarts 100 MinClusters 100 MaxClusters 110 MaxPossibleClusters 500 nStarts 1 StartCluFile SplitEvery 100 SplitFirst 20 PenaltyK 0.000000 PenaltyKLogN 1.000000 Subset 1 FullStepEvery 10 MaxIter 10000 RandomSeed 654 Debug 0 SplitInfo 1 Verbose 1 DistDump 0 DistThresh 6.907755 ChangedThresh 0.050000 Log 1 Screen 1 PriorPoint 1 SaveSorted 0 SaveCovarianceMeans 0 UseMaskedInitialConditions 1 AssignToFirstClosestMask 1 RamLimitGB 0.000000 help 0 help 0 Setting RAM limit to total physical memory, 16.00 GB. WARNING: Not all physical memory will be available, but on Macs it is not possible to get the available physical memory. ------------------------------------------------------------------------- Using Distributional EM with Maskstarts NOTE: Maskstarts overides above values of MinClusters and MaxClusters MinClusters = 100 MaxClusters = 100 This run is expected to use between 0.01 and 0.01 GB of RAM. Memory request: 0.00 GB would take us to total of 0.00 GB. ---------------------------------------------------------- Loaded 528 data points of dimension 25. MEMO: A lower score indicates a better clustering Masked EM: Computing Noise Means and Variances ----------------------------------------- Starting from 100 clusters... ------ Clustering full data set of 528 points ------ Starting initial clusters from distinct float masks Not enough masks (26) to generate starting clusters (100), so starting with (27) clusters instead. Assigned 27 initial classes from 26 unique masks. Deleting Class 23 (1 points): Lose 15.641298 but Gain 1015.892891 Iteration 0F (0.018381 sec): 26 clusters Score: Raw -13680.432742 + Penalty 19444.858224 = 5764.425482 nChanged 16 Deleting Class 18 (2 points): Lose 22.401822 but Gain 1004.614851 Iteration 1F (0.025503 sec): 25 clusters Score: Raw -13736.857037 + Penalty 18453.160190 = 4716.303153 nChanged 6 Deleting Class 3 (2 points): Lose 31.207012 but Gain 973.173525 Iteration 2Q (0.027095 sec): 24 clusters Score: Raw -13742.435989 + Penalty 17486.895508 = 3744.459519 nChanged 5 Deleting Class 13 (2 points): Lose 26.279067 but Gain 946.487109 Iteration 3Q (0.028577 sec): 23 clusters Score: Raw -13733.659113 + Penalty 16577.517347 = 2843.858234 nChanged 4 Deleting Class 17 (1 points): Lose 10.808842 but Gain 873.451787 Iteration 4Q (0.030091 sec): 22 clusters Score: Raw -13744.939514 + Penalty 15704.140692 = 1959.201177 nChanged 1 Deleting Class 20 (1 points): Lose 3.107912 but Gain 847.413657 Iteration 5Q (0.031617 sec): 21 clusters Score: Raw -13744.538197 + Penalty 14856.727342 = 1112.189145 nChanged 1 Deleting Class 21 (2 points): Lose 23.691911 but Gain 858.708241 Iteration 6Q (0.033130 sec): 20 clusters Score: Raw -13723.145721 + Penalty 13998.083884 = 274.938163 nChanged 2 Deleting Class 22 (2 points): Lose 19.296897 but Gain 799.476687 Iteration 7Q (0.034529 sec): 19 clusters Score: Raw -13707.433701 + Penalty 13198.336607 = -509.097094 nChanged 2 Deleting Class 24 (4 points): Lose 47.463778 but Gain 818.600646 Iteration 8Q (0.035926 sec): 18 clusters Score: Raw -13663.769211 + Penalty 12376.550815 = -1287.218396 nChanged 4 Deleting Class 19 (1 points): Lose 9.942410 but Gain 759.275768 Iteration 9Q (0.037315 sec): 17 clusters Score: Raw -13658.987099 + Penalty 11617.031025 = -2041.956074 nChanged 1 Deleting Class 26 (1 points): Lose 14.168985 but Gain 759.380738 Iteration 10F (0.041904 sec): 16 clusters Score: Raw -13647.392916 + Penalty 10857.407916 = -2789.985000 nChanged 1 Deleting Class 5 (11 points): Lose 107.954028 but Gain 839.946813 Iteration 11Q (0.043202 sec): 15 clusters Score: Raw -13541.753600 + Penalty 10018.131579 = -3523.622021 nChanged 11 Deleting Class 14 (2 points): Lose 18.467442 but Gain 736.901315 Iteration 12Q (0.044514 sec): 14 clusters Score: Raw -13546.870443 + Penalty 9282.475394 = -4264.395049 nChanged 3 Deleting Class 2 (9 points): Lose 110.390609 but Gain 828.107912 Iteration 13Q (0.045759 sec): 13 clusters Score: Raw -13448.728145 + Penalty 8454.595474 = -4994.132671 nChanged 10 Deleting Class 12 (1 points): Lose 0.687931 but Gain 715.757199 Iteration 14Q (0.047102 sec): 12 clusters Score: Raw -13471.094012 + Penalty 7732.232081 = -5738.861930 nChanged 2 Deleting Class 7 (46 points): Lose 321.973964 but Gain 1014.258299 Iteration 15Q (0.048331 sec): 11 clusters Score: Raw -13157.100655 + Penalty 6753.604546 = -6403.496109 nChanged 46 Deleting Class 6 (3 points): Lose 31.778281 but Gain 720.999630 Iteration 16F (0.051549 sec): 10 clusters Score: Raw -13266.091185 + Penalty 6033.674488 = -7232.416697 nChanged 5 Deleting Class 16 (4 points): Lose 44.448171 but Gain 710.761365 Iteration 17Q (0.052789 sec): 9 clusters Score: Raw -13231.176258 + Penalty 5319.710290 = -7911.465968 nChanged 5 Deleting Class 15 (9 points): Lose 69.901266 but Gain 695.185651 Iteration 18Q (0.053938 sec): 8 clusters Score: Raw -13173.141071 + Penalty 4617.603956 = -8555.537115 nChanged 9 Deleting Class 4 (1 points): Lose 9.800997 but Gain 616.977772 Iteration 19Q (0.055039 sec): 7 clusters Score: Raw -13179.145278 + Penalty 3998.155052 = -9180.990227 nChanged 1 Writing temp clu file Memory request: 0.00 GB would take us to total of 0.01 GB. Compute initial score before splitting: Score: Raw -13179.145278 + Penalty 3998.155052 = -9180.990227Memory request: 0.00 GB would take us to total of 0.01 GB. Trying to split cluster 1 (435 points) SP: Assigned 2 initial classes randomly. SP:Iteration 0F (0.061644 sec): 2 clusters Score: Raw -10701.299695 + Penalty 830.372949 = -9870.926746 nChanged 0 SP: Assigned 3 initial classes randomly. SP:Iteration 0F (0.062710 sec): 3 clusters Score: Raw -10595.696279 + Penalty 1661.067634 = -8934.628645 nChanged 107 SP:Iteration 1F (0.063735 sec): 3 clusters Score: Raw -10743.219484 + Penalty 1661.155337 = -9082.064146 nChanged 19 SP:Iteration 2Q (0.064732 sec): 3 clusters Score: Raw -10764.387229 + Penalty 1660.971929 = -9103.415300 nChanged 12 SP:Iteration 3Q (0.065724 sec): 3 clusters Score: Raw -10786.584717 + Penalty 1661.063927 = -9125.520790 nChanged 9 SP:Iteration 4Q (0.066834 sec): 3 clusters Score: Raw -10803.369375 + Penalty 1661.037533 = -9142.331842 nChanged 5 SP:Iteration 5Q (0.067866 sec): 3 clusters Score: Raw -10809.728422 + Penalty 1661.037533 = -9148.690889 nChanged 0 SP:Iteration 6F (0.068889 sec): 3 clusters Score: Raw -10809.728422 + Penalty 1661.037533 = -9148.690889 nChanged 0 Memory request: 0.00 GB would take us to total of 0.01 GB. Trying to split cluster 8 (1 points) SP: Assigned 2 initial classes randomly. SP:Iteration 0F (0.069351 sec): 2 clusters Score: Raw -30.904187 + Penalty 0.000000 = -30.904187 nChanged 0 SP: Assigned 3 initial classes randomly. SP:Iteration 0F (0.069552 sec): 2 clusters Score: Raw -30.904187 + Penalty 0.000000 = -30.904187 nChanged 0 Memory request: 0.00 GB would take us to total of 0.01 GB. Trying to split cluster 9 (44 points) SP: Assigned 2 initial classes randomly. SP:Iteration 0F (0.070196 sec): 2 clusters Score: Raw -1408.693061 + Penalty 473.926756 = -934.766304 nChanged 0 SP: Assigned 3 initial classes randomly. SP:Iteration 0F (0.070496 sec): 3 clusters Score: Raw -1475.044464 + Penalty 954.208796 = -520.835668 nChanged 0 Memory request: 0.00 GB would take us to total of 0.01 GB. Trying to split cluster 10 (35 points) SP: Assigned 2 initial classes randomly. SP:Iteration 0F (0.071021 sec): 2 clusters Score: Raw -1084.118637 + Penalty 443.869120 = -640.249516 nChanged 0 SP: Assigned 3 initial classes randomly. SP:Iteration 0F (0.071296 sec): 3 clusters Score: Raw -1159.441477 + Penalty 887.566500 = -271.874978 nChanged 0 Memory request: 0.00 GB would take us to total of 0.01 GB. Trying to split cluster 11 (12 points) SP: Assigned 2 initial classes randomly. SP:Iteration 0F (0.071763 sec): 2 clusters Score: Raw -374.572803 + Penalty 255.328352 = -119.244451 nChanged 0 SP: Assigned 3 initial classes randomly. SP:Iteration 0F (0.071994 sec): 3 clusters Score: Raw -396.093449 + Penalty 508.733544 = 112.640096 nChanged 0 Memory request: 0.00 GB would take us to total of 0.01 GB. Trying to split cluster 25 (1 points) SP: Assigned 2 initial classes randomly. SP:Iteration 0F (0.072456 sec): 2 clusters Score: Raw -28.886230 + Penalty 0.000000 = -28.886230 nChanged 0 SP: Assigned 3 initial classes randomly. SP:Iteration 0F (0.072643 sec): 2 clusters Score: Raw -28.886230 + Penalty 0.000000 = -28.886230 nChanged 0 Deleting Class 10 (35 points): Lose 175.605863 but Gain 782.668308 Iteration 20F (0.077069 sec): 6 clusters Score: Raw -13013.798458 + Penalty 3223.045997 = -9790.752461 nChanged 35 Deleting Class 8 (1 points): Lose 7.027071 but Gain 564.564803 Iteration 21F (0.080550 sec): 5 clusters Score: Raw -13068.137767 + Penalty 2657.870882 = -10410.266885 nChanged 1 Deleting Class 11 (13 points): Lose 103.984580 but Gain 657.162668 Iteration 22Q (0.082229 sec): 4 clusters Score: Raw -12966.324719 + Penalty 1995.496415 = -10970.828304 nChanged 13 Deleting Class 9 (44 points): Lose 278.570927 but Gain 785.133081 Iteration 23Q (0.083783 sec): 3 clusters Score: Raw -12708.943792 + Penalty 1205.315759 = -11503.628033 nChanged 44 Deleting Class 25 (1 points): Lose 13.331560 but Gain 364.774073 Iteration 24F (0.085406 sec): 2 clusters Score: Raw -12781.597525 + Penalty 839.640611 = -11941.956914 nChanged 1 Iteration 25Q (0.086447 sec): 2 clusters Score: Raw -12783.637441 + Penalty 839.640611 = -11943.996830 nChanged 0 Iteration 26F (0.087409 sec): 2 clusters Score: Raw -12783.637441 + Penalty 839.640611 = -11943.996830 nChanged 0 Writing temp clu file Memory request: 0.00 GB would take us to total of 0.01 GB. Compute initial score before splitting: Score: Raw -12783.637441 + Penalty 839.640611 = -11943.996830Memory request: 0.00 GB would take us to total of 0.01 GB. Trying to split cluster 1 (528 points) SP: Assigned 2 initial classes randomly. SP:Iteration 0F (0.092192 sec): 2 clusters Score: Raw -12882.037843 + Penalty 839.640611 = -12042.397232 nChanged 0 SP: Assigned 3 initial classes randomly. SP:Iteration 0F (0.093500 sec): 3 clusters Score: Raw -12725.874166 + Penalty 1679.518074 = -11046.356092 nChanged 143 SP:Iteration 1F (0.094787 sec): 3 clusters Score: Raw -12879.224416 + Penalty 1679.133738 = -11200.090678 nChanged 53 SP:Iteration 2F (0.096077 sec): 3 clusters Score: Raw -12966.158741 + Penalty 1679.405175 = -11286.753566 nChanged 20 SP:Iteration 3Q (0.097365 sec): 3 clusters Score: Raw -12985.611772 + Penalty 1679.395095 = -11306.216677 nChanged 10 SP:Iteration 4Q (0.098595 sec): 3 clusters Score: Raw -13000.311205 + Penalty 1679.159239 = -11321.151966 nChanged 7 SP:Iteration 5Q (0.099812 sec): 3 clusters Score: Raw -13006.862593 + Penalty 1679.365968 = -11327.496625 nChanged 3 SP:Iteration 6Q (0.101013 sec): 3 clusters Score: Raw -13010.305705 + Penalty 1679.314527 = -11330.991177 nChanged 2 SP:Iteration 7Q (0.102179 sec): 3 clusters Score: Raw -13012.544623 + Penalty 1679.348263 = -11333.196359 nChanged 1 SP:Iteration 8Q (0.103313 sec): 3 clusters Score: Raw -13014.613289 + Penalty 1679.348263 = -11335.265026 nChanged 0 SP:Iteration 9F (0.104492 sec): 3 clusters Score: Raw -13014.613289 + Penalty 1679.348263 = -11335.265026 nChanged 0 Time taken for this iteration:0.093915 seconds. 100->2 Clusters: Score -11943.996830, best is 100000000000000005366162204393472.000000 THE BEST YET! Main iterations: 27 (time per iteration =3.885815 ms) Total iterations: 56 (time per iteration =1.873518 ms) Def. Iteration metric 2: Iteration_metric2 += (scalar)(nDims*nDims)*(scalar)(nPoints) Iterations metric 2: 14831250.000000 (time per metric unit =7.074050ns) Def. Iteration metric 3: Iteration_metric3 += (scalar)(nDims*nDims)*(scalar)(nDims*nPoints) Iterations metric 3: 370781250.000000 (time per metric unit=282.961989ps) That took 0.104917 seconds.