Script started on Wed 07 Apr 2010 02:26:14 AM CDT $ java -cp ".:/u/mooney/ir-code/" ir.classifiers.TestNaiveBayes Loading Examples from /u/mooney/ir-code/corpora/yahoo-science/... Initializing Naive Bayes classifier... Generating 10 fold CV learning curves... Train Percentage: 0.0% Calculating results for fold 0 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 37.778% Calculating results for fold 1 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 33.333% Calculating results for fold 2 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 34.444% Calculating results for fold 3 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 31.111% Calculating results for fold 4 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 43.333% Calculating results for fold 5 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 31.111% Calculating results for fold 6 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 35.556% Calculating results for fold 7 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 24.444% Calculating results for fold 8 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 34.444% Calculating results for fold 9 Number of training examples: 0 Train Accuracy = 100.0%; Test Accuracy = 31.034% Train Percentage: 1.0% Calculating results for fold 0 Number of training examples: 9 Train Accuracy = 88.889%; Test Accuracy = 45.556% Calculating results for fold 1 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 52.222% Calculating results for fold 2 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 52.222% Calculating results for fold 3 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 42.222% Calculating results for fold 4 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 45.556% Calculating results for fold 5 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 52.222% Calculating results for fold 6 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 35.556% Calculating results for fold 7 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 53.333% Calculating results for fold 8 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 45.556% Calculating results for fold 9 Number of training examples: 9 Train Accuracy = 100.0%; Test Accuracy = 49.425% Train Percentage: 5.0% Calculating results for fold 0 Number of training examples: 39 Train Accuracy = 94.872%; Test Accuracy = 58.889% Calculating results for fold 1 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 67.778% Calculating results for fold 2 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 57.778% Calculating results for fold 3 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 58.889% Calculating results for fold 4 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 68.889% Calculating results for fold 5 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 52.222% Calculating results for fold 6 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 56.667% Calculating results for fold 7 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 71.111% Calculating results for fold 8 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 61.111% Calculating results for fold 9 Number of training examples: 39 Train Accuracy = 100.0%; Test Accuracy = 68.966% Train Percentage: 10.0% Calculating results for fold 0 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 65.556% Calculating results for fold 1 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 65.556% Calculating results for fold 2 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 58.889% Calculating results for fold 3 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 58.889% Calculating results for fold 4 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 60.0% Calculating results for fold 5 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 54.444% Calculating results for fold 6 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 56.667% Calculating results for fold 7 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 66.667% Calculating results for fold 8 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 60.0% Calculating results for fold 9 Number of training examples: 81 Train Accuracy = 98.765%; Test Accuracy = 68.966% Train Percentage: 20.0% Calculating results for fold 0 Number of training examples: 162 Train Accuracy = 96.914%; Test Accuracy = 66.667% Calculating results for fold 1 Number of training examples: 162 Train Accuracy = 96.914%; Test Accuracy = 68.889% Calculating results for fold 2 Number of training examples: 162 Train Accuracy = 95.679%; Test Accuracy = 56.667% Calculating results for fold 3 Number of training examples: 162 Train Accuracy = 95.062%; Test Accuracy = 71.111% Calculating results for fold 4 Number of training examples: 162 Train Accuracy = 95.062%; Test Accuracy = 66.667% Calculating results for fold 5 Number of training examples: 162 Train Accuracy = 95.679%; Test Accuracy = 58.889% Calculating results for fold 6 Number of training examples: 162 Train Accuracy = 95.062%; Test Accuracy = 67.778% Calculating results for fold 7 Number of training examples: 162 Train Accuracy = 95.679%; Test Accuracy = 78.889% Calculating results for fold 8 Number of training examples: 162 Train Accuracy = 95.062%; Test Accuracy = 66.667% Calculating results for fold 9 Number of training examples: 162 Train Accuracy = 95.062%; Test Accuracy = 68.966% Train Percentage: 30.0% Calculating results for fold 0 Number of training examples: 243 Train Accuracy = 94.65%; Test Accuracy = 62.222% Calculating results for fold 1 Number of training examples: 243 Train Accuracy = 94.239%; Test Accuracy = 66.667% Calculating results for fold 2 Number of training examples: 243 Train Accuracy = 96.296%; Test Accuracy = 66.667% Calculating results for fold 3 Number of training examples: 243 Train Accuracy = 93.827%; Test Accuracy = 75.556% Calculating results for fold 4 Number of training examples: 243 Train Accuracy = 94.239%; Test Accuracy = 68.889% Calculating results for fold 5 Number of training examples: 243 Train Accuracy = 94.239%; Test Accuracy = 65.556% Calculating results for fold 6 Number of training examples: 243 Train Accuracy = 94.239%; Test Accuracy = 64.444% Calculating results for fold 7 Number of training examples: 243 Train Accuracy = 93.827%; Test Accuracy = 80.0% Calculating results for fold 8 Number of training examples: 243 Train Accuracy = 94.239%; Test Accuracy = 68.889% Calculating results for fold 9 Number of training examples: 243 Train Accuracy = 93.827%; Test Accuracy = 68.966% Train Percentage: 40.0% Calculating results for fold 0 Number of training examples: 324 Train Accuracy = 92.901%; Test Accuracy = 65.556% Calculating results for fold 1 Number of training examples: 324 Train Accuracy = 92.901%; Test Accuracy = 68.889% Calculating results for fold 2 Number of training examples: 324 Train Accuracy = 95.37%; Test Accuracy = 65.556% Calculating results for fold 3 Number of training examples: 324 Train Accuracy = 93.21%; Test Accuracy = 71.111% Calculating results for fold 4 Number of training examples: 324 Train Accuracy = 93.827%; Test Accuracy = 71.111% Calculating results for fold 5 Number of training examples: 324 Train Accuracy = 93.827%; Test Accuracy = 65.556% Calculating results for fold 6 Number of training examples: 324 Train Accuracy = 93.519%; Test Accuracy = 68.889% Calculating results for fold 7 Number of training examples: 324 Train Accuracy = 93.519%; Test Accuracy = 78.889% Calculating results for fold 8 Number of training examples: 324 Train Accuracy = 93.827%; Test Accuracy = 72.222% Calculating results for fold 9 Number of training examples: 324 Train Accuracy = 93.827%; Test Accuracy = 67.816% Train Percentage: 50.0% Calculating results for fold 0 Number of training examples: 405 Train Accuracy = 93.827%; Test Accuracy = 70.0% Calculating results for fold 1 Number of training examples: 405 Train Accuracy = 94.568%; Test Accuracy = 67.778% Calculating results for fold 2 Number of training examples: 405 Train Accuracy = 94.321%; Test Accuracy = 71.111% Calculating results for fold 3 Number of training examples: 405 Train Accuracy = 93.086%; Test Accuracy = 71.111% Calculating results for fold 4 Number of training examples: 405 Train Accuracy = 92.84%; Test Accuracy = 68.889% Calculating results for fold 5 Number of training examples: 405 Train Accuracy = 92.346%; Test Accuracy = 71.111% Calculating results for fold 6 Number of training examples: 405 Train Accuracy = 92.099%; Test Accuracy = 75.556% Calculating results for fold 7 Number of training examples: 405 Train Accuracy = 91.852%; Test Accuracy = 81.111% Calculating results for fold 8 Number of training examples: 405 Train Accuracy = 92.099%; Test Accuracy = 70.0% Calculating results for fold 9 Number of training examples: 405 Train Accuracy = 92.346%; Test Accuracy = 68.966% Train Percentage: 60.0% Calculating results for fold 0 Number of training examples: 483 Train Accuracy = 92.34%; Test Accuracy = 72.222% Calculating results for fold 1 Number of training examples: 483 Train Accuracy = 93.996%; Test Accuracy = 71.111% Calculating results for fold 2 Number of training examples: 483 Train Accuracy = 93.168%; Test Accuracy = 62.222% Calculating results for fold 3 Number of training examples: 483 Train Accuracy = 92.754%; Test Accuracy = 67.778% Calculating results for fold 4 Number of training examples: 483 Train Accuracy = 93.996%; Test Accuracy = 65.556% Calculating results for fold 5 Number of training examples: 483 Train Accuracy = 91.718%; Test Accuracy = 70.0% Calculating results for fold 6 Number of training examples: 483 Train Accuracy = 92.961%; Test Accuracy = 75.556% Calculating results for fold 7 Number of training examples: 483 Train Accuracy = 92.961%; Test Accuracy = 82.222% Calculating results for fold 8 Number of training examples: 483 Train Accuracy = 92.961%; Test Accuracy = 72.222% Calculating results for fold 9 Number of training examples: 483 Train Accuracy = 92.754%; Test Accuracy = 73.563% Train Percentage: 70.0% Calculating results for fold 0 Number of training examples: 564 Train Accuracy = 92.73%; Test Accuracy = 72.222% Calculating results for fold 1 Number of training examples: 564 Train Accuracy = 93.262%; Test Accuracy = 68.889% Calculating results for fold 2 Number of training examples: 564 Train Accuracy = 93.44%; Test Accuracy = 67.778% Calculating results for fold 3 Number of training examples: 564 Train Accuracy = 93.617%; Test Accuracy = 72.222% Calculating results for fold 4 Number of training examples: 564 Train Accuracy = 93.44%; Test Accuracy = 72.222% Calculating results for fold 5 Number of training examples: 564 Train Accuracy = 92.199%; Test Accuracy = 68.889% Calculating results for fold 6 Number of training examples: 564 Train Accuracy = 92.908%; Test Accuracy = 74.444% Calculating results for fold 7 Number of training examples: 564 Train Accuracy = 92.553%; Test Accuracy = 76.667% Calculating results for fold 8 Number of training examples: 564 Train Accuracy = 92.553%; Test Accuracy = 71.111% Calculating results for fold 9 Number of training examples: 564 Train Accuracy = 91.844%; Test Accuracy = 68.966% Train Percentage: 80.0% Calculating results for fold 0 Number of training examples: 645 Train Accuracy = 91.783%; Test Accuracy = 73.333% Calculating results for fold 1 Number of training examples: 645 Train Accuracy = 92.868%; Test Accuracy = 73.333% Calculating results for fold 2 Number of training examples: 645 Train Accuracy = 92.868%; Test Accuracy = 67.778% Calculating results for fold 3 Number of training examples: 645 Train Accuracy = 92.868%; Test Accuracy = 70.0% Calculating results for fold 4 Number of training examples: 645 Train Accuracy = 93.178%; Test Accuracy = 77.778% Calculating results for fold 5 Number of training examples: 645 Train Accuracy = 91.628%; Test Accuracy = 67.778% Calculating results for fold 6 Number of training examples: 645 Train Accuracy = 92.403%; Test Accuracy = 68.889% Calculating results for fold 7 Number of training examples: 645 Train Accuracy = 93.023%; Test Accuracy = 76.667% Calculating results for fold 8 Number of training examples: 645 Train Accuracy = 92.713%; Test Accuracy = 71.111% Calculating results for fold 9 Number of training examples: 645 Train Accuracy = 92.403%; Test Accuracy = 71.264% Train Percentage: 90.0% Calculating results for fold 0 Number of training examples: 726 Train Accuracy = 86.364%; Test Accuracy = 64.444% Calculating results for fold 1 Number of training examples: 726 Train Accuracy = 85.262%; Test Accuracy = 67.778% Calculating results for fold 2 Number of training examples: 726 Train Accuracy = 86.364%; Test Accuracy = 62.222% Calculating results for fold 3 Number of training examples: 726 Train Accuracy = 85.675%; Test Accuracy = 62.222% Calculating results for fold 4 Number of training examples: 726 Train Accuracy = 85.537%; Test Accuracy = 72.222% Calculating results for fold 5 Number of training examples: 726 Train Accuracy = 84.986%; Test Accuracy = 63.333% Calculating results for fold 6 Number of training examples: 726 Train Accuracy = 85.813%; Test Accuracy = 62.222% Calculating results for fold 7 Number of training examples: 726 Train Accuracy = 86.226%; Test Accuracy = 66.667% Calculating results for fold 8 Number of training examples: 726 Train Accuracy = 92.149%; Test Accuracy = 72.222% Calculating results for fold 9 Number of training examples: 726 Train Accuracy = 92.149%; Test Accuracy = 74.713% Train Percentage: 100.0% Calculating results for fold 0 Number of training examples: 807 Train Accuracy = 86.989%; Test Accuracy = 68.889% Calculating results for fold 1 Number of training examples: 807 Train Accuracy = 85.998%; Test Accuracy = 65.556% Calculating results for fold 2 Number of training examples: 807 Train Accuracy = 86.741%; Test Accuracy = 64.444% Calculating results for fold 3 Number of training examples: 807 Train Accuracy = 86.121%; Test Accuracy = 64.444% Calculating results for fold 4 Number of training examples: 807 Train Accuracy = 86.989%; Test Accuracy = 74.444% Calculating results for fold 5 Number of training examples: 807 Train Accuracy = 85.13%; Test Accuracy = 63.333% Calculating results for fold 6 Number of training examples: 807 Train Accuracy = 86.493%; Test Accuracy = 62.222% Calculating results for fold 7 Number of training examples: 807 Train Accuracy = 87.237%; Test Accuracy = 66.667% Calculating results for fold 8 Number of training examples: 807 Train Accuracy = 92.193%; Test Accuracy = 73.333% Calculating results for fold 9 Number of training examples: 807 Train Accuracy = 86.245%; Test Accuracy = 59.77% Total Training time in seconds: 2.89 Testing time per example in milliseconds: 0.05 GNUPLOT train accuracy file is NaiveBayesTrain.gplot GNUPLOT test accuracy file is NaiveBayes.gplot $ exit Script done on Wed 07 Apr 2010 02:26:38 AM CDT