Temporal Data Set Evaluation V1.0
Mathieu Guillame-Bert
PhD Student - INRIA Rhône Alpes

Mail : mathieu.guillame-bert@inrialpes.fr
Web site : http://www-prima.imag.fr/guillame-bert

Date of generation : Mon May 23 12:41:47 2011

Notation :

User_Conf[i] : confidence of user's predictions on subset i i.e probability of a preduction to be true
Ref_Conf[i] : confidence of reference's predictions on subset i i.e probability of a preduction to be true
User_Supp[i] : support of user's predictions on subset i i.e probability of an event to be predicted
Ref_Supp[i] : support of reference's predictions on subset i i.e probability of an event to be predicted
User_Prec[i] : precision of user's predictions on subset i i.e. temporal accuracy of the prediction
Ref_Prec[i] : precision of reference's predictions on subset i i.e. temporal accuracy of the prediction
mean(l) : mean of a list's values i.e sum(l)/size(l)
Precision : Precision (or temporal precision) of a prediction is the standard deviation of this prediction

Global results:

Number of evaluation subsets : 99
Duration of evaluation : 710.16s
   
User's predictions directory : D:/enseignement/PhD/implementation/dataset/data_pred_rules_simple_r1_l0.05
Reference's predictions directory : dataset_refPred/
Events directory : dataset/
Dataset Descriptions directory : dataset_desc/
Output report directory : D:/enseignement/PhD/implementation/dataset/report_pred_rules_simple_r1_l0.05.html
   
Ratio User's predictions' estimated confidence/Reference's predictions' estimated confidence
i.e. statistics of { User_Conf[i]/Ref_Conf[i] for i = 1...N } with N the number of subsets
mean : 97.10%
median : 100.98%
std : 25.82%
min : 0.00%
max : 153.39%
len : 99
Ratio User's predictions' estimated support/Reference's predictions' estimated support
i.e. statistics of { User_Supp[i]/Ref_Supp[i] for i = 1...N } with N the number of subsets
mean : 144.05%
median : 130.77%
std : 48.04%
min : 0.00%
max : 247.44%
len : 99
Ratio User's predictions' precision/Reference's predictions' precision
i.e. statistics of { User_Prec[i]/Ref_Prec[i] for i = 1...N } with N the number of subsets
mean : 710.43%
median : 739.23%
std : 324.91%
min : 104.05%
max : 1290.64%
len : 99
Gain User's predictions' estimated confidence/Reference's predictions' estimated confidence
i.e. statistics of { (User_Conf[i]-Ref_Conf[i])/Ref_Conf[i] for i = 1...N } with N the number of subsets
mean : -2.90%
median : 0.98%
std : 25.82%
min : -100.00%
max : 53.39%
len : 99
Gain User's predictions' estimated support/Reference's predictions' estimated support
i.e. statistics of { (User_Supp[i]-Ref_Supp[i])/Ref_Supp[i] for i = 1...N } with N the number of subsets
mean : 44.05%
median : 30.77%
std : 48.04%
min : -100.00%
max : 147.44%
len : 99
Gain User's predictions' precision/Reference's predictions' precision
i.e. statistics of { (User_Prec[i]-Ref_Prec[i])/Ref_Prec[i] for i = 1...N } with N the number of subsets
mean : 610.43%
median : 639.23%
std : 324.91%
min : 4.05%
max : 1190.64%
len : 99
Number of user's predictions
mean : 8905.75757576
median : 4171.0
std : 13590.9084311
min : 28
max : 89409
len : 99
Number of reference predictions
mean : 8226.02020202
median : 2975.0
std : 14212.5734588
min : 13
max : 89408
len : 99
Gain of number of user's predictions / number of reference predictions
mean : 133.33%
median : 100.00%
std : 121.44%
min : 0.00%
max : 1100.00%
len : 99
Number of user's predictions / number of events
mean : 95.96%
median : 100.00%
std : 98.39%
min : 0.00%
max : 500.00%
len : 99
Number of reference prediction / number of events
mean : 52.53%
median : 100.00%
std : 49.94%
min : 0.00%
max : 100.00%
len : 99
  Ratio
i.e user/ref
Gain
i.e (user-ref)/ref
Bond
i.e user → ref
Confidence/Support
Confidence/Standard deviation
Standard deviation/Support
Mean of number of predictions of a single event
Descriptions : Temporal precision, Maximum future of prediction, Probability of type 0 noise, Maximum noise ratio, Density of events to predict, Duration of experiment, Number of conditions, Maximum condition window distance, Number of events to perdict, Maximum condition window size, Probability of type 1 noise, Probability of type 2 noise
  User Reference User/Reference ratio
Correlation between Temporal precision and confidence
Correlation between Temporal precision and support
Correlation between Temporal precision and precision
Correlation between Maximum future of prediction and confidence
Correlation between Maximum future of prediction and support
Correlation between Maximum future of prediction and precision
Correlation between Probability of type 0 noise and confidence
Correlation between Probability of type 0 noise and support
Correlation between Probability of type 0 noise and precision
Correlation between Maximum noise ratio and confidence
Correlation between Maximum noise ratio and support
Correlation between Maximum noise ratio and precision
Correlation between Density of events to predict and confidence
Correlation between Density of events to predict and support
Correlation between Density of events to predict and precision
Correlation between Duration of experiment and confidence
Correlation between Duration of experiment and support
Correlation between Duration of experiment and precision
Correlation between Number of conditions and confidence
Correlation between Number of conditions and support
Correlation between Number of conditions and precision
Correlation between Maximum condition window distance and confidence
Correlation between Maximum condition window distance and support
Correlation between Maximum condition window distance and precision
Correlation between Number of events to perdict and confidence
Correlation between Number of events to perdict and support
Correlation between Number of events to perdict and precision
Correlation between Maximum condition window size and confidence
Correlation between Maximum condition window size and support
Correlation between Maximum condition window size and precision
Correlation between Probability of type 1 noise and confidence
Correlation between Probability of type 1 noise and support
Correlation between Probability of type 1 noise and precision
Correlation between Probability of type 2 noise and confidence
Correlation between Probability of type 2 noise and support
Correlation between Probability of type 2 noise and precision

List of subsets : part_10_2 , part_11_2 , part_12_2 , part_13_2 , part_14_2 , part_15_2 , part_16_2 , part_17_2 , part_18_2 , part_19_2 , part_1_2 (report not generated) , part_20_2 (report not generated) , part_21_2 (report not generated) , part_22_2 (report not generated) , part_23_2 (report not generated) , part_24_2 (report not generated) , part_25_2 (report not generated) , part_26_2 (report not generated) , part_27_2 (report not generated) , part_28_2 (report not generated) , part_29_2 (report not generated) , part_2_2 (report not generated) , part_30_2 (report not generated) , part_31_2 (report not generated) , part_32_2 (report not generated) , part_33_2 (report not generated) , part_34_2 (report not generated) , part_35_2 (report not generated) , part_36_2 (report not generated) , part_37_2 (report not generated) , part_38_2 (report not generated) , part_39_2 (report not generated) , part_3_2 (report not generated) , part_40_2 (report not generated) , part_41_2 (report not generated) , part_42_2 (report not generated) , part_43_2 (report not generated) , part_44_2 (report not generated) , part_45_2 (report not generated) , part_46_2 (report not generated) , part_47_2 (report not generated) , part_48_2 (report not generated) , part_49_2 (report not generated) , part_4_2 (report not generated) , part_50_2 (report not generated) , part_51_2 (report not generated) , part_52_2 (report not generated) , part_53_2 (report not generated) , part_54_2 (report not generated) , part_55_2 (report not generated) , part_56_2 (report not generated) , part_57_2 (report not generated) , part_58_2 (report not generated) , part_59_2 (report not generated) , part_5_2 (report not generated) , part_60_2 (report not generated) , part_61_2 (report not generated) , part_62_2 (report not generated) , part_63_2 (report not generated) , part_64_2 (report not generated) , part_65_2 (report not generated) , part_66_2 (report not generated) , part_67_2 (report not generated) , part_68_2 (report not generated) , part_69_2 (report not generated) , part_6_2 (report not generated) , part_70_2 (report not generated) , part_71_2 (report not generated) , part_72_2 (report not generated) , part_73_2 (report not generated) , part_74_2 (report not generated) , part_75_2 (report not generated) , part_76_2 (report not generated) , part_77_2 (report not generated) , part_78_2 (report not generated) , part_79_2 (report not generated) , part_7_2 (report not generated) , part_80_2 (report not generated) , part_81_2 (report not generated) , part_82_2 (report not generated) , part_83_2 (report not generated) , part_84_2 (report not generated) , part_85_2 (report not generated) , part_86_2 (report not generated) , part_87_2 (report not generated) , part_88_2 (report not generated) , part_89_2 (report not generated) , part_8_2 (report not generated) , part_90_2 (report not generated) , part_91_2 (report not generated) , part_92_2 (report not generated) , part_93_2 (report not generated) , part_94_2 (report not generated) , part_95_2 (report not generated) , part_96_2 (report not generated) , part_97_2 (report not generated) , part_98_2 (report not generated) , part_99_2 (report not generated) , part_9_2 (report not generated)
Subset : part_10_2
   
Symbol to predict : a
Number of user predictions : 1757
Number of reference predictions : 987
Number of reference events : 657
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 1.0
Maximum noise ratio : 0.2
Density of events to predict : 0.00987
Duration of experiment : 100000.0
Number of conditions : 3.0
Maximum condition window distance : 20.0
Number of events to perdict : 987.0
Probability of type 2 noise : 0.0
Probability of type 1 noise : 0.0
Maximum condition window size : 10.0
   
User predictions estimated confidence : 33.75%
Reference predictions estimated confidence : 59.88%
User predictions estimated confidence/Reference predictions estimated confidence : 56.37%
   
User predictions estimated support : 89.50%
Reference predictions estimated support : 89.19%
User predictions estimated support/Reference predictions estimated support : 100.34%
   
User predictions precision : 0.721651771917
Reference predictions precision : 0.633413495633
User predictions precision/Reference predictions precision : 113.93%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_11_2
   
Symbol to predict : a
Number of user predictions : 1684
Number of reference predictions : 956
Number of reference events : 1427
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.5
Maximum noise ratio : 0.5
Density of events to predict : 0.00956
Duration of experiment : 100000.0
Number of conditions : 3.0
Maximum condition window distance : 20.0
Number of events to perdict : 956.0
Probability of type 2 noise : 0.5
Probability of type 1 noise : 0.0
Maximum condition window size : 10.0
   
User predictions estimated confidence : 58.85%
Reference predictions estimated confidence : 90.17%
User predictions estimated confidence/Reference predictions estimated confidence : 65.27%
   
User predictions estimated support : 69.38%
Reference predictions estimated support : 59.92%
User predictions estimated support/Reference predictions estimated support : 115.79%
   
User predictions precision : 4.90723168426
Reference predictions precision : 0.864484252998
User predictions precision/Reference predictions precision : 567.65%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_12_2
   
Symbol to predict : a
Number of user predictions : 2053
Number of reference predictions : 1131
Number of reference events : 1679
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.5
Maximum noise ratio : 0.5
Density of events to predict : 0.01131
Duration of experiment : 100000.0
Number of conditions : 4.0
Maximum condition window distance : 20.0
Number of events to perdict : 1131.0
Probability of type 2 noise : 0.5
Probability of type 1 noise : 0.0
Maximum condition window size : 10.0
   
User predictions estimated confidence : 48.37%
Reference predictions estimated confidence : 61.18%
User predictions estimated confidence/Reference predictions estimated confidence : 79.05%
   
User predictions estimated support : 56.64%
Reference predictions estimated support : 40.02%
User predictions estimated support/Reference predictions estimated support : 141.52%
   
User predictions precision : 5.34022291259
Reference predictions precision : 0.797231388155
User predictions precision/Reference predictions precision : 669.85%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_13_2
   
Symbol to predict : a
Number of user predictions : 1128
Number of reference predictions : 1128
Number of reference events : 1676
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.5
Maximum noise ratio : 0.5
Density of events to predict : 0.01128
Duration of experiment : 100000.0
Number of conditions : 1.0
Maximum condition window distance : 20.0
Number of events to perdict : 1128.0
Probability of type 2 noise : 0.0
Probability of type 1 noise : 0.5
Maximum condition window size : 10.0
   
User predictions estimated confidence : 60.82%
Reference predictions estimated confidence : 60.02%
User predictions estimated confidence/Reference predictions estimated confidence : 101.33%
   
User predictions estimated support : 40.57%
Reference predictions estimated support : 40.10%
User predictions estimated support/Reference predictions estimated support : 101.19%
   
User predictions precision : 0.721651771917
Reference predictions precision : 0.55244318152
User predictions precision/Reference predictions precision : 130.63%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_14_2
   
Symbol to predict : a
Number of user predictions : 3606
Number of reference predictions : 3606
Number of reference events : 3602
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.333333
Maximum noise ratio : 1.0
Density of events to predict : 0.03606
Duration of experiment : 100000.0
Number of conditions : 1.0
Maximum condition window distance : 20.0
Number of events to perdict : 3606.0
Probability of type 2 noise : 0.333333
Probability of type 1 noise : 0.333333
Maximum condition window size : 10.0
   
User predictions estimated confidence : 90.71%
Reference predictions estimated confidence : 89.93%
User predictions estimated confidence/Reference predictions estimated confidence : 100.86%
   
User predictions estimated support : 90.23%
Reference predictions estimated support : 89.45%
User predictions estimated support/Reference predictions estimated support : 100.87%
   
User predictions precision : 0.865982112535
Reference predictions precision : 0.687625491498
User predictions precision/Reference predictions precision : 125.94%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_15_2
   
Symbol to predict : a
Number of user predictions : 2517
Number of reference predictions : 2142
Number of reference events : 2131
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.333333
Maximum noise ratio : 1.0
Density of events to predict : 0.02142
Duration of experiment : 100000.0
Number of conditions : 4.0
Maximum condition window distance : 20.0
Number of events to perdict : 2142.0
Probability of type 2 noise : 0.333333
Probability of type 1 noise : 0.333333
Maximum condition window size : 10.0
   
User predictions estimated confidence : 54.51%
Reference predictions estimated confidence : 65.03%
User predictions estimated confidence/Reference predictions estimated confidence : 83.82%
   
User predictions estimated support : 68.47%
Reference predictions estimated support : 59.88%
User predictions estimated support/Reference predictions estimated support : 114.34%
   
User predictions precision : 4.76290158453
Reference predictions precision : 0.795667699468
User predictions precision/Reference predictions precision : 598.60%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_16_2
   
Symbol to predict : a
Number of user predictions : 9276
Number of reference predictions : 4751
Number of reference events : 6845
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.333333
Maximum noise ratio : 1.0
Density of events to predict : 0.04751
Duration of experiment : 100000.0
Number of conditions : 3.0
Maximum condition window distance : 20.0
Number of events to perdict : 4751.0
Probability of type 2 noise : 0.333333
Probability of type 1 noise : 0.333333
Maximum condition window size : 10.0
   
User predictions estimated confidence : 85.46%
Reference predictions estimated confidence : 67.00%
User predictions estimated confidence/Reference predictions estimated confidence : 127.55%
   
User predictions estimated support : 79.14%
Reference predictions estimated support : 41.43%
User predictions estimated support/Reference predictions estimated support : 191.01%
   
User predictions precision : 5.48455332204
Reference predictions precision : 0.755350279781
User predictions precision/Reference predictions precision : 726.09%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_17_2
   
Symbol to predict : a
Number of user predictions : 8040
Number of reference predictions : 8040
Number of reference events : 8031
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.5
Maximum noise ratio : 1.0
Density of events to predict : 0.0804
Duration of experiment : 100000.0
Number of conditions : 1.0
Maximum condition window distance : 20.0
Number of events to perdict : 8040.0
Probability of type 2 noise : 0.5
Probability of type 1 noise : 0.0
Maximum condition window size : 10.0
   
User predictions estimated confidence : 92.28%
Reference predictions estimated confidence : 91.13%
User predictions estimated confidence/Reference predictions estimated confidence : 101.26%
   
User predictions estimated support : 90.60%
Reference predictions estimated support : 89.52%
User predictions estimated support/Reference predictions estimated support : 101.21%
   
User predictions precision : 0.865982181361
Reference predictions precision : 0.681148246628
User predictions precision/Reference predictions precision : 127.14%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_18_2
   
Symbol to predict : a
Number of user predictions : 2955
Number of reference predictions : 2955
Number of reference events : 2952
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.5
Maximum noise ratio : 1.0
Density of events to predict : 0.02955
Duration of experiment : 100000.0
Number of conditions : 1.0
Maximum condition window distance : 20.0
Number of events to perdict : 2955.0
Probability of type 2 noise : 0.0
Probability of type 1 noise : 0.5
Maximum condition window size : 10.0
   
User predictions estimated confidence : 90.63%
Reference predictions estimated confidence : 89.20%
User predictions estimated confidence/Reference predictions estimated confidence : 101.59%
   
User predictions estimated support : 90.41%
Reference predictions estimated support : 89.02%
User predictions estimated support/Reference predictions estimated support : 101.56%
   
User predictions precision : 0.721651771917
Reference predictions precision : 0.498647043009
User predictions precision/Reference predictions precision : 144.72%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :

Subset : part_19_2
   
Symbol to predict : a
Number of user predictions : 4409
Number of reference predictions : 3295
Number of reference events : 4880
   
Subset complexity description :
Temporal precision : 3.0
Maximum future of prediction : 10.0
Probability of type 0 noise : 0.0
Maximum noise ratio : 1.0
Density of events to predict : 0.03295
Duration of experiment : 100000.0
Number of conditions : 2.0
Maximum condition window distance : 20.0
Number of events to perdict : 3295.0
Probability of type 2 noise : 1.0
Probability of type 1 noise : 0.0
Maximum condition window size : 10.0
   
User predictions estimated confidence : 83.40%
Reference predictions estimated confidence : 90.99%
User predictions estimated confidence/Reference predictions estimated confidence : 91.66%
   
User predictions estimated support : 78.89%
Reference predictions estimated support : 60.33%
User predictions estimated support/Reference predictions estimated support : 130.77%
   
User predictions precision : 5.34022291259
Reference predictions precision : 0.616961973285
User predictions precision/Reference predictions precision : 865.57%
   
Statistics of multiple prediction of a single event
   
Confidence/Standard deviation of reference predictions :
Confidence/Standard deviation of user predictions :
Confidence/succes rate for reference prediction :
Confidence/succes rate for user prediction :