Test #2 (Order score): Charniak Figure 1

This module implements Ordering Search of Structures in Bayesian Networks from Theory & Concepts

Test #2 (Order score): Charniak Figure 1

Postby M Charles » Mon Aug 25, 2014 3:33 pm

This test scores orders based on the 5-node network from [Charniak, 1991], using a generated dataset of 50000 entries. The results are sorted from lowest to highest score:
lo<hb<bp<fo<do: -80191.9004544189
hb<lo<bp<fo<do: -80191.9004544189
bp<hb<lo<fo<do: -80191.9004544188
hb<bp<lo<fo<do: -80191.9004544188
lo<bp<hb<fo<do: -80190.6850077025
bp<lo<hb<fo<do: -80190.6850077024
lo<hb<bp<do<fo: -80186.8292711008
hb<lo<bp<do<fo: -80186.8292711008
hb<bp<lo<do<fo: -80186.8292711008
bp<hb<lo<do<fo: -80186.8292711008
lo<bp<hb<do<fo: -80185.6138243844
bp<lo<hb<do<fo: -80185.6138243844
lo<hb<fo<bp<do: -80176.2425380855
hb<lo<fo<bp<do: -80176.2425380854
lo<hb<do<bp<fo: -80175.3760822308
hb<lo<do<bp<fo: -80175.3760822308
hb<bp<do<lo<fo: -80171.8225107967
bp<hb<do<lo<fo: -80171.8225107967
lo<do<hb<bp<fo: -80166.2068160219
hb<do<lo<bp<fo: -80166.2068160219
do<lo<hb<bp<fo: -80166.2068160219
do<hb<lo<bp<fo: -80166.2068160219
hb<do<bp<lo<fo: -80166.2050271774
bp<do<hb<lo<fo: -80166.2050271774
do<bp<hb<lo<fo: -80166.2050271774
do<hb<bp<lo<fo: -80166.2050271774
bp<do<lo<hb<fo: -80166.2049747959
lo<do<bp<hb<fo: -80166.2049747959
do<bp<lo<hb<fo: -80166.2049747959
do<lo<bp<hb<fo: -80166.2049747959
lo<do<bp<fo<hb: -80166.2047847357
bp<do<lo<fo<hb: -80166.2047847357
do<bp<lo<fo<hb: -80166.2047847357
do<lo<bp<fo<hb: -80166.2047847357
lo<hb<do<fo<bp: -80166.1055275517
hb<lo<do<fo<bp: -80166.1055275516
lo<bp<do<hb<fo: -80165.6642795926
bp<lo<do<hb<fo: -80165.6642795926
lo<bp<do<fo<hb: -80165.6640895324
bp<lo<do<fo<hb: -80165.6640895324
lo<hb<fo<do<bp: -80165.6280397138
hb<lo<fo<do<bp: -80165.6280397138
lo<fo<hb<bp<do: -80165.617262472
fo<lo<hb<bp<do: -80165.617262472
fo<hb<lo<bp<do: -80165.617262472
hb<fo<lo<bp<do: -80165.617262472
fo<hb<bp<lo<do: -80165.6163407182
hb<fo<bp<lo<do: -80165.6163407182
hb<bp<fo<lo<do: -80165.6163407182
bp<hb<fo<lo<do: -80165.6163407181
fo<hb<bp<do<lo: -80165.6163131499
hb<fo<bp<do<lo: -80165.6163131499
bp<hb<fo<do<lo: -80165.6163131499
hb<bp<fo<do<lo: -80165.6163131499
fo<bp<lo<hb<do: -80163.6439255807
bp<fo<lo<hb<do: -80163.6439255807
fo<bp<hb<lo<do: -80163.6439013128
bp<fo<hb<lo<do: -80163.6439013128
fo<bp<hb<do<lo: -80163.6438737446
bp<fo<hb<do<lo: -80163.6438737446
lo<bp<fo<hb<do: -80163.4425195957
bp<lo<fo<hb<do: -80163.4425195957
lo<fo<bp<hb<do: -80163.3351137952
fo<lo<bp<hb<do: -80163.3351137952
hb<do<lo<fo<bp: -80156.9362613428
lo<do<hb<fo<bp: -80156.9362613428
do<lo<hb<fo<bp: -80156.9362613428
do<hb<lo<fo<bp: -80156.9362613428
lo<do<fo<hb<bp: -80156.9360706421
do<lo<fo<hb<bp: -80156.9360706421
lo<do<fo<bp<hb: -80156.9324558728
do<lo<fo<bp<hb: -80156.9324558727
lo<fo<hb<do<bp: -80155.0027641004
fo<lo<hb<do<bp: -80155.0027641003
fo<hb<lo<do<bp: -80155.0027641003
hb<fo<lo<do<bp: -80155.0027641003
fo<hb<do<lo<bp: -80155.0027365376
hb<fo<do<lo<bp: -80155.0027365376
fo<hb<do<bp<lo: -80155.0018625136
hb<fo<do<bp<lo: -80155.0018625136
hb<bp<do<fo<lo: -80152.0513739089
bp<hb<do<fo<lo: -80152.0513739089
hb<do<fo<lo<bp: -80146.4381906629
do<fo<hb<lo<bp: -80146.4381906629
do<hb<fo<lo<bp: -80146.4381906629
fo<do<hb<lo<bp: -80146.4381906628
do<fo<lo<hb<bp: -80146.4381107781
lo<fo<do<hb<bp: -80146.4381107781
fo<lo<do<hb<bp: -80146.4381107781
fo<do<lo<hb<bp: -80146.4381107781
hb<do<fo<bp<lo: -80146.4373166389
do<fo<hb<bp<lo: -80146.4373166389
do<hb<fo<bp<lo: -80146.4373166389
fo<do<hb<bp<lo: -80146.4373166388
do<fo<lo<bp<hb: -80146.4344960088
lo<fo<do<bp<hb: -80146.4344960088
fo<lo<do<bp<hb: -80146.4344960087
fo<do<lo<bp<hb: -80146.4344960087
hb<do<bp<fo<lo: -80146.4338902897
bp<do<hb<fo<lo: -80146.4338902896
do<bp<hb<fo<lo: -80146.4338902896
do<hb<bp<fo<lo: -80146.4338902896
do<fo<bp<hb<lo: -80146.4337014945
bp<do<fo<hb<lo: -80146.4337014944
do<bp<fo<hb<lo: -80146.4337014944
fo<do<bp<hb<lo: -80146.4337014944
do<fo<bp<lo<hb: -80146.4336219636
bp<do<fo<lo<hb: -80146.4336219636
do<bp<fo<lo<hb: -80146.4336219636
fo<do<bp<lo<hb: -80146.4336219636
fo<bp<do<hb<lo: -80144.4612620892
bp<fo<do<hb<lo: -80144.4612620892
fo<bp<lo<do<hb: -80144.4612086953
bp<fo<lo<do<hb: -80144.4612086953
fo<bp<do<lo<hb: -80144.4611825584
bp<fo<do<lo<hb: -80144.4611825584
lo<bp<fo<do<hb: -80144.2598027103
bp<lo<fo<do<hb: -80144.2598027103
lo<fo<bp<do<hb: -80144.1523969098
fo<lo<bp<do<hb: -80144.1523969098
Last edited by M Charles on Mon Aug 25, 2014 4:13 pm, edited 2 times in total.
M Charles
 
Posts: 23
Joined: Sun Jun 22, 2014 5:00 pm

Re: Test #2 (Order score): Charniak Figure 1

Postby M Charles » Mon Aug 25, 2014 3:37 pm

Results
The last order does match the original network. So, this is a good sign. It appears to be 9.04% of the total score.

However, the order that tied for best score does not match the original network (it puts light-on (lo) as the least element, so it cannot match the network's fo->lo).

I put a couple of the other total orders that matched the original network in bold font.

For 50000 entries on my 2.4GHz Core 2 Duo MacBook, it took (using BSD time command):
22.80s user 0.07s system 98% cpu 23.325 total

I expect it to be faster on the server.
M Charles
 
Posts: 23
Joined: Sun Jun 22, 2014 5:00 pm

Re: Test #2 (Order score): Charniak Figure 1

Postby M Charles » Thu Aug 28, 2014 10:17 pm

The first 2000 entries (order score fraction):

bp<lo<hb<do<fo: -3361.14703168866 5.56571132575819e-10
lo<bp<hb<do<fo: -3361.14703168866 5.56571132576072e-10
bp<hb<lo<do<fo: -3360.95410402772 6.75006718956221e-10
hb<bp<lo<do<fo: -3360.95410402772 6.75006718956221e-10
lo<hb<bp<do<fo: -3360.95410402457 6.75006721084664e-10
hb<lo<bp<do<fo: -3360.95410402457 6.75006721084664e-10
hb<lo<do<bp<fo: -3358.42154427445 8.49541935752207e-09
lo<hb<do<bp<fo: -3358.42154427445 8.49541935752594e-09
hb<lo<do<fo<bp: -3357.98143782947 1.31923031403761e-08
lo<hb<do<fo<bp: -3357.98143782947 1.31923031403821e-08
bp<lo<hb<fo<do: -3355.18291804798 2.16621880092282e-07
lo<bp<hb<fo<do: -3355.18291804798 2.16621880092479e-07
bp<hb<lo<fo<do: -3354.98999038704 2.62717945608207e-07
hb<bp<lo<fo<do: -3354.98999038704 2.62717945608327e-07
hb<lo<bp<fo<do: -3354.98999038388 2.62717946436614e-07
lo<hb<bp<fo<do: -3354.98999038388 2.62717946436734e-07
hb<lo<fo<bp<do: -3354.59914531726 3.88357410349763e-07
lo<hb<fo<bp<do: -3354.59914531726 3.88357410349939e-07
hb<bp<do<lo<fo: -3353.32290152443 1.39154492971435e-06
bp<hb<do<lo<fo: -3353.32290152443 1.39154492971499e-06
hb<fo<lo<bp<do: -3352.80511416966 2.33544381781458e-06
fo<lo<hb<bp<do: -3352.80511416966 2.3354438178167e-06
fo<hb<lo<bp<do: -3352.80511416966 2.3354438178167e-06
lo<fo<hb<bp<do: -3352.80511416966 2.33544381781989e-06
hb<fo<bp<lo<do: -3352.53824686565 3.049779365861e-06
fo<hb<bp<lo<do: -3352.53824686565 3.04977936586239e-06
bp<hb<fo<lo<do: -3352.53824681241 3.04977952821184e-06
hb<bp<fo<lo<do: -3352.53824681241 3.04977952821462e-06
hb<fo<bp<do<lo: -3352.53765427116 3.05158718389695e-06
fo<hb<bp<do<lo: -3352.53765427116 3.05158718389834e-06
bp<hb<fo<do<lo: -3352.53765421793 3.05158734634542e-06
hb<bp<fo<do<lo: -3352.53765421793 3.05158734634681e-06
lo<do<hb<bp<fo: -3352.05052672721 4.96686763745536e-06
do<lo<hb<bp<fo: -3352.05052672721 4.96686763745762e-06
hb<do<lo<bp<fo: -3352.05052672713 4.96686763785062e-06
do<hb<lo<bp<fo: -3352.05052672713 4.96686763785514e-06
lo<do<bp<fo<hb: -3352.01544344325 5.14421442903253e-06
do<lo<bp<fo<hb: -3352.01544344325 5.14421442903487e-06
bp<do<lo<fo<hb: -3352.01544344298 5.14421443041974e-06
do<bp<lo<fo<hb: -3352.01544344298 5.1442144304291e-06
bp<do<hb<lo<fo: -3351.99953333837 5.22671396801057e-06
do<bp<hb<lo<fo: -3351.99953333837 5.2267139680177e-06
lo<do<bp<hb<fo: -3351.99952432238 5.22676109226029e-06
do<lo<bp<hb<fo: -3351.99952432238 5.22676109226266e-06
bp<do<lo<hb<fo: -3351.99952432211 5.22676109366976e-06
do<bp<lo<hb<fo: -3351.9995243221 5.22676109367927e-06
hb<do<bp<lo<fo: -3351.98835554487 5.28546483829881e-06
do<hb<bp<lo<fo: -3351.98835554487 5.28546483830361e-06
lo<hb<fo<do<bp: -3351.78213474221 6.49596602289866e-06
hb<lo<fo<do<bp: -3351.78213474221 6.49596602289866e-06
lo<do<fo<hb<bp: -3351.65237721913 7.39599690795095e-06
do<lo<fo<hb<bp: -3351.65237721913 7.39599690795767e-06
fo<lo<bp<hb<do: -3351.64630190723 7.44106666379973e-06
lo<fo<bp<hb<do: -3351.64630190723 7.4410666638065e-06
lo<do<hb<fo<bp: -3351.61042028223 7.71291219113483e-06
do<lo<hb<fo<bp: -3351.61042028223 7.71291219113833e-06
hb<do<lo<fo<bp: -3351.61042028215 7.71291219174863e-06
do<hb<lo<fo<bp: -3351.61042028215 7.71291219175564e-06
lo<do<fo<bp<hb: -3351.44053093987 9.14114064489001e-06
do<lo<fo<bp<hb: -3351.44053093987 9.14114064489832e-06
bp<fo<lo<hb<do: -3351.43764664605 9.16754444021929e-06
fo<bp<lo<hb<do: -3351.43764664605 9.16754444022346e-06
bp<lo<fo<hb<do: -3351.39157880695 9.59975241114778e-06
lo<bp<fo<hb<do: -3351.39157880695 9.59975241115214e-06
bp<fo<hb<lo<do: -3351.32351473456 1.02759003313487e-05
fo<bp<hb<lo<do: -3351.32351473455 1.02759003313534e-05
bp<lo<do<fo<hb: -3351.32331928241 1.02779089743857e-05
lo<bp<do<fo<hb: -3351.32331928241 1.02779089743857e-05
fo<bp<hb<do<lo: -3351.32292214007 1.02819915778752e-05
bp<fo<hb<do<lo: -3351.32292214007 1.02819915778752e-05
bp<lo<do<hb<fo: -3351.30740016154 1.04428334934738e-05
lo<bp<do<hb<fo: -3351.30740016154 1.04428334934738e-05
fo<lo<hb<do<bp: -3349.98810359461 3.90644372544583e-05
fo<hb<lo<do<bp: -3349.98810359461 3.90644372544583e-05
hb<fo<lo<do<bp: -3349.98810359461 3.90644372544583e-05
lo<fo<hb<do<bp: -3349.98810359461 3.90644372545294e-05
hb<fo<do<lo<bp: -3349.98741729149 3.90912565015656e-05
fo<hb<do<lo<bp: -3349.98741729149 3.90912565015834e-05
hb<fo<do<bp<lo: -3349.79325870761 4.74680762892605e-05
fo<hb<do<bp<lo: -3349.79325870761 4.74680762893037e-05
hb<bp<do<fo<lo: -3345.40455785537 0.00382287585210157
bp<hb<do<fo<lo: -3345.40455785537 0.00382287585210331
fo<lo<do<hb<bp: -3344.6548803849 0.00809041842264054
fo<do<lo<hb<bp: -3344.6548803849 0.00809041842264054
do<fo<lo<hb<bp: -3344.6548803849 0.00809041842264789
lo<fo<do<hb<bp: -3344.6548803849 0.00809041842265525
fo<do<hb<lo<bp: -3344.4749346771 0.00968546355118614
hb<do<fo<lo<bp: -3344.4749346771 0.00968546355118614
do<fo<hb<lo<bp: -3344.47493467709 0.00968546355119495
do<hb<fo<lo<bp: -3344.47493467709 0.00968546355119495
fo<lo<do<bp<hb: -3344.44303410564 0.00999941638669804
fo<do<lo<bp<hb: -3344.44303410564 0.00999941638669804
lo<fo<do<bp<hb: -3344.44303410564 0.00999941638671623
do<fo<lo<bp<hb: -3344.44303410564 0.00999941638671623
fo<do<hb<bp<lo: -3344.28077609322 0.0117609502453919
hb<do<fo<bp<lo: -3344.28077609322 0.0117609502453919
do<fo<hb<bp<lo: -3344.28077609322 0.0117609502454026
do<hb<fo<bp<lo: -3344.28077609322 0.0117609502454026
fo<do<bp<lo<hb: -3344.20889619509 0.0126374501599776
do<fo<bp<lo<hb: -3344.20889619509 0.0126374501599891
bp<do<fo<lo<hb: -3344.20889619363 0.0126374501783272
do<bp<fo<lo<hb: -3344.20889619363 0.0126374501783387
bp<do<hb<fo<lo: -3344.0811896693 0.0143589173353182
do<bp<hb<fo<lo: -3344.0811896693 0.0143589173353378
fo<do<bp<hb<lo: -3344.07912533536 0.014388589551956
do<fo<bp<hb<lo: -3344.07912533536 0.0143885895519691
bp<do<fo<hb<lo: -3344.07912533391 0.0143885895728549
do<bp<fo<hb<lo: -3344.0791253339 0.014388589572868
hb<do<bp<fo<lo: -3344.0700118758 0.014520318723458
do<hb<bp<fo<lo: -3344.0700118758 0.0145203187234712
fo<lo<bp<do<hb: -3342.75265267911 0.0542123182436767
lo<fo<bp<do<hb: -3342.75265267911 0.054212318243726
bp<fo<lo<do<hb: -3342.54399741794 0.066790671171387
fo<bp<lo<do<hb: -3342.54399741794 0.0667906711714173
bp<fo<do<lo<hb: -3342.54355520846 0.0668202131707995
fo<bp<do<lo<hb: -3342.54355520846 0.0668202131708299
bp<lo<fo<do<hb: -3342.49792957884 0.0699395471493287
lo<bp<fo<do<hb: -3342.49792957884 0.0699395471493287
fo<bp<do<hb<lo: -3342.41378434873 0.0760793205051881
bp<fo<do<hb<lo: -3342.41378434873 0.0760793205051881

Valid orders in bold above make up 47.36% of the score of all orders (and ~71% of the score of the top 10 orders).
M Charles
 
Posts: 23
Joined: Sun Jun 22, 2014 5:00 pm


Return to Ordering Search of Structures in Bayesian Networks

Who is online

Users browsing this forum: No registered users and 1 guest