The Probabilistic Inference Challenge (PIC2011)

PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

The Probabilistic Inference Challenge (PIC2011)
Home
Overview
File Formats
Evaluation Criteria
Examples
Data Set
 
Leader Board
Live Leader Board
 
 
 
 

Live Leader Board

  • Lower scores are better
  • Baseline is asynchronous BP at same time frame so even if absolute
    performance improves as more time is given, numbers could go up
  • An INF score in the MPE column appears only when the solver
    returns a zero probability assignment for one (or more) of the networks
  • Score on leaderboard is a sum of the scores for each domain:
    click on the group name link to see the breakdown of performance.
  • In this “live” board old versions are removed when an update of a solver is submitted.
    Go to the static board to see the stable results

Time 20 seconds

Group NamePRMARMPE
agelfand37.3736--
ai9.90570.8486-
ai-lp0.85500.5916-
ali_m---
amartins---0.2750
AsynchBP131.98131.5056-0.0753
daoopt---6.1314
daoopt+jglp---6.1364
daoopt+mm---6.1298
daoopt-br---6.1314
dfbbve---4.5244
dfbbvemcs---6.0518
DGVNS---5.9461
DS---2.5082
dtrlow---
edbp4.13080.8016-
edbq10.24530.5235-
edbr2.17550.7828-
ficolofo---6.0819
ijgp-0.5236-
nutcracker3.25370.7056-5.2361
smp-0.5171-
toulbar2---5.6105
utd2.85733.0483-
vanilla-MPLP---3.1193
vg0.55261.9512-
vns/lds+cp---5.9368
yl790---2.6480

Time 20 minutes

Group NamePRMARMPE
agelfand140.9824--
ai0.24060.0207-
ai-lp0.28250.0589-
ali_m---
amartins--7.9543
AsynchBP126.10861.5469-0.1470
daoopt---7.7448
daoopt+jglp---7.8436
daoopt+mm---7.8320
daoopt-br---7.8519
dfbbve---7.4625
dfbbvemcs---7.8041
DGVNS---7.7020
DS---6.9067
dtrlow---
edbp1.43670.6650-
edbq4.30880.2194-
edbr1.68990.2998-
ficolofo---7.8000
ijgp-0.0195-
nutcracker1.91440.2978-4.3357
smp-0.0195-
toulbar2---5.9347
utd0.24050.0669-
vanilla-MPLP---7.0887
vg0.24050.0229-
vns/lds+cp---7.7887
yl790---7.2274

Time 1 hour

Group NamePRMARMPE
agelfand109.0386--
ai0.24050.0200-
ai-lp0.28250.0581-
ali_m---
amartins--55.6715
AsynchBP123.02781.36372.5766
daoopt---8.2213
daoopt+jglp---8.2768
daoopt+mm---8.3214
daoopt-br---8.2830
dfbbve---8.1039
dfbbvemcs---8.3033
DGVNS---8.2500
DS---6.6987
dtrlow---
edbp1.09910.1628-
edbq2.58160.3324-
edbr1.40860.1865-
ficolofo---8.3196
ijgp-0.0193-
nutcracker1.91440.2940-2.7702
smp-0.0446-
toulbar2---7.5764
utd0.23000.0260-
vanilla-MPLP---6.1250
vg0.24050.0215-
vns/lds+cp---8.3150
yl790---5.9204




| Contact admin |

2010 (C) The Hebrew University of Jerusalem, All rights reserved