DREAM4: Prediction Evaluations by Challenge


Challenge 3 : SignalingNetworkOriginal

Refer to the Challenge 3 Description for more information.

Updated results and Original results

The results table called SignalingNetworkOriginal was based on a cost per link that was determined empirically from the team with the lowest value of prediction_score / number of links. It later came to light that the team upon which the cost per link value was based made a submission error in their phosphoprotein predictions. Therefore, we re-scored the challenge using this team's (unofficial) corrected predictions, which affected the empirically determined cost per link, which in turn affected the overall score for every team. The updated results table is called SignalingNetworkUpdated. The three best-performers remain the same using either derivation of cost per link, but there are subtle changes in the rankings of the remainng teams.

Definitions

Predictive Signaling Network Modeling Results

TEAM  OVERALL SCORE  EDGE COUNT  PREDICTION SCORE  AKT PVAL  ERK12 PVAL  IKB PVAL  JNK12 PVAL  P38 PVAL  HSP27 PVAL  MEK12 PVAL 
Team 3953.07515.0003.9467.927e-049.758e-081.032e-048.359e-059.302e-031.461e-022.625e-06
Team 5333.61026.0005.1211.327e-032.801e-093.062e-071.746e-061.166e-042.355e-032.625e-06
Team 4710.47754.0003.6144.426e-036.056e-071.481e-041.189e-061.122e-031.247e-027.590e-03
Team 3470.74019.0001.8443.811e-036.802e-015.080e-051.000e+001.620e-039.051e-036.406e-02
Team 4413.89518.0004.9411.653e-031.337e-073.062e-071.451e-065.206e-056.246e-048.148e-06
Team 491-0.00018.0001.0462.380e-022.424e-057.147e-019.608e-018.457e-015.312e-012.695e-01
Team 5440.36418.0001.4104.172e-034.489e-058.712e-021.000e+009.949e-011.134e-017.307e-02
Team 4763.83017.0004.8184.300e-037.457e-095.715e-071.451e-062.462e-052.869e-031.006e-04
Team 4513.35517.0004.3431.490e-034.123e-081.389e-062.151e-041.967e-041.181e-039.389e-05
Team 5041.85810.0002.4394.624e-031.626e-057.385e-038.713e-042.573e-033.385e-022.000e-01
Team 2563.28722.0004.5651.811e-034.090e-073.909e-071.451e-064.901e-046.040e-038.858e-06
Team 3142.58227.0004.1512.432e-031.382e-051.908e-062.075e-064.901e-046.788e-031.990e-05