*** AIDA *** STANDARD RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 3421 665 3421 1064 0.837 0.763 0.798 strong_link_match 3369 717 3369 1116 0.825 0.751 0.786 strong_typed_link_match 5233 180 5233 383 0.967 0.932 0.949 strong_typed_mention_match JPARK_N (YAGO) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 3425 633 3425 1060 0.844 0.764 0.802 strong_link_match 3377 681 3377 1108 0.832 0.753 0.791 strong_typed_link_match 5239 174 5239 377 0.968 0.933 0.950 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-yago.aida.combined.tsv strong_typed_mention_match -0.001 0.184 -0.001 0.184 -0.001 0.184 baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-yago.aida.combined.tsv strong_link_match -0.007 0.000 -0.001 0.118 -0.004 0.000 baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-yago.aida.combined.tsv strong_typed_link_match -0.008 0.001 -0.002 0.094 -0.004 0.004 JPARK (DBPEDIA) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 3419 639 3419 1066 0.843 0.762 0.800 strong_link_match 3369 689 3369 1116 0.830 0.751 0.789 strong_typed_link_match 5237 176 5237 379 0.967 0.933 0.950 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.aida.combined.tsv strong_typed_mention_match -0.001 0.338 -0.001 0.338 -0.001 0.338 baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.aida.combined.tsv strong_link_match -0.005 0.002 +0.000 0.421 -0.002 0.046 baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.aida.combined.tsv strong_typed_link_match -0.006 0.008 +0.000 0.546 -0.003 0.080 JPARK (Wikidata) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 3424 634 3424 1061 0.844 0.763 0.802 strong_link_match 3375 683 3375 1110 0.832 0.753 0.790 strong_typed_link_match 5236 177 5236 380 0.967 0.932 0.949 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-wikidata.aida.combined.tsv strong_typed_mention_match -0.001 0.375 -0.001 0.375 -0.001 0.375 baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-wikidata.aida.combined.tsv strong_link_match -0.007 0.000 -0.001 0.369 -0.003 0.012 baseline.aida.combined.tsv.aida.combined.tsv data-flair-E2ENEL/JPARK-wikidata.aida.combined.tsv strong_typed_link_match -0.007 0.001 -0.001 0.248 -0.004 0.016 *** MEANTIME *** STANDARD RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 446 94 446 279 0.826 0.615 0.705 strong_link_match 423 117 423 302 0.783 0.583 0.669 strong_typed_link_match 617 50 617 176 0.925 0.778 0.845 strong_typed_mention_match JPARK (YAGO) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 446 93 446 279 0.827 0.615 0.706 strong_link_match 427 112 427 298 0.792 0.589 0.676 strong_typed_link_match 621 46 621 172 0.931 0.783 0.851 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-yago.meantime.combined.tsv strong_typed_mention_match -0.006 0.147 -0.005 0.147 -0.005 0.147 baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-yago.meantime.combined.tsv strong_link_match -0.002 0.498 +0.000 1.000 -0.001 0.498 baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-yago.meantime.combined.tsv strong_typed_link_match -0.009 0.061 -0.006 0.111 -0.007 0.061 JPARK (DBpedia) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 446 93 446 279 0.827 0.615 0.706 strong_link_match 429 110 429 296 0.796 0.592 0.679 strong_typed_link_match 623 44 623 170 0.934 0.786 0.853 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.meantime.combined.tsv strong_typed_mention_match -0.009 0.036 -0.008 0.036 -0.008 0.036 baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.meantime.combined.tsv strong_link_match -0.002 0.503 +0.000 1.000 -0.001 0.503 baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.meantime.combined.tsv strong_typed_link_match -0.013 0.006 -0.008 0.014 -0.010 0.006 JPARK (Wikidata) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 446 93 446 279 0.827 0.615 0.706 strong_link_match 429 110 429 296 0.796 0.592 0.679 strong_typed_link_match 623 44 623 170 0.934 0.786 0.853 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-wikidata.meantime.combined.tsv strong_typed_mention_match -0.009 0.037 -0.008 0.037 -0.008 0.037 baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-wikidata.meantime.combined.tsv strong_link_match -0.002 0.499 +0.000 1.000 -0.001 0.499 baseline.meantime.combined.tsv data-flair-E2ENEL/JPARK-wikidata.meantime.combined.tsv strong_typed_link_match -0.013 0.008 -0.008 0.014 -0.010 0.008 *** TAC-KBP *** STANDARD RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 998 683 998 1678 0.594 0.373 0.458 strong_link_match 975 706 975 1701 0.580 0.364 0.448 strong_typed_link_match 3727 149 3727 1242 0.962 0.750 0.843 strong_typed_mention_match JPARK (YAGO) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 991 654 991 1685 0.602 0.370 0.459 strong_link_match 977 668 977 1699 0.594 0.365 0.452 strong_typed_link_match 3743 133 3743 1226 0.966 0.753 0.846 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-yago.tac.combined.tsv strong_typed_mention_match -0.004 0.003 -0.003 0.003 -0.004 0.003 baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-yago.tac.combined.tsv strong_link_match -0.009 0.021 +0.003 0.044 -0.001 0.409 baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-yago.tac.combined.tsv strong_typed_link_match -0.014 0.002 -0.001 0.417 -0.005 0.040 JPARK (DBpedia) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 996 649 996 1680 0.605 0.372 0.461 strong_link_match 983 662 983 1693 0.598 0.367 0.455 strong_typed_link_match 3744 132 3744 1225 0.966 0.753 0.847 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.tac.combined.tsv strong_typed_mention_match -0.004 0.002 -0.003 0.002 -0.004 0.002 baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.tac.combined.tsv strong_link_match -0.012 0.000 +0.001 0.409 -0.003 0.075 baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.tac.combined.tsv strong_typed_link_match -0.018 0.000 -0.003 0.127 -0.007 0.006 JPARK (Wikidata) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 1017 628 1017 1659 0.618 0.380 0.471 strong_link_match 1005 640 1005 1671 0.611 0.376 0.465 strong_typed_link_match 3746 130 3746 1223 0.966 0.754 0.847 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-wikidata.tac.combined.tsv strong_typed_mention_match -0.005 0.002 -0.004 0.002 -0.004 0.002 baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-wikidata.tac.combined.tsv strong_link_match -0.025 0.000 -0.007 0.059 -0.013 0.003 baseline.tac.combined.tsv data-flair-E2ENEL/JPARK-wikidata.tac.combined.tsv strong_typed_link_match -0.031 0.000 -0.011 0.005 -0.018 0.000 *** MERGED *** STANDARD RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 4865 1442 4865 3021 0.771 0.617 0.686 strong_link_match 4767 1540 4767 3119 0.756 0.604 0.672 strong_typed_link_match 9577 379 9577 1801 0.962 0.842 0.898 strong_typed_mention_match JPARK (YAGO) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 4862 1380 4862 3024 0.779 0.617 0.688 strong_link_match 4781 1461 4781 3105 0.766 0.606 0.677 strong_typed_link_match 9603 353 9603 1775 0.965 0.844 0.900 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.all.combined.tsv data-flair-E2ENEL/JPARK-yago.all.combined.tsv strong_typed_mention_match -0.003 0.000 -0.002 0.000 -0.002 0.000 baseline.all.combined.tsv data-flair-E2ENEL/JPARK-yago.all.combined.tsv strong_link_match -0.008 0.000 +0.000 0.334 -0.003 0.002 baseline.all.combined.tsv data-flair-E2ENEL/JPARK-yago.all.combined.tsv strong_typed_link_match -0.010 0.000 -0.002 0.056 -0.005 0.000 JPARK (DBpedia) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 4861 1381 4861 3025 0.779 0.616 0.688 strong_link_match 4781 1461 4781 3105 0.766 0.606 0.677 strong_typed_link_match 9604 352 9604 1774 0.965 0.844 0.900 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.all.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.all.combined.tsv strong_typed_mention_match -0.003 0.003 -0.002 0.003 -0.003 0.003 baseline.all.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.all.combined.tsv strong_link_match -0.007 0.000 +0.001 0.305 -0.003 0.003 baseline.all.combined.tsv data-flair-E2ENEL/JPARK-dbpedia.all.combined.tsv strong_typed_link_match -0.010 0.000 -0.002 0.095 -0.005 0.000 JPARK (Wikidata) RESULTS: (gold mentions) ptp fp rtp fn precis recall fscore measure 4887 1355 4887 2999 0.783 0.620 0.692 strong_link_match 4809 1433 4809 3077 0.770 0.610 0.681 strong_typed_link_match 9605 351 9605 1773 0.965 0.844 0.900 strong_typed_mention_match sys1 sys2 measure d-precis p-precis d-recall p-recall d-fscore p-fscore baseline.all.combined.tsv data-flair-E2ENEL/JPARK-wikidata.all.combined.tsv strong_typed_mention_match -0.003 0.000 -0.002 0.000 -0.003 0.000 baseline.all.combined.tsv data-flair-E2ENEL/JPARK-wikidata.all.combined.tsv strong_link_match -0.012 0.000 -0.003 0.052 -0.006 0.000 baseline.all.combined.tsv data-flair-E2ENEL/JPARK-wikidata.all.combined.tsv strong_typed_link_match -0.015 0.000 -0.005 0.000 -0.009 0.000