Instructions

In order to properly submit, please submit a CSV file with two columns. The first column should contain the PromptIDs, while the second column should contain the corresponding prediction (an integer value of -1, 0, 1). The PromptIDs should exclusively contain only the IDs listed as test IDs.

Submission

Email address:
System Display Name:
Submission Display Name:
System Description:
CSV Output File:


Final Submit:

Leaderboard

System NameDateF1-scorePrecisionRecall
Pipelined BioBERT
Yidu Cloud AI Lab
07/23/20190.7970.7960.797

Baseline

Model TypeF1-scorePrecisionRecall
Majority0.1950.1380.333
Heuristics0.3540.4310.389
Logistic Regression0.3580.4020.386
NN + Attention0.5050.5180.503
NN + Pretrain Cond. Attention0.5310.5330.530
BERT Pipeline0.7490.7500.750