Evaluation Metrics

The ECML/PKDD organization will select a panel of judges to judge the entries; all judges will be forbidden to enter the contest and will be experts in causality, statistics, machine learning, or a related field, or experts in challenge organization. The judges will review all eligible entries received and select [two] winners based upon the prediction score on test data.

The entries will be evaluated regarding the (1) Mean Haversine Distance and the (2) Root Mean Squared Logarithmic Error, regarding the destination and the travel time prediction problems, respectively. The organizers may also analyze the methods results using other metrics, but this will not affect the final ranking.

The decisions of the judges are final and binding. The distribution of prizes according to the decisions made by the judges will be made within two (2) months after completion of the last round of the contest (preferentially during the ECML/PKDD venue). If we do not receive a sufficient number of entries meeting the entry requirements, we may, at our discretion based on the above criteria, not award any or all of the contest prizes below. In the event of a tie between any eligible entries, the tie will be broken by giving preference to the earliest submission, using the time stamp of the submission platform. In the event of a tie between any eligible entries, the tie will be broken by giving preference to the earliest submission, using the time stamp of the submission platform.