- Public Test: This phase evaluates algorithms on the FinQA public test set where the references are available.
A submission needs to consist of results on the entire public test set to be considered as a valid submission.
The leaderboard for the public test set is hosted here on Codalab.
- Private Test: This phase evaluates algorithms on the FinQA private test set with all references heldout.
A submission needs to consist of results on the entire test set to be considered as a valid submission.
This phase is aimed at the final evaluation of the model and one is not allowed to create multiple submissions using multiple teams.
The leaderboard for the private test set is hosted here on Codalab
The final evaluation of the model will be based on the results on the private test set.
Please first submit your results to both leaderboards.
Then please use the
official ARR style files available as an
Overleaf template to format your papers.
Submissions should have at least 4 pages and at most 8 pages of content, plus unlimited pages for references and appendices.
Please submit through our
Openreview submission site, and also upload to arxiv.
To be eligible for result archives and consideration for awards, we kindly request you to send the following information to zhiyuchen@cs.ucsb.edu using your main contact email:
- Team name.
- Team members.
- The username used in CodaLab submissions.
- The forum link to your paper submission on Openreview and the link to your arxiv submission.
Dual Sumbission: We also allow submissions that are under review in other venues or have preprint versions. But please make sure to follow dual submission policies from other venues.
Non-Archival: The paper submission will be non-archival. The winners can present their work at the workshop.
Anonymity Period: We do not enforce an anonymity period. We allow preprint servers such as arXiv at any point of time.
