FARTBench Core R01 · Community
Leaderboard
Public reviewers watch the same anonymous clips and answer the same questions. Their answers form a separate, rolling Community layer. It never changes the Official R01 results.
How it works. A question on a clip is settled when the Wilson 95% lower bound of one answer's share is above one half; otherwise it stays unsettled and earns nothing. The Community rank uses the same Factual Score as the Official leaderboard — one point per scene where the event happened, a second where the source or cause was also right — but only once every clip of a configuration has at least 15 valid community reviews. Until then the row shows insufficient reviews and no provisional rank.
Community review responses and the Community data derived from them are released under CC0 1.0. The licence covers the Community data only, not the site code, the technical report, the videos or provider media.