FARTBench Core R01

FARTBench Core R01

Refusals

Some providers decline some prompts. That is a result about the configuration, and it is reported as one — not hidden, not worked around, and not scored as bad video.

Cells
64
Covered by a refusal
1

The rule

If a provider refuses the exact frozen prompt for a scene, that refusal is the canonical outcome for that cell. A clip generated afterwards from a reworded prompt may be kept as supplementary evidence, but it is excluded from the comparison: it answers a different prompt, and letting it stand in would reward rewriting around a filter.

How refusals are reported

  • As coverage. A configuration's refusal rate is the share of its cells refused.
  • Separately from quality. A refused cell has no clip, so it has no answers and no ratings. The results pages state how many cells each rate rests on.
  • In the ranking. A refused scene is still one of the four requested scenes: it earns no Factual Score points and is marked R — coverage, not a bad video (Overall Ranking V1, adopted after the reveal).
  • With the provider's own words. The recorded moderation message is published with the results.

Core R01 so far

Of 64 cells, 1 is covered by a refusal. Kling VIDEO 3.0 Omni × FB-074 was refused by the provider ; the provider's moderation response, verbatim: Prompt blocked as it may violate TOS, scat detected in prompt.