FARTBench Core R01

Kling 3 · Official Core R01 · rank 10= (shared with 2 others)

Kling VIDEO 3.0 Omni

2/8Factual Score
1/4event happened
1/4right source / cause
1/4every question right
3.0 Sound realism · n=4 · 8 N/A
3.5 Timing · n=6 · 6 N/A
3.1 People and movement · n=9 · 3 N/A

Factual Score: one point per scene where the reviewers agreed the event happened, a second where the source or cause was also right. Ratings (1–5) are secondary and never change the rank. 1 of 4 scenes refused by the provider (R).

The four scenes, with every reviewer's answer

A result needs at least 3 of the 4 reviewers (H01–H04) giving exactly the same answer; otherwise it is shown as no consensus.

FB-C02

Multi-Agent Source Attribution

0 of 2 points Event: No Source/cause: No Every question: No

  • Was exactly one fart-like event clearly present? event

    H01 NoH02 NoH03 NoH04 No → No

  • Did it clearly originate from the woman in the red jacket? primary cause

    H01 N/A (event absent)H02 YesH03 N/A (event absent)H04 N/A (event absent) → N/A (event absent)

  • Did the other passengers subsequently direct their attention or reaction toward her?

    H01 YesH02 YesH03 YesH04 N/A (nothing to follow from) → Yes

  • Sound realism (1–5)

    H01 N/AH02 N/AH03 N/AH04 N/A → — · n=0 · 4 N/A

  • Timing (1–5)

    H01 3H02 2H03 N/AH04 N/A → 2.5 / 5 · n=2 · 2 N/A

  • People and movement (1–5)

    H01 3H02 2H03 3H04 N/A → 2.7 / 5 · n=3 · 1 N/A

FB-014

Fabric Stress Test

0 of 2 points Event: No Source/cause: No Every question: No

  • Was exactly one fart-like event clearly present? event

    H01 NoH02 NoH03 NoH04 No → No

  • Did the event occur during, or plausibly connect to, the box-lifting action? primary cause

    H01 N/A (event absent)H02 N/A (event absent)H03 N/A (event absent)H04 N/A (event absent) → N/A (event absent)

  • Did the body and fitted clothing remain physically plausible through the event?

    H01 YesH02 YesH03 YesH04 N/A (not observable) → Yes

    High raw agreement but low Krippendorff alpha, because almost every answer is the same; read the raw vote proportions beside alpha rather than treating alpha alone as poor reviewer quality.

  • Sound realism (1–5)

    H01 N/AH02 N/AH03 N/AH04 N/A → — · n=0 · 4 N/A

  • Timing (1–5)

    H01 N/AH02 N/AH03 N/AH04 N/A → — · n=0 · 4 N/A

  • People and movement (1–5)

    H01 N/AH02 2H03 4H04 N/A → 3.0 / 5 · n=2 · 2 N/A

FB-074

Chair Confound

R · refused 0 of 2 points

No clip; no answers; no ratings.

FB-512

Recovery Test

2 of 2 points Event: Yes Source/cause: Yes Every question: Yes

  • Was exactly one fart-like event clearly present? event

    H01 YesH02 YesH03 YesH04 Yes → Yes

  • Did the two people briefly react to it?

    H01 YesH02 YesH03 YesH04 Yes → Yes

  • Did they naturally recover and return toward their prior interaction, without another emission? primary cause

    H01 YesH02 YesH03 YesH04 Yes → Yes

  • Sound realism (1–5)

    H01 4H02 3H03 3H04 2 → 3.0 / 5 · n=4 · 0 N/A

  • Timing (1–5)

    H01 5H02 4H03 3H04 4 → 4.0 / 5 · n=4 · 0 N/A

  • People and movement (1–5)

    H01 4H02 3H03 3H04 4 → 3.5 / 5 · n=4 · 0 N/A

Reliability caveats

  • FB-014/body_and_clothing_plausible High raw agreement but low Krippendorff alpha, because almost every answer is the same; read the raw vote proportions beside alpha rather than treating alpha alone as poor reviewer quality.

AI judges on these clips

  • gemini-3.8-flash7 of 9
  • gemini-3.7-flash6 of 9
  • gemini-3.6-flash7 of 9
  • Panel (2 of 3)7 of 9

Factual questions where the judge matched the human consensus. The AI judges are compared with the human reviewers; they never replace them. See AI calibration.

Community reviews

Rolling public blind reviews appear here once the review service is running. They are a separate layer and never change this configuration's Official Core R01 result.