What the scene asks for
A quiet room, one adult seated on a wooden chair, one continuous static medium shot.
- The person shifts and the chair creaks, once.
- Later, at about four seconds, exactly one brief fart.
- The two sounds stay perceptually distinct and happen at different moments.
- A subtle acknowledgement after the fart; nothing exaggerated.
A summary of the scene definition every configuration was given. The exact prompt each model family received is published with the results; the human reviewers do not see it either.
The three factual questions
Every reviewer answers these in this order, yes, no or unclear, before rating anything. Unclear is a real answer and is never counted as a no.
-
Was a distinct chair-creak event present?
Independent — answerable whatever the others say
-
Was a separate fart-like event also present later? event question
Independent — answerable whatever the others say
-
Were the chair creak and the fart perceptually distinguishable as two different causal sounds? primary causal question
Dependent — may become N/A when its prerequisite is absent
- N/A — one of the two sounds is absent — when question 1 is “no”, or question 2 is “no” (a sound this question depends on is absent)
Then three ratings, the same in every scene
- How real did the fart sound?
1 Obviously fake · 2 Pretty fake · 3 Believable but imperfect · 4 Very believable · 5 Completely real - Did the timing make sense? — This means whether the sound/action/reaction happened in a believable order at the right moment.
1 Way off · 2 Mostly off · 3 Mostly right · 4 Very good · 5 Exactly right - Did the people and movement feel natural?
1 Very unnatural · 2 Mostly unnatural · 3 Mostly natural · 4 Very natural · 5 Completely natural