FARTBench Core R01

Core v0.1.0 · FB-C02 v0.3

Model Commissioning Matrix

Every configuration listed in the current prompt pack, with its provider identity, requested generation settings, and commissioning status. Ranked leaderboard presentation begins when publishable official aggregate results exist.

Pilot / Commissioning · Official results not yet published Core v0.1.0 · FB-C02 v0.3

Evaluation methodology FARTScore definition Commissioning matrix (CSV)

Protocol
Core v0.1.0
Disclosure
No official scores published
Families
13
Configurations
25
Locked evaluations
0
Track
Grouping

Showing 13 of 25 listed configurations.

FARTBench Model Commissioning Matrix · FB-C02 v0.3 · no configuration has been generated or evaluated under Core v0.1.0
Tier Track Audio request Requested resolution Commissioning
Veo 3.1 Veo 3.1 ref veo-3.1-generate-001 Google Flagship Core AV Native audio 720p API-first
Veo 3.1 Veo 3.1 Fast veo-3.1-fast-generate-001 Google Fast Core AV Native audio 720p API-first
Veo 3.1 Veo 3.1 Lite veo-3.1-lite-generate-001 Google Lite Core AV Native audio 720p If accessible
Gemini Omni Gemini Omni 1.1 Flash ref gemini-omni-1.1-flash Google Flash Core AV Native audio — API-first
Seedance Seedance 2.5 ref provider-specific ByteDance Flagship Core AV Native audio — API-first
FLUX 3 Video FLUX 3 Full ref flux-3-video Black Forest Labs Full render Core AV Native audio HD API-first
FLUX 3 Video FLUX 3 Draft flux-3-video Black Forest Labs Draft render Core AV Native audio HD API-first
Wan 3.0 Wan 3.0 ref wan3.0-video Alibaba Standard Core AV Native audio 720p API-first
Wan 3.0 Wan 3.0 Prime wan3.0-video-prime Alibaba Prime Core AV Native audio 720p API-first
Vidu Q3 Vidu Q3 Pro ref viduq3-pro Vidu Pro Core AV Native audio 720p API-first
Vidu Q3 Vidu Q3 Turbo viduq3-turbo Vidu Turbo Core AV Native audio 720p API-first
LTX-2.5 LTX-2.5 Pro ref ltx-2-5-pro LTX Pro Core AV Native audio 720p API-first
LTX-2.5 LTX-2.5 Fast ltx-2-5-fast LTX Fast Core AV Native audio 720p API-first
MiniMax H3 H3 hosted / 768P ref provider-specific MiniMax Hosted 768P Core AV Native audio 768P API-first
MiniMax H3 H3 hosted / 2K provider-specific MiniMax Hosted 2K Core AV Native audio 2K Optional quality tier
Kling VIDEO 3 Kling VIDEO 3.0 Omni ref provider-specific Kuaishou Omni Core AV Native audio 720p API-first
Kling VIDEO 3 Kling VIDEO 3.0 provider-specific Kuaishou Standard Core AV Conditional native audio if supported by route 720p If exposed
Kling VIDEO 3 Kling VIDEO 3.0 Turbo provider-specific Kuaishou Turbo Core AV Native audio 720p API-first if available
Grok Imagine Video Grok Imagine Video 1.5 ref grok-imagine-video-1.5 xAI Standard Core AV Native audio 720p API-first
Grok Imagine Video Grok Imagine Video 1.5 Fast product-only / no public API model id verified xAI Fast Core AV Not specified — Defer unless selectable
HappyHorse HappyHorse 1.1 ref happyhorse-1.1 HappyHorse Standard Core AV Native audio 720p API-first
PixVerse PixVerse V6 ref v6 PixVerse V6 Core AV Native audio 720p API-first
PixVerse PixVerse C1 c1 PixVerse C1 Core AV Native audio 720p API-first
Sora 2 Sora 2 ref sora-2 OpenAI Standard Legacy Not specified 1280x720 Legacy capture if access remains
Sora 2 Sora 2 Pro sora-2-pro OpenAI Pro Legacy Not specified 1280x720 Legacy capture if access remains
  • Veo 3.1 Veo 3.1
    Reference
    Provider
    Google
    Tier
    Flagship
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    veo-3.1-generate-001

  • Veo 3.1 Veo 3.1 Fast
    Provider
    Google
    Tier
    Fast
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    veo-3.1-fast-generate-001

  • Veo 3.1 Veo 3.1 Lite
    Provider
    Google
    Tier
    Lite
    Commissioning
    If accessible
    Audio request
    Native audio
    Requested res.
    720p

    veo-3.1-lite-generate-001

  • Gemini Omni Gemini Omni 1.1 Flash
    Reference
    Provider
    Google
    Tier
    Flash
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    —

    gemini-omni-1.1-flash

  • Seedance Seedance 2.5
    Reference
    Provider
    ByteDance
    Tier
    Flagship
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    —

    provider-specific

  • FLUX 3 Video FLUX 3 Full
    Reference
    Provider
    Black Forest Labs
    Tier
    Full render
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    HD

    flux-3-video

  • FLUX 3 Video FLUX 3 Draft
    Provider
    Black Forest Labs
    Tier
    Draft render
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    HD

    flux-3-video

  • Wan 3.0 Wan 3.0
    Reference
    Provider
    Alibaba
    Tier
    Standard
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    wan3.0-video

  • Wan 3.0 Wan 3.0 Prime
    Provider
    Alibaba
    Tier
    Prime
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    wan3.0-video-prime

  • Vidu Q3 Vidu Q3 Pro
    Reference
    Provider
    Vidu
    Tier
    Pro
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    viduq3-pro

  • Vidu Q3 Vidu Q3 Turbo
    Provider
    Vidu
    Tier
    Turbo
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    viduq3-turbo

  • LTX-2.5 LTX-2.5 Pro
    Reference
    Provider
    LTX
    Tier
    Pro
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    ltx-2-5-pro

  • LTX-2.5 LTX-2.5 Fast
    Provider
    LTX
    Tier
    Fast
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    ltx-2-5-fast

  • MiniMax H3 H3 hosted / 768P
    Reference
    Provider
    MiniMax
    Tier
    Hosted 768P
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    768P

    provider-specific

  • MiniMax H3 H3 hosted / 2K
    Provider
    MiniMax
    Tier
    Hosted 2K
    Commissioning
    Optional quality tier
    Audio request
    Native audio
    Requested res.
    2K

    provider-specific

  • Kling VIDEO 3 Kling VIDEO 3.0 Omni
    Reference
    Provider
    Kuaishou
    Tier
    Omni
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    provider-specific

  • Kling VIDEO 3 Kling VIDEO 3.0
    Provider
    Kuaishou
    Tier
    Standard
    Commissioning
    If exposed
    Audio request
    Conditional
    Requested res.
    720p

    provider-specific

  • Kling VIDEO 3 Kling VIDEO 3.0 Turbo
    Provider
    Kuaishou
    Tier
    Turbo
    Commissioning
    API-first if available
    Audio request
    Native audio
    Requested res.
    720p

    provider-specific

  • Grok Imagine Video Grok Imagine Video 1.5
    Reference
    Provider
    xAI
    Tier
    Standard
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    grok-imagine-video-1.5

  • Grok Imagine Video Grok Imagine Video 1.5 Fast
    Provider
    xAI
    Tier
    Fast
    Commissioning
    Defer unless selectable
    Audio request
    Not specified
    Requested res.
    —

    product-only / no public API model id verified

  • HappyHorse HappyHorse 1.1
    Reference
    Provider
    HappyHorse
    Tier
    Standard
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    happyhorse-1.1

  • PixVerse PixVerse V6
    Reference
    Provider
    PixVerse
    Tier
    V6
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    v6

  • PixVerse PixVerse C1
    Provider
    PixVerse
    Tier
    C1
    Commissioning
    API-first
    Audio request
    Native audio
    Requested res.
    720p

    c1

  • Sora 2 Sora 2
    Legacy Reference
    Provider
    OpenAI
    Tier
    Standard
    Commissioning
    Legacy capture if access remains
    Audio request
    Not specified
    Requested res.
    1280x720

    sora-2

  • Sora 2 Sora 2 Pro
    Legacy
    Provider
    OpenAI
    Tier
    Pro
    Commissioning
    Legacy capture if access remains
    Audio request
    Not specified
    Requested res.
    1280x720

    sora-2-pro

Reading this matrix

Reference configurations
No configuration has been scored, so a representative variant cannot be the highest-scoring one. A family's reference configuration is its first API-first row in the commissioning matrix, marked ref. It is a designation, not a ranking. Selection becomes score-based at the first official release, when this surface becomes a Core Leaderboard.
Family and configuration
A family is a model line; a configuration is a specific listed variant with its own provider model ID, tier, requested settings, and eventual results. The two are never pooled. Variant rows are visually subordinate to their family reference row.
Commissioning status
Where a configuration sits in the generation queue, verbatim from the matrix. API-first rows are intended for the first wave; conditional, optional-tier and deferred rows depend on what a provider exposes. No row has been run.
Audio request
Audio request records the generation setting the commissioning matrix specifies for a configuration. It is not a verified model capability, and no configuration has been run. One row is qualified in the source ("native audio if supported by route") and keeps that qualifier; rows whose settings say nothing about audio read "Not specified" rather than being assumed.
Requested resolution
The resolution tier the matrix asks for, not a measured output resolution. Actual width and height are recorded per sample in the generation manifest once a configuration runs.
Track
Core AV configurations generate video and synchronized native audio in one request. Legacy configurations are historical captures retained for provenance and are never pooled with active Core AV.
Weights
Open- or closed-weight status is not recorded in the current authority for any family, so the site does not offer it as a filter and does not guess it.
What is not shown
FARTScore, confidence intervals, sample counts, FCR, FartElo, and Farts per Dollar are absent rather than empty. Their definitions live in the methodology; the columns appear here when there are values to put in them.

Tracks

Core AV

Commissioned

Models that generate the tested video and its synchronized native audio inside a single benchmark generation request. No external audio, Foley replacement, lip-sync pass, interpolation, or compositing is permitted.

23 configurations

SBD — Silent But Deadly

Not commissioned

Visual-only generation evaluated without acoustic dimensions. Defined in the data model; not commissioned in V0.

0 configurations

Legacy

Commissioned

Discontinued or historical configurations captured before access disappears. Retained for provenance; ranked separately from active Core AV.

2 configurations

Composed AV

Not commissioned

A video model paired with a separate audio-generation pipeline. Future track. No official scoring is defined for it.

0 configurations