Rank
Creator
model
Bradley-Terry
Elo
Wins
Matches
1
ai logo
OpenAI
4o-26-3-25
1232.851073.39143945259989
2
ai logo
Black Forest Labs
flux-1-pro
1118.541038.029429491758418
3
ai logo
Hidream AI
hidream-I1-full
1107.541034.23111009211420
4
ai logo
Black Forest Labs
flux-1.1-pro
1070.661022.145971211154140
5
ai logo
Reve AI
halfmoon-4-4-25
1031.131008.46208895411614
6
ai logo
Ideogram
ideogram
1029.561007.93128334254353
7
ai logo
Recraft
recraft-v2
1023.621005.825450471071663
8
ai logo
OpenGVLab
lumina-17-2-25
1005.20999.30169749336565
9
ai logo
xAI
aurora-20-1-25
1004.91999.07376016753139
10
ai logo
Google DeepMind
imagen-3
1004.87999.065622881137009
11
ai logo
Runway
frames-23-1-25
971.56986.78318794649573
12
ai logo
OpenAI
dalle-3
944.71976.587843501610583
13
ai logo
Stability AI
stable-diffusion-3
926.53969.496342581313010
14
ai logo
Midjourney
midjourney-5.2
889.23954.547013411495158
15
ai logo
DeepSeek
janus-7b
819.85925.20117343266244

What is "Bradley-Terry"?

The Bradley-Terry ranking model is a probabilistic model used to predict outcomes in pairwise comparisons. It assigns a strength parameter (reported score) to each item, indicating its likelihood of winning against another. See the wikipedia article for mathematical details.

What do we consider as "Overall preference"?

Here we evaluate the model across all criteria and determine which model has the best overall performance.

All results are directly based on feedback from real human raters. The process of how we came out with results is best described in our blog post.

Examples

Visual examples of the annotators’ preferences

Preference
Which image looks better overall?
flux-1-pro_winner
FLUX.1 [pro]
flux-1-pro_winner
Midjourney
Coherence
Which image feels less weird or unnatural for its style when you look closely? I.e. fewer odd or strange-looking objects or elements
flux-1-pro_winner
FLUX.1 [pro]
flux-1-pro_winner
Midjourney
Alignment
Which image is more aligned with and better adheres to the prompt:
A black and white picture of a white man singing a song
flux-1-pro_winner
FLUX.1 [pro]
flux-1-pro_winner
Midjourney