The following table shows the improvement results for the best MTurk designs, as determined by the MTurk order HIT. Two designs were chosen from each ordering.
For AB comparisons, the left/right order of the original/improved was flipped randomly. Duplicates were also added to remove inconsistent users.
InfoOriginalImproved
Row 1
Design absdesign
User A1ZB0Q47TF8BAX

Original Design Votes: 9 (21%)
Improved Design Votes: 34 (79%)
Statistically Significant: True
Row 2
Design absdesign
User A31MPGBY92OWW

Original Design Votes: 25 (30%)
Improved Design Votes: 59 (70%)
Statistically Significant: True
Row 3
Design absdesign
User A1ZB0Q47TF8BAX

Original Design Votes: 23 (27%)
Improved Design Votes: 61 (73%)
Statistically Significant: True
Row 4
Design absdesign
User A2FQJTT7FWUAAB

Original Design Votes: 12 (14%)
Improved Design Votes: 74 (86%)
Statistically Significant: True
Row 5
Design absdesign
User A1KJ2WRVURHN5G

Original Design Votes: 15 (37%)
Improved Design Votes: 26 (63%)
Statistically Significant: False
Row 6
Design absdesign
User A1SR1SZA08EP2V

Original Design Votes: 17 (41%)
Improved Design Votes: 24 (59%)
Statistically Significant: False
Row 7
Design absdesign
User A1SX7V7C6MFTN9

Original Design Votes: 10 (8%)
Improved Design Votes: 114 (92%)
Statistically Significant: True
Row 8
Design absdesign
User A31WJI6976HZ0M

Original Design Votes: 6 (7%)
Improved Design Votes: 76 (93%)
Statistically Significant: True
Row 9
Design absdesign
User A1H7TFURB0HWA2

Original Design Votes: 14 (35%)
Improved Design Votes: 26 (65%)
Statistically Significant: False
Row 10
Design absdesign
User A2FQJTT7FWUAAB

Original Design Votes: 23 (56%)
Improved Design Votes: 18 (44%)
Statistically Significant: False
Row 11
Design absdesign
User A2FQJTT7FWUAAB

Original Design Votes: 21 (50%)
Improved Design Votes: 21 (50%)
Statistically Significant: False
Row 12
Design absdesign
User A3UJ3YXKD24YPW

Original Design Votes: 30 (75%)
Improved Design Votes: 10 (25%)
Statistically Significant: True
Row 13
Design absdesign
User A2FQJTT7FWUAAB

Original Design Votes: 8 (19%)
Improved Design Votes: 35 (81%)
Statistically Significant: True
Row 14
Design absdesign
User A2TL7IBOE632XF

Original Design Votes: 11 (26%)
Improved Design Votes: 32 (74%)
Statistically Significant: True
Row 15
Design absdesign
User A2SFP0U6HGY64G

Original Design Votes: 24 (62%)
Improved Design Votes: 15 (38%)
Statistically Significant: False
Row 16
Design absdesign
User AZ64UCV9DRPB0

Original Design Votes: 16 (42%)
Improved Design Votes: 22 (58%)
Statistically Significant: False
Row 17
Design artshow
User A1ZB0Q47TF8BAX

Original Design Votes: 29 (36%)
Improved Design Votes: 52 (64%)
Statistically Significant: True
Row 18
Design artshow
User A3CV537R0EFWFI

Original Design Votes: 22 (52%)
Improved Design Votes: 20 (48%)
Statistically Significant: False
Row 19
Design artshow
User A2FQJTT7FWUAAB

Original Design Votes: 26 (63%)
Improved Design Votes: 15 (37%)
Statistically Significant: False
Row 20
Design artshow
User AP06TRYS8165J

Original Design Votes: 28 (65%)
Improved Design Votes: 15 (35%)
Statistically Significant: False
Row 21
Design artshow
User A2FQJTT7FWUAAB

Original Design Votes: 41 (48%)
Improved Design Votes: 45 (52%)
Statistically Significant: False
Row 22
Design artshow
User AYLD14EI9Q925

Original Design Votes: 18 (43%)
Improved Design Votes: 24 (57%)
Statistically Significant: False
Row 23
Design artshow
User A2FQJTT7FWUAAB

Original Design Votes: 17 (44%)
Improved Design Votes: 22 (56%)
Statistically Significant: False
Row 24
Design artshow
User AHLADH7JTJRO8

Original Design Votes: 28 (67%)
Improved Design Votes: 14 (33%)
Statistically Significant: True
Row 25
Design artshow
User A21W2URWEP4R0F

Original Design Votes: 48 (60%)
Improved Design Votes: 32 (40%)
Statistically Significant: False
Row 26
Design artshow
User A2FQJTT7FWUAAB

Original Design Votes: 35 (42%)
Improved Design Votes: 49 (58%)
Statistically Significant: False
Row 27
Design artshow
User A234WZ4KX8IW07

Original Design Votes: 35 (41%)
Improved Design Votes: 50 (59%)
Statistically Significant: False
Row 28
Design artshow
User AHLADH7JTJRO8

Original Design Votes: 25 (60%)
Improved Design Votes: 17 (40%)
Statistically Significant: False
Row 29
Design artshow
User A1F86EKL4ZCQNQ

Original Design Votes: 30 (79%)
Improved Design Votes: 8 (21%)
Statistically Significant: True
Row 30
Design artshow
User APMEOBFFLFRLX

Original Design Votes: 13 (31%)
Improved Design Votes: 29 (69%)
Statistically Significant: True
Row 31
Design artshow
User A2BTSQJKEUU0CN

Original Design Votes: 43 (26%)
Improved Design Votes: 125 (74%)
Statistically Significant: True
Row 32
Design artshow
User A2ZSNSDERYQI63

Original Design Votes: 11 (26%)
Improved Design Votes: 31 (74%)
Statistically Significant: True
Row 33
Design club
User A1XVYOL52UT8T9

Original Design Votes: 41 (53%)
Improved Design Votes: 37 (47%)
Statistically Significant: False
Row 34
Design club
User A2H9DQS8WYDKI8

Original Design Votes: 28 (35%)
Improved Design Votes: 51 (65%)
Statistically Significant: True
Row 35
Design club
User A178LCGNPF94F7

Original Design Votes: 23 (53%)
Improved Design Votes: 20 (47%)
Statistically Significant: False
Row 36
Design club
User APMEOBFFLFRLX

Original Design Votes: 28 (67%)
Improved Design Votes: 14 (33%)
Statistically Significant: True
Row 37
Design club
User A3IUEMZG39ZS3H

Original Design Votes: 28 (68%)
Improved Design Votes: 13 (32%)
Statistically Significant: True
Row 38
Design club
User AHLADH7JTJRO8

Original Design Votes: 19 (46%)
Improved Design Votes: 22 (54%)
Statistically Significant: False
Row 39
Design club
User A2FQJTT7FWUAAB

Original Design Votes: 22 (55%)
Improved Design Votes: 18 (45%)
Statistically Significant: False
Row 40
Design club
User A2SFP0U6HGY64G

Original Design Votes: 24 (31%)
Improved Design Votes: 54 (69%)
Statistically Significant: True
Row 41
Design club
User A2FQJTT7FWUAAB

Original Design Votes: 21 (49%)
Improved Design Votes: 22 (51%)
Statistically Significant: False
Row 42
Design club
User A2WLVJKM4F7UIF

Original Design Votes: 29 (37%)
Improved Design Votes: 49 (63%)
Statistically Significant: True
Row 43
Design club
User A1KJ2WRVURHN5G

Original Design Votes: 19 (48%)
Improved Design Votes: 21 (52%)
Statistically Significant: False
Row 44
Design club
User AWEQZZGOOBGV3

Original Design Votes: 23 (55%)
Improved Design Votes: 19 (45%)
Statistically Significant: False
Row 45
Design club
User AHLADH7JTJRO8

Original Design Votes: 27 (68%)
Improved Design Votes: 13 (32%)
Statistically Significant: True
Row 46
Design club
User AWEQZZGOOBGV3

Original Design Votes: 22 (27%)
Improved Design Votes: 61 (73%)
Statistically Significant: True
Row 47
Design club
User A2FQJTT7FWUAAB

Original Design Votes: 19 (48%)
Improved Design Votes: 21 (52%)
Statistically Significant: False
Row 48
Design club
User A2K1CZSLA7PO3Q

Original Design Votes: 15 (38%)
Improved Design Votes: 24 (62%)
Statistically Significant: False
Row 49
Design club
User A31WJI6976HZ0M

Original Design Votes: 16 (40%)
Improved Design Votes: 24 (60%)
Statistically Significant: False
Row 50
Design club
User APMEOBFFLFRLX

Original Design Votes: 20 (50%)
Improved Design Votes: 20 (50%)
Statistically Significant: False
Row 51
Design conference
User A1ZV6G4BUQUUKG

Original Design Votes: 28 (72%)
Improved Design Votes: 11 (28%)
Statistically Significant: True
Row 52
Design conference
User A3OGLJITOG8JQM

Original Design Votes: 62 (73%)
Improved Design Votes: 23 (27%)
Statistically Significant: True
Row 53
Design conference
User A1KZHOAJV4S0M4

Original Design Votes: 34 (79%)
Improved Design Votes: 9 (21%)
Statistically Significant: True
Row 54
Design conference
User A23ZXX27YV4RQU

Original Design Votes: 27 (69%)
Improved Design Votes: 12 (31%)
Statistically Significant: True
Row 55
Design conference
User A13GYBVKHODB7W

Original Design Votes: 27 (64%)
Improved Design Votes: 15 (36%)
Statistically Significant: False
Row 56
Design conference
User A2SY3BKOFNTTNC

Original Design Votes: 32 (78%)
Improved Design Votes: 9 (22%)
Statistically Significant: True
Row 57
Design conference
User A1ZB0Q47TF8BAX

Original Design Votes: 46 (55%)
Improved Design Votes: 38 (45%)
Statistically Significant: False
Row 58
Design conference
User A2FQJTT7FWUAAB

Original Design Votes: 55 (66%)
Improved Design Votes: 28 (34%)
Statistically Significant: True
Row 59
Design conference
User A1IO7K9MXZK99A

Original Design Votes: 61 (73%)
Improved Design Votes: 22 (27%)
Statistically Significant: True
Row 60
Design conference
User A3OGLJITOG8JQM

Original Design Votes: 23 (55%)
Improved Design Votes: 19 (45%)
Statistically Significant: False
Row 61
Design conference
User A2HZQTX8EXTPRZ

Original Design Votes: 23 (53%)
Improved Design Votes: 20 (47%)
Statistically Significant: False
Row 62
Design conference
User AZ64UCV9DRPB0

Original Design Votes: 26 (68%)
Improved Design Votes: 12 (32%)
Statistically Significant: True
Row 63
Design conference
User A178LCGNPF94F7

Original Design Votes: 11 (13%)
Improved Design Votes: 74 (87%)
Statistically Significant: True
Row 64
Design conference
User A2VHNUBHSTC2RS

Original Design Votes: 19 (45%)
Improved Design Votes: 23 (55%)
Statistically Significant: False
Row 65
Design conference
User A1494MUEG9XXAY

Original Design Votes: 25 (61%)
Improved Design Votes: 16 (39%)
Statistically Significant: False
Row 66
Design conference
User A1SR1SZA08EP2V

Original Design Votes: 23 (58%)
Improved Design Votes: 17 (42%)
Statistically Significant: False
Row 67
Design crowd2
User A1OVRPQ4L34YTR

Original Design Votes: 20 (24%)
Improved Design Votes: 63 (76%)
Statistically Significant: True
Row 68
Design crowd2
User A31WJI6976HZ0M

Original Design Votes: 5 (12%)
Improved Design Votes: 35 (88%)
Statistically Significant: True
Row 69
Design crowd2
User A2HZQTX8EXTPRZ

Original Design Votes: 5 (13%)
Improved Design Votes: 34 (87%)
Statistically Significant: True
Row 70
Design crowd2
User AHLADH7JTJRO8

Original Design Votes: 18 (45%)
Improved Design Votes: 22 (55%)
Statistically Significant: False
Row 71
Design crowd2
User A1494MUEG9XXAY

Original Design Votes: 20 (48%)
Improved Design Votes: 22 (52%)
Statistically Significant: False
Row 72
Design crowd2
User A1ORWSNSD8L33Q

Original Design Votes: 19 (45%)
Improved Design Votes: 23 (55%)
Statistically Significant: False
Row 73
Design crowd2
User A2HZQTX8EXTPRZ

Original Design Votes: 29 (76%)
Improved Design Votes: 9 (24%)
Statistically Significant: True
Row 74
Design crowd2
User A2SFP0U6HGY64G

Original Design Votes: 49 (63%)
Improved Design Votes: 29 (37%)
Statistically Significant: True
Row 75
Design crowd2
User A2FQJTT7FWUAAB

Original Design Votes: 55 (65%)
Improved Design Votes: 29 (35%)
Statistically Significant: True
Row 76
Design crowd2
User A3DKW5X4Y1Z6UD

Original Design Votes: 24 (60%)
Improved Design Votes: 16 (40%)
Statistically Significant: False
Row 77
Design crowd2
User A1ORWSNSD8L33Q

Original Design Votes: 22 (58%)
Improved Design Votes: 16 (42%)
Statistically Significant: False
Row 78
Design crowd2
User AYLD14EI9Q925

Original Design Votes: 29 (72%)
Improved Design Votes: 11 (28%)
Statistically Significant: True
Row 79
Design dojo
User A2FQJTT7FWUAAB

Original Design Votes: 28 (65%)
Improved Design Votes: 15 (35%)
Statistically Significant: False
Row 80
Design dojo
User A2TPIS2HB11T7R

Original Design Votes: 36 (43%)
Improved Design Votes: 48 (57%)
Statistically Significant: False
Row 81
Design dojo
User A1ZB0Q47TF8BAX

Original Design Votes: 35 (81%)
Improved Design Votes: 8 (19%)
Statistically Significant: True
Row 82
Design dojo
User A3OGLJITOG8JQM

Original Design Votes: 27 (68%)
Improved Design Votes: 13 (32%)
Statistically Significant: True
Row 83
Design dojo
User A2H9DQS8WYDKI8

Original Design Votes: 59 (74%)
Improved Design Votes: 21 (26%)
Statistically Significant: True
Row 84
Design dojo
User A3EIP7L51UGR9N

Original Design Votes: 19 (45%)
Improved Design Votes: 23 (55%)
Statistically Significant: False
Row 85
Design dojo
User A1ZV6G4BUQUUKG

Original Design Votes: 24 (59%)
Improved Design Votes: 17 (41%)
Statistically Significant: False
Row 86
Design dojo
User A31WJI6976HZ0M

Original Design Votes: 58 (69%)
Improved Design Votes: 26 (31%)
Statistically Significant: True
Row 87
Design dojo
User A1SR1SZA08EP2V

Original Design Votes: 42 (50%)
Improved Design Votes: 42 (50%)
Statistically Significant: False
Row 88
Design dojo
User AW6ZUC9O9V26P

Original Design Votes: 21 (54%)
Improved Design Votes: 18 (46%)
Statistically Significant: False
Row 89
Design dojo
User A1SR1SZA08EP2V

Original Design Votes: 33 (85%)
Improved Design Votes: 6 (15%)
Statistically Significant: True
Row 90
Design dojo
User AHLADH7JTJRO8

Original Design Votes: 45 (56%)
Improved Design Votes: 35 (44%)
Statistically Significant: False
Row 91
Design dojo
User A3UJ3YXKD24YPW

Original Design Votes: 49 (64%)
Improved Design Votes: 27 (36%)
Statistically Significant: True
Row 92
Design dojo
User AW6ZUC9O9V26P

Original Design Votes: 18 (42%)
Improved Design Votes: 25 (58%)
Statistically Significant: False
Row 93
Design dojo
User A3OGLJITOG8JQM

Original Design Votes: 57 (73%)
Improved Design Votes: 21 (27%)
Statistically Significant: True
Row 94
Design dojo
User AQI9UX1CSIDJY

Original Design Votes: 18 (42%)
Improved Design Votes: 25 (58%)
Statistically Significant: False
Row 95
Design dojo
User A2HZQTX8EXTPRZ

Original Design Votes: 43 (54%)
Improved Design Votes: 37 (46%)
Statistically Significant: False
Row 96
Design dojo
User AOKI5MGJEVU5U

Original Design Votes: 49 (61%)
Improved Design Votes: 31 (39%)
Statistically Significant: False
Row 97
Design dojo
User AOKI5MGJEVU5U

Original Design Votes: 32 (80%)
Improved Design Votes: 8 (20%)
Statistically Significant: True
Row 98
Design dojo
User AW8DRG5FEA286

Original Design Votes: 57 (73%)
Improved Design Votes: 21 (27%)
Statistically Significant: True
Row 99
Design dojo
User A1ORWSNSD8L33Q

Original Design Votes: 16 (38%)
Improved Design Votes: 26 (62%)
Statistically Significant: False
Row 100
Design dojo
User AHLADH7JTJRO8

Original Design Votes: 28 (70%)
Improved Design Votes: 12 (30%)
Statistically Significant: True
Row 101
Design dojo
User A26GL4VV1F6CP4

Original Design Votes: 30 (75%)
Improved Design Votes: 10 (25%)
Statistically Significant: True
Row 102
Design dojo
User A3IRHEHX2HCMME

Original Design Votes: 26 (62%)
Improved Design Votes: 16 (38%)
Statistically Significant: False
Row 103
Design mba
User A3SLVGSMLQ1TAO

Original Design Votes: 23 (56%)
Improved Design Votes: 18 (44%)
Statistically Significant: False
Row 104
Design mba
User APMEOBFFLFRLX

Original Design Votes: 16 (20%)
Improved Design Votes: 66 (80%)
Statistically Significant: True
Row 105
Design mba
User A1ORWSNSD8L33Q

Original Design Votes: 9 (22%)
Improved Design Votes: 31 (78%)
Statistically Significant: True
Row 106
Design mba
User A36EYLA7ZHRXIA

Original Design Votes: 14 (34%)
Improved Design Votes: 27 (66%)
Statistically Significant: False
Row 107
Design mba
User A1494MUEG9XXAY

Original Design Votes: 59 (72%)
Improved Design Votes: 23 (28%)
Statistically Significant: True
Row 108
Design mba
User A2HZQTX8EXTPRZ

Original Design Votes: 19 (48%)
Improved Design Votes: 21 (52%)
Statistically Significant: False
Row 109
Design mba
User A3EIP7L51UGR9N

Original Design Votes: 12 (31%)
Improved Design Votes: 27 (69%)
Statistically Significant: True
Row 110
Design mba
User A3QRFDCMARL9IP

Original Design Votes: 18 (44%)
Improved Design Votes: 23 (56%)
Statistically Significant: False
Row 111
Design mba
User A31WJI6976HZ0M

Original Design Votes: 20 (26%)
Improved Design Votes: 58 (74%)
Statistically Significant: True
Row 112
Design mba
User A3J60U6YVPF7S4

Original Design Votes: 18 (42%)
Improved Design Votes: 25 (58%)
Statistically Significant: False
Row 113
Design mba
User A31WJI6976HZ0M

Original Design Votes: 58 (73%)
Improved Design Votes: 21 (27%)
Statistically Significant: True
Row 114
Design mba
User A3OGLJITOG8JQM

Original Design Votes: 32 (80%)
Improved Design Votes: 8 (20%)
Statistically Significant: True
Row 115
Design mba
User A1YZSQR87QT5EW

Original Design Votes: 66 (40%)
Improved Design Votes: 101 (60%)
Statistically Significant: True
Row 116
Design mba
User A2SY3BKOFNTTNC

Original Design Votes: 67 (80%)
Improved Design Votes: 17 (20%)
Statistically Significant: True
Row 117
Design mba
User A1ZB0Q47TF8BAX

Original Design Votes: 16 (41%)
Improved Design Votes: 23 (59%)
Statistically Significant: False
Row 118
Design mba
User A2HZQTX8EXTPRZ

Original Design Votes: 23 (59%)
Improved Design Votes: 16 (41%)
Statistically Significant: False
Row 119
Design mba
User AHLADH7JTJRO8

Original Design Votes: 29 (76%)
Improved Design Votes: 9 (24%)
Statistically Significant: True
Row 120
Design mba
User APMEOBFFLFRLX

Original Design Votes: 21 (50%)
Improved Design Votes: 21 (50%)
Statistically Significant: False
Row 121
Design mba
User A1WK3QVIJZXKKQ

Original Design Votes: 12 (29%)
Improved Design Votes: 30 (71%)
Statistically Significant: True
Row 122
Design mba
User A30BK9UTIQWICD

Original Design Votes: 13 (31%)
Improved Design Votes: 29 (69%)
Statistically Significant: True
Row 123
Design sigcover
User A23ZXX27YV4RQU

Original Design Votes: 10 (26%)
Improved Design Votes: 29 (74%)
Statistically Significant: True
Row 124
Design sigcover
User A3PYF9S3SPSIUX

Original Design Votes: 15 (17%)
Improved Design Votes: 71 (83%)
Statistically Significant: True
Row 125
Design sigcover
User A3IRHEHX2HCMME

Original Design Votes: 9 (21%)
Improved Design Votes: 33 (79%)
Statistically Significant: True
Row 126
Design sigcover
User A3IUEMZG39ZS3H

Original Design Votes: 10 (23%)
Improved Design Votes: 33 (77%)
Statistically Significant: True
Row 127
Design sigcover
User A1KZHOAJV4S0M4

Original Design Votes: 26 (21%)
Improved Design Votes: 98 (79%)
Statistically Significant: True
Row 128
Design sigcover
User A1ZV6G4BUQUUKG

Original Design Votes: 6 (15%)
Improved Design Votes: 35 (85%)
Statistically Significant: True
Row 129
Design sigcover
User A2FQJTT7FWUAAB

Original Design Votes: 12 (31%)
Improved Design Votes: 27 (69%)
Statistically Significant: True
Row 130
Design sigcover
User A2SY3BKOFNTTNC

Original Design Votes: 12 (29%)
Improved Design Votes: 30 (71%)
Statistically Significant: True
Row 131
Design sigcover
User A1494MUEG9XXAY

Original Design Votes: 12 (31%)
Improved Design Votes: 27 (69%)
Statistically Significant: True
Row 132
Design sigcover
User AELM0N8VFP1O3

Original Design Votes: 27 (68%)
Improved Design Votes: 13 (32%)
Statistically Significant: True
Row 133
Design sigcover
User A31WJI6976HZ0M

Original Design Votes: 20 (24%)
Improved Design Votes: 64 (76%)
Statistically Significant: True
Row 134
Design sigcover
User AQI9UX1CSIDJY

Original Design Votes: 36 (43%)
Improved Design Votes: 47 (57%)
Statistically Significant: False
Row 135
Design sigcover
User A1Z6SYXEC73M9K

Original Design Votes: 25 (29%)
Improved Design Votes: 61 (71%)
Statistically Significant: True
Row 136
Design sigcover
User A1ZB0Q47TF8BAX

Original Design Votes: 5 (12%)
Improved Design Votes: 38 (88%)
Statistically Significant: True
Row 137
Design simple2
User A1XVYOL52UT8T9

Original Design Votes: 11 (28%)
Improved Design Votes: 28 (72%)
Statistically Significant: True
Row 138
Design simple2
User A2UDAX1CF4CSBW

Original Design Votes: 5 (13%)
Improved Design Votes: 34 (87%)
Statistically Significant: True
Row 139
Design simple2
User A1VFQCUGV6VRGR

Original Design Votes: 20 (47%)
Improved Design Votes: 23 (53%)
Statistically Significant: False
Row 140
Design simple2
User A31MPGBY92OWW

Original Design Votes: 8 (19%)
Improved Design Votes: 34 (81%)
Statistically Significant: True
Row 141
Design simple2
User A1IO7K9MXZK99A

Original Design Votes: 13 (33%)
Improved Design Votes: 26 (67%)
Statistically Significant: False
Row 142
Design simple2
User A3FIWSZ4U54TKX

Original Design Votes: 12 (29%)
Improved Design Votes: 30 (71%)
Statistically Significant: True
Row 143
Design simple2
User A3IUEMZG39ZS3H

Original Design Votes: 22 (26%)
Improved Design Votes: 64 (74%)
Statistically Significant: True
Row 144
Design simple2
User A3VJJZQLB2HJF5

Original Design Votes: 23 (28%)
Improved Design Votes: 60 (72%)
Statistically Significant: True
Row 145
Design simple2
User A3SLVGSMLQ1TAO

Original Design Votes: 2 (5%)
Improved Design Votes: 40 (95%)
Statistically Significant: True
Row 146
Design simple2
User AJA0JLTTAVKY8

Original Design Votes: 10 (24%)
Improved Design Votes: 32 (76%)
Statistically Significant: True
Row 147
Design simple2
User A1WK3QVIJZXKKQ

Original Design Votes: 28 (70%)
Improved Design Votes: 12 (30%)
Statistically Significant: True
Row 148
Design simple2
User AOKI5MGJEVU5U

Original Design Votes: 27 (69%)
Improved Design Votes: 12 (31%)
Statistically Significant: True
Row 149
Design simple2
User A2BTSQJKEUU0CN

Original Design Votes: 30 (70%)
Improved Design Votes: 13 (30%)
Statistically Significant: True
Row 150
Design simple2
User A2FQJTT7FWUAAB

Original Design Votes: 28 (72%)
Improved Design Votes: 11 (28%)
Statistically Significant: True
Row 151
Design simple2
User ANKF628PX9YXK

Original Design Votes: 11 (26%)
Improved Design Votes: 31 (74%)
Statistically Significant: True
Row 152
Design simple2
User AWEQZZGOOBGV3

Original Design Votes: 9 (21%)
Improved Design Votes: 33 (79%)
Statistically Significant: True
Row 153
Design simple2
User A1ORWSNSD8L33Q

Original Design Votes: 6 (15%)
Improved Design Votes: 34 (85%)
Statistically Significant: True
Row 154
Design simple2
User AHLADH7JTJRO8

Original Design Votes: 14 (35%)
Improved Design Votes: 26 (65%)
Statistically Significant: False
Row 155
Design simple2
User AOKI5MGJEVU5U

Original Design Votes: 27 (68%)
Improved Design Votes: 13 (32%)
Statistically Significant: True
Row 156
Design simple2
User AW8DRG5FEA286

Original Design Votes: 33 (43%)
Improved Design Votes: 43 (57%)
Statistically Significant: False
Row 157
Design simple2
User A3DKW5X4Y1Z6UD

Original Design Votes: 20 (47%)
Improved Design Votes: 23 (53%)
Statistically Significant: False
Row 158
Design simple2
User A3SLVGSMLQ1TAO

Original Design Votes: 15 (35%)
Improved Design Votes: 28 (65%)
Statistically Significant: False
Row 159
Design simple3
User A2H9DQS8WYDKI8

Original Design Votes: 27 (34%)
Improved Design Votes: 53 (66%)
Statistically Significant: True
Row 160
Design simple3
User A3QRFDCMARL9IP

Original Design Votes: 10 (23%)
Improved Design Votes: 33 (77%)
Statistically Significant: True
Row 161
Design simple3
User A2OHOTK3XOY3VB

Original Design Votes: 10 (24%)
Improved Design Votes: 32 (76%)
Statistically Significant: True
Row 162
Design simple3
User A3PYF9S3SPSIUX

Original Design Votes: 10 (23%)
Improved Design Votes: 33 (77%)
Statistically Significant: True
Row 163
Design simple3
User A2FQJTT7FWUAAB

Original Design Votes: 18 (45%)
Improved Design Votes: 22 (55%)
Statistically Significant: False
Row 164
Design simple3
User AYLD14EI9Q925

Original Design Votes: 20 (51%)
Improved Design Votes: 19 (49%)
Statistically Significant: False
Row 165
Design simple3
User A1XVYOL52UT8T9

Original Design Votes: 31 (79%)
Improved Design Votes: 8 (21%)
Statistically Significant: True
Row 166
Design simple3
User A2H9DQS8WYDKI8

Original Design Votes: 34 (89%)
Improved Design Votes: 4 (11%)
Statistically Significant: True
Row 167
Design simple3
User AELM0N8VFP1O3

Original Design Votes: 19 (48%)
Improved Design Votes: 21 (52%)
Statistically Significant: False
Row 168
Design simple3
User AW6ZUC9O9V26P

Original Design Votes: 61 (72%)
Improved Design Votes: 24 (28%)
Statistically Significant: True
Row 169
Design simple3
User AQI9UX1CSIDJY

Original Design Votes: 18 (44%)
Improved Design Votes: 23 (56%)
Statistically Significant: False
Row 170
Design simple3
User AVPT9Q8VBWM9Z

Original Design Votes: 51 (61%)
Improved Design Votes: 33 (39%)
Statistically Significant: False
Row 171
Design simple3
User A1IO7K9MXZK99A

Original Design Votes: 33 (85%)
Improved Design Votes: 6 (15%)
Statistically Significant: True
Row 172
Design simple3
User A2TL7IBOE632XF

Original Design Votes: 16 (37%)
Improved Design Votes: 27 (63%)
Statistically Significant: False
Row 173
Design simple3
User A2ZSNSDERYQI63

Original Design Votes: 44 (55%)
Improved Design Votes: 36 (45%)
Statistically Significant: False
Row 174
Design simple3
User A31WJI6976HZ0M

Original Design Votes: 37 (47%)
Improved Design Votes: 41 (53%)
Statistically Significant: False
Row 175
Design simple
User A2H9DQS8WYDKI8

Original Design Votes: 10 (24%)
Improved Design Votes: 32 (76%)
Statistically Significant: True
Row 176
Design simple
User A2UDAX1CF4CSBW

Original Design Votes: 5 (12%)
Improved Design Votes: 35 (88%)
Statistically Significant: True
Row 177
Design simple
User A2FQJTT7FWUAAB

Original Design Votes: 28 (33%)
Improved Design Votes: 56 (67%)
Statistically Significant: True
Row 178
Design simple
User APMEOBFFLFRLX

Original Design Votes: 28 (65%)
Improved Design Votes: 15 (35%)
Statistically Significant: False
Row 179
Design simple
User AHLADH7JTJRO8

Original Design Votes: 9 (11%)
Improved Design Votes: 71 (89%)
Statistically Significant: True
Row 180
Design simple
User AW6ZUC9O9V26P

Original Design Votes: 30 (35%)
Improved Design Votes: 56 (65%)
Statistically Significant: True
Row 181
Design simple
User A1XVYOL52UT8T9

Original Design Votes: 14 (33%)
Improved Design Votes: 29 (67%)
Statistically Significant: True
Row 182
Design simple
User A2H9DQS8WYDKI8

Original Design Votes: 8 (19%)
Improved Design Votes: 35 (81%)
Statistically Significant: True
Row 183
Design simple
User A2SY3BKOFNTTNC

Original Design Votes: 5 (13%)
Improved Design Votes: 34 (87%)
Statistically Significant: True
Row 184
Design simple
User AELM0N8VFP1O3

Original Design Votes: 21 (51%)
Improved Design Votes: 20 (49%)
Statistically Significant: False
Row 185
Design simple
User A1ZB0Q47TF8BAX

Original Design Votes: 48 (57%)
Improved Design Votes: 36 (43%)
Statistically Significant: False
Row 186
Design simple
User A2BTSQJKEUU0CN

Original Design Votes: 26 (60%)
Improved Design Votes: 17 (40%)
Statistically Significant: False
Row 187
Design simple
User A2HZQTX8EXTPRZ

Original Design Votes: 13 (33%)
Improved Design Votes: 26 (67%)
Statistically Significant: False
Row 188
Design simple
User A2M2BAHRU9GE5U

Original Design Votes: 24 (29%)
Improved Design Votes: 60 (71%)
Statistically Significant: True
Row 189
Design simple
User A2FQJTT7FWUAAB

Original Design Votes: 12 (30%)
Improved Design Votes: 28 (70%)
Statistically Significant: True
Row 190
Design simple
User A31MPGBY92OWW

Original Design Votes: 8 (21%)
Improved Design Votes: 31 (79%)
Statistically Significant: True
Row 191
Design simple
User A2SY3BKOFNTTNC

Original Design Votes: 28 (72%)
Improved Design Votes: 11 (28%)
Statistically Significant: True
Row 192
Design simple
User A2ZG4S19AVH2G3

Original Design Votes: 21 (49%)
Improved Design Votes: 22 (51%)
Statistically Significant: False
Row 193
Design simple
User A3EIP7L51UGR9N

Original Design Votes: 22 (55%)
Improved Design Votes: 18 (45%)
Statistically Significant: False
Row 194
Design simple
User A3OGLJITOG8JQM

Original Design Votes: 34 (87%)
Improved Design Votes: 5 (13%)
Statistically Significant: True
Row 195
Design simple
User A2FQJTT7FWUAAB

Original Design Votes: 5 (12%)
Improved Design Votes: 38 (88%)
Statistically Significant: True
Row 196
Design simple
User A36EYLA7ZHRXIA

Original Design Votes: 20 (24%)
Improved Design Votes: 64 (76%)
Statistically Significant: True