(small AB test experiment)
Tic-Tac-Crow » Devlog
I don't have any ability to do real AB testing, so I thought I'd experiment a bit with this:
https://twitter.com/droqen/status/1370026119290789899
I've switched the cover art from the first image to the second:
The main reason for making this devlog is so that I know what the CTR was before I swapped cover art: 0.93%.
Let's see how the numbers change over the next 7 days :)
Get Tic-Tac-Crow
Buy Now$5.00 USD or more
Tic-Tac-Crow
A garden of simulated bird friends, all engrossed in games of #tic-tac-toe
Status | Released |
Author | droqen |
Genre | Simulation |
Tags | 2D, ai, ambience, birds, Board Game, nature, nemesis, Pixel Art, Singleplayer, tic-tac-toe |
Comments
Log in with itch.io to leave a comment.
It's been 10 days on the right art, and CTR = 0.40%. So who knows! It's magic!
It's been 6 days, and we're at CTR 0.45%!!! So the messy janky cover art seemed to be performing better. This is a great experiment. I'm switching back one more time, let's see...
Day whatever: CTR is at a solid 1%.
I'm going to switch back to the first cover art now, and check back in whenever and see how it affected sales/views/clicks!
OH NO, I TOTALLY MESSED UP MY TEST! - now it's at 1.39 % because i twote about it. whoops. okay
Day 4: still steadily dropping. 0.60% now.
it occurs to me that maybe this is just natural dropoff as tweets and things vanish and the only people seeing the cover are random browsers of itch.io!
Day 2: CTR has dropped to 0.65%! It definitely feels like cover image B is performing more poorly than image A, but I think the CTR is based on the "last 7 days" so I'm going to hold out with image B for 5 more days, then switch back to image A.
Day 1: CTR has dropped to 0.79%