Hi creators,
We've got some exciting news today! If you've been keeping up with our creator channels recently you might've seen that we've been experimenting with creating a new algorithm to replace our existing bumping system used on the default 'Relevance' sort.
Over the past few months we've tested the new system by randomly splitting users into two groups, with one half of users seeing our new relevance algorithm and the other half seeing the existing bumping results. Our most recent iteration of the algorithm has been live for three weeks and collected data from thousands of users on millions of impressions. Comparing the two groups we've found that the new algorithm has resulted in a:
These numbers are brilliant. The fact that the new algorithm decreased impressions while increasing purchases means that buyers were able to find what they were looking for more easily, which is exactly what a relevance algorithm should do!
Today we've removed the ability to bump resources and moved everyone over to our new relevance sort algorithm. This is great news for creators because it will lead to an increase in earnings and mean you no longer have to click the bump button every day to maximise your discoverability.
What's really cool about this new approach is that we'll be able to continue to iterate on the algorithm by splitting users into groups to test our changes, selecting the best performer, and repeating. The next change we'll be working on is personalisation of rankings, which we expect to amplify the effects we've already seen.
If you have a question, we've answered a bunch in the Q&A thread in our Discord server and will continue to add more answers. If you're curious about something not mentioned in the thread, please feel free to ask in the #creators channel.
Mick
We've got some exciting news today! If you've been keeping up with our creator channels recently you might've seen that we've been experimenting with creating a new algorithm to replace our existing bumping system used on the default 'Relevance' sort.
Over the past few months we've tested the new system by randomly splitting users into two groups, with one half of users seeing our new relevance algorithm and the other half seeing the existing bumping results. Our most recent iteration of the algorithm has been live for three weeks and collected data from thousands of users on millions of impressions. Comparing the two groups we've found that the new algorithm has resulted in a:
- 6.0% decrease in impressions
- 1.2% increase in purchases
- 7.9% increase in the average purchase price
- 9.3% increase in creator earnings
These numbers are brilliant. The fact that the new algorithm decreased impressions while increasing purchases means that buyers were able to find what they were looking for more easily, which is exactly what a relevance algorithm should do!
Today we've removed the ability to bump resources and moved everyone over to our new relevance sort algorithm. This is great news for creators because it will lead to an increase in earnings and mean you no longer have to click the bump button every day to maximise your discoverability.
What's really cool about this new approach is that we'll be able to continue to iterate on the algorithm by splitting users into groups to test our changes, selecting the best performer, and repeating. The next change we'll be working on is personalisation of rankings, which we expect to amplify the effects we've already seen.
If you have a question, we've answered a bunch in the Q&A thread in our Discord server and will continue to add more answers. If you're curious about something not mentioned in the thread, please feel free to ask in the #creators channel.
Mick
