Mix Evaluation Dataset

Browse the songs list, then open a song to see its mixes. Press play and use ◀ ▶ — or hit ▶ on any mix — to switch: every mix plays from the same point, MUSHRA-style A/B.

Tap a mix to reveal its comments and every individual rating, plus what listeners talked about — the instruments and mix features their comments were tagged with, and how much of that talk was approving.

Mixes are ranked by mean rating, and the highest and lowest are highlighted. Ratings are subjective and the whisker on each score bar shows ±1 standard error, so mixes whose whiskers overlap are ones this listening test did not separate.

This dataset was created by Brecht De Man and Joshua D. Reiss.

A special thanks goes to Johan Pauwels and Soumya Sai Vanka for overcoming various server challenges during the migration process and successfully recovering most of the dataset.

We also thank Jinjie Shi, Ross Conquer, and Yuchen Liu for organising and verifying the contents of the Mix Evaluation Dataset, as well as assisting with its relaunch. Furthermore, they have dedicated a significant amount of time to supplementing the dataset with previously missing materials, including raw tracks, sessions, and processed tracks. Stay tuned for the upcoming Mix Evaluation 2.0!