As part of STARTRISE I also created this benchmark that I use to compare frontier models as they are getting released. https://www.startrise.io/benchmark/gallery/
I also open sourced my benchmark suite so you can fork it and build yours or just get inspired. See it here: https://github.com/startriseio/sr-llm-benchmark