The goal was to create a large model that's highly capable for RP/ERP scenarios. Goliath-120b is excellent for roleplay, and Venus-120b was created with the idea of attempting to mix more than two models together to see how well this method works.
v1.0 is better than v1.2
Ran this on 6xA100 at full precision. It was one of the best models I have ever tried for RP. 10/10