Replit releases ViBench 2.0, a long-horizon benchmark for building whole software products

Replit released ViBench 2.0, in which an agent starts from an empty project and builds a product feature by feature; the best models pass every test plan in only 49-65% of builds.