If training a model on its own outputs leads to model collapse, what happens when you continually give it it's own code to build on?
Commit
a2dd898
Im not a big expert in this but it seems that something similar happens with the code. It is slowly degrades I think. Short iteration loops, diff reviews, static analysis and etc will steer it.
commit a2dd898