Question: Anyone felt LLMs loosing the purpose after the long messages em actually building a multi agent system, realizing that there is a need of another agent just to keep things on track.
Any opinion on that?
LLMs are terrible at programming. Great at coding, but they can't create a clear project for you and the fact that they have a temperature means that they have randomness that eventually walks them off task.
You are the best option to keep them on track. That and context…