You can’t fix it with a pure LLM, no. But very few of the major models are pure LLMs anymore. They’ve got LLMs built in to them as subsystems, but they’ve got control systems layered on top of those to adjust their behaviors. And those don’t have to be trained purely with next word prediction.
The problem with that is that, it seems like it will become an unwieldy piece of spaghetti code, even assuming the code wasn’t written by LLMs.
An LLM is a crazily complex thing but at least it’s text in, text out, one input, one output.
As soon as you start bolting more and more things onto it to deal with special conditions, you have to maintain all those things, and understand how they interact.
You can’t fix it with a pure LLM, no. But very few of the major models are pure LLMs anymore. They’ve got LLMs built in to them as subsystems, but they’ve got control systems layered on top of those to adjust their behaviors. And those don’t have to be trained purely with next word prediction.
The problem with that is that, it seems like it will become an unwieldy piece of spaghetti code, even assuming the code wasn’t written by LLMs.
An LLM is a crazily complex thing but at least it’s text in, text out, one input, one output.
As soon as you start bolting more and more things onto it to deal with special conditions, you have to maintain all those things, and understand how they interact.