Honestly I think we’re going to have to pit AIs against one another in another web of complexity in order to reach AGI. You’re going to need 50 different AIs all deliberating and contradicting and refining output with each one controlling some aspect of the result. I think it’s far too much processing needed at this point in time. LLMs right now are largely just word predictors, but we also see things like diffusors being able to create images, etc. These are distinct problem types, and I think if we develop a separate AI for each generalized problem type, we can utilize them in a way that can predictably output something that we can classify as ‘general intelligence’.
I think we’re going to have to pit AIs against one another in another web of complexity in order to reach AGI.
I don’t know if its going to be the route to AGI, but what you are describing is already happening.
There’s Microsoft’s AutoGen framework & OpenAI next month say they too will have AI Agents for Chat-GPT
I think we need to shift our paradigm one or two more times before we can start seriously talking about AGI. Current transformer models are impressive, but they’re much better suited to modeling language than what I would call “cognition”.
I think we’re close, but I don’t think we’ll get there by increasing/improving current technology.