Why Brainstorming With AI Runs Out of Road
A wall is useful because it returns the ball. This one started nodding.
September 23, 2026 · 8 min read
You open a chat to think something through. The first few exchanges are genuinely good. It picks up your framing, adds a consideration you had not written down, organises the mess into three options. You feel like you are getting somewhere.
Then, somewhere around the tenth message, you notice that you have not changed your mind about anything. The idea you walked in with is now better dressed. It has headings. It has a risks section. But it is the same idea, and nothing in the conversation ever seriously challenged it.
The model is optimised to be agreeable, and it is very good at it
Models are tuned on human preference feedback, and humans rate helpful, affirming, on-topic answers highly. The predictable result is a strong pull toward building on what you said rather than contradicting it. Disagreeing with a user is a behaviour that gets trained down, because in most contexts it reads as unhelpful.
That is the right default for most requests. It is the wrong default for a brainstorm, where the entire value of the other party is that they do not already share your assumptions.
The conversation narrows because it is built on itself
There is a second effect that has nothing to do with agreeableness. Every turn in a chat is conditioned on everything before it. By message ten, the model is not responding to your problem anymore. It is responding to its own last nine answers about your problem.
Each turn commits a little more to a frame, and the space of ideas gets narrower rather than wider. This is the opposite of what a brainstorm is for. You wanted the early turns to open doors, and instead they quietly closed them.
You can feel this if you start a brand new chat with the same question after a long session. The fresh answer is often noticeably different, and sometimes better, than where the long conversation ended up. Nothing was learned along the way; the room just got smaller.
What an actual sparring partner does
Think about what makes a colleague useful when you are working through a half-formed idea. It is rarely that they know more than you. It is that they do not automatically accept the premise. They ask why the problem is framed that way. They point at the part you skipped over quickly because you did not want to look at it.
Two things are needed for that, and a single chat session gives you neither reliably:
- A position not derived from yours. Someone who arrived at the problem independently, so their objection is not a polite variation of your own idea.
- Willingness to hold it. Someone who does not fold the moment you push back, because the second and third exchange is where the useful part usually lives.
The trap when you add more models
The obvious fix is to bring in more than one model so you get positions that were not derived from each other. That does help, but it comes with a specific failure mode worth knowing, and it is not the one people expect.
A 2026 study on multi-agent setups found that giving agents distinct expert personas can produce the least diverse ideas of any configuration tested. Assigning roles feels like it creates variety. What it often does is push every agent toward the stereotyped centre of its assigned role, which is narrower than where any of them would have gone unprompted.
So more voices is not automatically more thinking. The structure matters more than the count. We covered that study in detail separately, because it changed how we build this.
What to do instead
- Ask for the strongest objection, not for feedback. "What do you think?" invites agreement. "What is the best argument that this is wrong?" gives the model permission to disagree, which it will not take on its own.
- Start fresh when the thread stops surprising you. Ten turns of accumulated context is often a liability rather than an asset in a brainstorm. Restating the problem cleanly in a new session costs a minute.
- Get independent answers before you get a discussion. If you want positions that are genuinely different, they have to be formed without seeing each other. Discussion afterwards is useful. Discussion first produces consensus.
- Watch for agreement that arrives too early. If the second model instantly endorses the first, that is worth more suspicion than a disagreement.
Where Parley fits
This is the shape Parley is built around. Several models answer the same question separately first, so none of them is reacting to another one's framing, and only then do the differences get laid out. The point is not to collect more opinions. It is to find the places where informed positions actually diverge, because that is where your own thinking has room to move.
Worth being straight about the limits. This does not help when you already know what you want and need it written up. It helps when you suspect you are circling and cannot tell what you are avoiding. The best practices guide goes through which questions repay the extra effort.
Related reading
- When more AI agents make things worse is the study behind the persona warning above.
- Why ChatGPT and Claude give different answers to the same question covers what makes independent positions independent.