Bounded Rationality
In Thinking In Systems: A Primer' one of the most interesting ideas that Donella Meadows describes is what Herbert Simon coined bounded rationality:
Bounded rationality means that people make quite reasonable decisions based on the information they have. But they don’t have perfect information, especially about more distant parts of the system
Later on in the chapter the following idea is suggested:
If you become a manager, you probably will stop seeing labour as a deserving partner in production, and start seeing it as a cost to be minimised.
This helps explains something that I’ve noticed happen quite frequently.
Someone who was previously non management gets pulled into a management position and 'mysteriously' starts acting exactly like all the others in that type of role rather than having a holistic view.
The strange thing is that we don’t expect this to happen. The person was on 'our' side very recently so surely they should be able to see both perspectives!
Esther Derby referred to this problem in her keynote at XP2011 where she talked about two different types of information that occur in a system:
-
Day to day information - this is possessed by people 'on the ground'
-
System information - this is possessed by people 'in management'
When the people who recently moved into a management position are challenged on this they will often point out that "you can’t see the bigger picture" which is true but still doesn’t account for the fact that they probably aren’t seeing it either!
We’re both just seeing different parts of the system.
Meadows goes on to point out that the design of the system tends to encourage this type of behaviour:
Seeing how individual decisions are rational within the bounds of the information available does not provide an excuse for narrow-minded behaviour. It provides an understanding of why that behaviour arises. Taking out one individual from a position of bounded rationality and putting in another person is not likely to make much difference. Blaming the individual rarely helps create a more desirable outcome.
Meadows finishes this section of the book with the following suggestion which I think is especially useful in a consulting environment where both consultants and management quite obviously tend to suffer from bounded rationality.
It’s amazing how quickly and easily behaviour changes can come, with even slight enlargement of bounded rationality, by providing better, more complete, timelier information.
I’ve seen various attempts at trying to help people enlarge their bounded rationality at ThoughtWorks, such as:
-
Presentations by the finance director showing where the revenue of the company gets spent
-
Management team members taking the time to have one on one discussions with consultants
-
Discussions about the sales pipeline and the types of work available in the market
I think if this type of thing happened more frequently then you’d probably see an enlargement of everyone’s bounded rationality which would be useful for all involved!
About the author
I'm currently working on short form content at ClickHouse. I publish short 5 minute videos showing how to solve data problems on YouTube @LearnDataWithMark. I previously worked on graph analytics at Neo4j, where I also co-authored the O'Reilly Graph Algorithms Book with Amy Hodler.