Thinking With Models

by Henry Farrell on November 29, 2011

Scott Page is offering a “free graded course”:http://www.modelthinker-class.org/ on ‘thinking with models.’

We live in a complex world with diverse people, firms, and governments whose behaviors aggregate to produce novel, unexpected phenomena. We see political uprisings, market crashes, and a never ending array of social trends. How do we make sense of it?

Models. Evidence shows that people who think with models consistently outperform those who don’t. And, moreover people who think with lots of models outperform people who use only one.

Why do models make us better thinkers?

Models help us to better organize information – to make sense of that fire hose or hairball of data (choose your metaphor) available on the Internet. Models improve our abilities to make accurate forecasts. They help us make better decisions and adopt more effective strategies. They even can improve our ability to design institutions and procedures.

In this class, I present a starter kit of models: I start with models of tipping points. I move on to cover models explain the wisdom of crowds, models that show why some countries are rich and some are poor, and models that help unpack the strategic decisions of firm and politicians.

I really recommend this to CT readers. Scott is one of the people pioneering the study of complex systems in the social sciences. My review of his book, _The Difference_ is “here”:https://crookedtimber.org/2007/06/27/review-scott-e-page-the-difference/, and I imagine that studying with him will be a lot of fun. There are a number of other courses (listed at the bottom of the page for Scott’s course) that also look very interesting.

{ 30 comments }

1

Jeffrey Davis 11.29.11 at 4:58 pm

Language is the first model so I wonder how people manage to disparage models without using a model!

2

Theophylact 11.29.11 at 5:18 pm

Yes, but it’s an implicit model.

3

Shelley 11.29.11 at 5:44 pm

Outperform how?

4

tomslee 11.29.11 at 6:04 pm

It looks great and I’m thinking of signing up for it. But surely Philip Tetlock would disagree with “Evidence shows that people who think with models consistently outperform those who don’t”: model-thinkers tend to be hedgehog-like, and model-free thinkers tend to be more fox-like.

5

Jeffrey Davis 11.29.11 at 7:02 pm

re: 4 “model-free thinkers tend to be more fox-like.”

You don’t think actual foxes use models? Foxes just apprehend reality directly? How does that work? (In your explanation, eschew the use of models, please.)

6

MPAVictoria 11.29.11 at 7:21 pm

Thanks for posting this Henry! I just signed up.
Cheers

7

Lee A. Arnold 11.29.11 at 7:22 pm

Slightly off-topic, but I just finished an animated model for macroeconomics:

http://www.youtube.com/watch?v=7RBfBTIFs6o

I would argue that this is better than a mathematical model, for the purpose of introductory understanding.

In particular, the next few mini-vids will argue for gov’t stimuli.

8

Barry Freed 11.29.11 at 7:28 pm

Jeffrey Davis @6

The reference is to a well-known essay of Isaiah Berlin’s: http://en.wikipedia.org/wiki/The_Hedgehog_and_the_Fox

9

tomslee 11.29.11 at 7:40 pm

1. “Evidence shows that people who think with models consistently outperform those who don’t” – Scott Page.

2. “There is no way to think without models, they’re structures of assumption.” – an adult.

3. “You don’t think actual foxes use models?” – Jeffrey Davis.

If 2 and 3 are correct, then 1 can be true only in the sense that “people who think with models consistently outperform those who don’t think”. I have no argument with that conclusion.

10

tomslee 11.29.11 at 7:52 pm

Alternative reply to “an adult” and Jeffrey Davis: by “model” I presume you mean “model of a model” because I can’t think about models without using a model.

11

Jeffrey Davis 11.29.11 at 8:05 pm

re: 9

My reaction is complicated since that hedgehog is trotted out every time some somnambulist right-winger says the same thing twice.

My point was simply that all thought is a model.

12

Barry Freed 11.29.11 at 8:46 pm

The Fox gets all the models.

13

tomslee 11.29.11 at 8:48 pm

#14: Isn’t the general pro-fox propaganda that the fox has a collection of models, and is happy switching from one to another as seems appropriate, whereas the hedgehog has one model that he/she is too much in love with?

14

Khan 11.29.11 at 10:53 pm

Ignoring this debate about Page’s subject matter … I’m very excited to see the “free online course” concept taking off. This fall, there are three such (albeit limited to CompSci): AI, Machine Learning, and DB. For the spring, I count 16, all with a common site design.

I’m taking the current ML class as a refresher, and I highly recommend the format.

15

nnyhav 11.29.11 at 11:03 pm

Counter-recommendation: Emanuel Derman’s Models.Behaving.Badly: Why Confusing Illusion with Reality Can Lead to Disaster, on Wall Street and in Life

16

bianca steele 11.29.11 at 11:11 pm

I’m guessing that what Page means by model isn’t what I learned a model is in middle-school science.

17

afinetheorem 11.30.11 at 1:38 am

20: What is the contradiction between Page’s quite proper reasoning about models and a title which argues against “confusing illusion with reality”? To the extent that people take thought experiments as representatives of reality, then clearly they are in error. But they would equally be in error to neglect any sort of formal structured reasoning which allows the brain to spot connections between seemingly different problems; i.e., the reasoning of game theoretic equilibrium applies to a broad class of situations with social interactions.

18

Ebenezer Scrooge 11.30.11 at 1:39 am

tomslee got it right. “Evidence shows that people who think with models consistently outperform those who don’t. And, moreover people who think with lots of models outperform people who use only one.”

To translate into English: people who think well think better than those who do not think well. Unless one can define “model” independently of thinking in general.

19

tomslee 11.30.11 at 2:30 am

Can anyone see what kind of time commitment (hours per week) is involved in the course? I could not see anything obvious at the sign up page.

20

nnyhav 11.30.11 at 6:43 am

22: What contradiction? No one’s suggesting that models are unnecessary. Only insufficient. Models are like metaphors; real constraints often get lost in a fit of abstraction. But the recommendation is for the book not the title. RTFM.

21

Walt 11.30.11 at 7:39 am

Page means mathematical models, right?

22

Barry 11.30.11 at 1:16 pm

Khan 11.29.11 at 10:53 pm

” Ignoring this debate about Page’s subject matter … I’m very excited to see the “free online course” concept taking off. This fall, there are three such (albeit limited to CompSci): AI, Machine Learning, and DB. For the spring, I count 16, all with a common site design.

I’m taking the current ML class as a refresher, and I highly recommend the format.”

If only there was some way of rapidly send an ‘address’ (perhaps a ‘link’, to be slangly like those beatnik hepcats), which could be somehow made available to a large number of people :)

23

Tim Wilkinson 11.30.11 at 2:14 pm

I found Evidence shows that people who think with models consistently outperform those who don’t odd, too – not because it’s impossible to provide an appropriate sense of ‘model’ under which some people do and some don’t think with them, but because such a sweeping yet nebulous claim, appealing to generic ‘research’ with no hint of a citation, makes the thing read like a newspaper ad for some dodgy ‘improve your memory’ or ‘secrets of winning investment strategy’ course, which is distinctly off-putting.

24

Zamfir 11.30.11 at 2:40 pm

Page means mathematical models, right?
Yeah, but going from the description he means a particular form of them.Toy models that aren’t expected to provide detailed numerical predictions, but only as direction-of-change analogy of some particular aspect of a more messy reality.

That kind of model often is just a metaphor clothed in a fashionable hard-science attitude. Which isn’t bad, not at all, but it leads to the sneaking suspicion that his “people who don’t use models” are just people who don’t speak the jargon that turns metaphors into models.

25

Salient 11.30.11 at 5:54 pm

…I feel like I see substantiation of Evidence shows that people who think with models consistently outperform those who don’t in every exam I give. The folks who ace the thing outright seem to have a pretty good overall picture of what their tools can do.

In particular, ‘thinking with models’ helps you to spot wild and weird claims, especially your own wild claims. I’ve seen plenty of exams on which a student obtained a result, realized it didn’t accord with their general sense of what kind of answer would make sense, and backtracked to discover an error. I don’t mean, like, a minus sign error, which is more an issue of basic awareness; people without models can spot that form of error probably just as well as the model folks. Sure, students leave answers that can’t possibly make sense (for any variety of reasons, e.g. running out of time).

The model-vs-nonmodel difference shows up when students attempt methods that can’t possibly make sense. What I mean is, a realization that their whole approach to the question they want to answer can’t possibly make sense, because the computations they’ve attempted or considered attempting can’t possibly produce the desired information. A model provides a strong sense of what information is connected to (or should be connected to) what other information. The kind of error the models folks tend to make is ‘invent a way to solve this that sort of makes some intuitive sense, but turns out to have a fatal flaw in reasoning that they didn’t catch.’ Awkwardly, given {exam time pressure} + {exam rule prohibits asking someone to review their idea}, quite a lot of model-oriented folks . But when they see their own work returned, their reaction is often something like “oh sheesh duh why did I think that?” — they have a strong sense of nonsense and can assess “sheesh, why did I think this was related to that?”

My favorite quote on models-vs-procedures was from my undergrad days: “You shouldn’t have to find the answer in order to know what the answer is.” (You can replace the ‘is’ with a ‘should be’ and tack on some sort of statement like “You have to find the answer in order to check that you have it” if you prefer less pithy statements.)

{models}{rules} and {models}{procedures} are both really neat nontrivial Venn diagrams.

26

Eric 11.30.11 at 9:51 pm

Not to sound incredibly obnoxious, but this just rehashes Weber’s “ideal types” argument? I am sure Page is easier to understand than “Objectivity in the Social Sciences,” but he probably loses some of Weber’s infamous subtlety.

27

piglet 12.01.11 at 10:03 pm

“In particular, ‘thinking with models’ helps you to spot wild and weird claims, especially your own wild claims. I’ve seen plenty of exams on which a student obtained a result, realized it didn’t accord with their general sense of what kind of answer would make sense, and backtracked to discover an error.”

I don’t know if and how this is related to models but you are addressing a very important issue. I see students give nonsense answers apparently without giving any thought to whether their answers make sense, and I would love to hear any ideas about how to teach them do better. This reminds me of course of the old “how old was the captain” joke. The way many students are exposed to Mathematics leads them to believe that numbers are meaningless abstractions. Their task is to perform meaningless arithmetic manipulations and come up with some sort of response. At that point they seem to stop without giving any thought to what their answer might mean. I try to counter this tendency by using only real-world examples with real-world data in my exercises but still the results often drive me to despair.

28

Tim Wilkinson 12.01.11 at 11:13 pm

I don’t know if and how this is related to models…
Nor I.

(Also nor I: Not to sound incredibly obnoxious)

29

Salient 12.02.11 at 11:46 am

I don’t know if and how this is related to models… / Nor I.

Well, heck, possibly nor I, I guess. I was loosely interpreting ‘model’ as a characterization of relationships between objects of study, providing a plausible description that enables us to make predictions because it generalizes previously observed phenomena in a plausible way. So a mathematical model is a sense not only of how some particular quantities are related to each other, but also of what it means for quantities to be related, and some intuition about what should be true about those relationships even when available data is incomplete or ambiguous.

Perhaps that’s nonsense; it’s just a definition I derived ad hoc from:

Models help us to better organize information – to make sense of that fire hose or hairball of data (choose your metaphor) available on the Internet. Models improve our abilities to make accurate forecasts. They help us make better decisions and adopt more effective strategies. They even can improve our ability to design institutions and procedures.

I’d be happy to hear alternative characterizations of what ‘model’ means in this context, and I’m looking forward to hearing more from Scott Page about it.

OT, but — Did anyone else notice and appreciate the sort of beautiful point/counterpoint of Henry’s two posts? I like that Scott Page (who wrote an intelligent, careful, measured, and fairly reasonable book on diversity) was implicitly contrasted with Andrew Sullivan (who expressed support for a fallacious, irresponsible, immoderate, and daft book on diversity). That was meta-cool.

30

tomslee 12.02.11 at 2:53 pm

I see students give nonsense answers apparently without giving any thought to whether their answers make sense, and I would love to hear any ideas about how to teach them do better.

Back when I was doing some TA’ing as a grad student (last teaching I ever did), I’d see two sorts of nonsense answer in physical chemistry problem sets. One was the use of “models” in completely the wrong context – students see a volume and a temperature and remember seeing “V/T = constant” and apply it, even though Charles’s law is for ideal gases. The other was the order of magnitude mistake, where a student would get a minus sign in an exponent wrong and get densities of 10^25 kg/m^3 for a gas.

Which makes me think that the word “models”, which we never used to use much, now means two different things. One is a mathematically tractable simplified representation of a problem, that gives insights because of the mathematics. The other is what we used to call “qualitative methods” in physics – a grab-bag of techniques and facts that made order-of-magnitude estimates of unfamiliar problems possible, like “how many bricks in Birmingham?” It seems to me that the two meanings overlap in social sciences, and I’m beginning to think that the word “model” itself has become a bit of a fetish in some circles.

Comments on this entry are closed.