When Is Intuitive Judgment Valid?

(p. 240) If subjective confidence is not to be trusted, how can we evaluate the probable validity of an intuitive judgment? When do judgments reflect true expertise? When do they display an illusion of validity? The answer comes from the two basic conditions for acquiring a skill:

  • an environment that is sufficiently regular to be predictable
  • an opportunity to learn these regularities through prolonged practice

When both these conditions are satisfied, intuitions are likely to be skilled. Chess is an extreme example of a regular environment, but bridge and poker also provide robust statistical regularities that can support skill. Physicians, nurses, athletes, and firefighters also face complex but fundamentally orderly situations. The accurate intuitions that Gary Klein has described are due to highly valid cues that the expert’s System 1 has learned to use, even if System 2 has not learned to name them. In contrast, stock pickers and political scientists who make long-term forecasts operate in a zero-validity environment. Their failures reflect the basic unpredictability of the events that they try to forecast.

Source:
Kahneman, Daniel. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux, 2011.

Romney Right that Culture Matters for Economic Success

WealthAndPovertyOfNationsBK2012-07-31.jpg

Source of book image: http://photo.goodreads.com/books/1172699090l/209176.jpg

In the piece quoted below, and in much of the TV media coverage, the story is spun as being that Romney offended the Palestinians. But that is not the story. The story is that Romney courageously highlighted an important, but politically incorrect, truth—culture, generally, does matter for economic performance; and Israeli culture, specifically, has encouraged economic growth.
Romney referred to an important book by the distinguished economic historian David Landes. Last school year, one of the students in my Economics of Technology seminar gave a presentation on a related Landes book. That presentation can be viewed at: http://www.amazon.com/review/R2GLBAMFCS5PXH/ref=cm_cr_pr_perm?ie=UTF8&ASIN=0521094186&linkCode=&nodeID=&tag=
I recently read another relevant book, Start-Up Nation, that directly supports Romney’s specific claim, by making the case that Israeli culture is especially congenial to entrepreneurial initiative and success.

(p. A1) JERUSALEM — Mitt Romney offended Palestinian leaders on Monday by suggesting that cultural differences explain why the Israelis are so much more economically successful than Palestinians, thrusting himself again into a volatile issue while on his high-profile overseas trip.
. . .
In the speech, Mr. Romney mentioned books that had influenced his thinking about nations — particularly “The Wealth and Poverty of Nations,” by David S. Landes, which, he said, argues that culture is the defining factor in determining the success of a society.
“Culture makes all the (p. A14) difference,” Mr. Romney said. “And as I come here and I look out over this city and consider the accomplishments of the people of this nation, I recognize the power of at least culture and a few other things.”
He added, “As you come here and you see the G.D.P. per capita, for instance, in Israel, which is about $21,000, and compare that with the G.D.P. per capita just across the areas managed by the Palestinian Authority, which is more like $10,000 per capita, you notice such a dramatically stark difference in economic vitality. And that is also between other countries that are near or next to each other. Chile and Ecuador, Mexico and the United States.”
The remarks, which vastly understated the disparities between the societies, drew a swift rejoinder from Palestinian leaders.

For the full story, see:
ASHLEY PARKER and RICHARD A. OPPEL Jr. “Romney Trip Raises Sparks at a 2nd Stop.” The New York Times (Tues., July 31, 2012): A1 & A14.
(Note: ellipsis added.)
(Note: the online version of the story has the date July 30, 2012.)

The Landes book discussed by Romney is:
Landes, David S. The Wealth and Poverty of Nations. New York: W.W. Norton & Company, 1998.

The book on Israeli entrepreneurship, that I mention in my comments, is:
Senor, Dan, and Saul Singer. Start-Up Nation: The Story of Israel’s Economic Miracle. hb ed. New York: Twelve, 2009.

Simple Algorithms Predict Better than Trained Experts

(p. 222) I never met Meehl, but he was one of my heroes from the time I read his Clinical vs. Statistical Prediction: A Theoretical Analysis and a Review of the Evidence.
In the slim volume that he later called “my disturbing little book,” Meehl reviewed the results of 20 studies that had analyzed whether clinical predictions based on the subjective impressions of trained professionals were more accurate than statistical predictions made by combining a few scores or ratings according to a rule. In a typical study, trained counselors predicted the grades of freshmen at the end of the school year. The counselors interviewed each student for forty-five minutes. They also had access to high school grades, several aptitude tests, and a four-page personal statement. The statistical algorithm used only a fraction of this information: high school grades and one aptitude test. Nevertheless, the formula was more accurate than 11 of the 14 counselors. Meehl reported generally sim-(p. 223)ilar results across a variety of other forecast outcomes, including violations of parole, success in pilot training, and criminal recidivism.
Not surprisingly, Meehl’s book provoked shock and disbelief among clinical psychologists, and the controversy it started has engendered a stream of research that is still flowing today, more than fifty years after its publication. The number of studies reporting comparisons of clinical and statistical predictions has increased to roughly two hundred, but the score in the contest between algorithms and humans has not changed. About 60% of the studies have shown significantly better accuracy for the algorithms. The other comparisons scored a draw in accuracy, but a tie is tantamount to a win for the statistical rules, which are normally much less expensive to use than expert judgment. No exception has been convincingly documented.

Source:
Kahneman, Daniel. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux, 2011.
(Note: italics in original.)

Edison Was Great Inventor; “Jobs Was the Far Shrewder Businessman”

EdisonThomasAlva2012-06-22.jpg “Thomas Alva Edison.” Source of caption and photo: online version of the NYT article quoted and cited below.

I have not read Stross’ books on Jobs and Edison. According to some of the Amazon reviews of the Jobs book, back in 1993 Stross was much more critical of Jobs than he is in the piece below:

(p. 4) I wrote a book about Mr. Jobs in 1993.
. . .
Years later, I wrote a biography of Edison, a person whom Mr. Jobs admired. When you compare the two personalities and their careers, a few similarities emerge immediately. Both had less formal schooling than most of their respective peers. Both possessed the ability to visualize projects on a grand scale. Both followed an inner voice when making decisions. And both had terrific tempers that could make their employees quake.
. . .
Mr. Jobs was the far shrewder businessman, even if he never talked about wealth as a matter of personal interest. When Edison died, he left behind an estate valued at about $12 million, or about $180 million in today’s dollars. His friend Henry Ford had once joked that Edison was “the world’s greatest inventor and the world’s worst businessman.” Mr. Jobs was worth a commanding $6.5 billion.
Mr. Jobs was perhaps the most beloved billionaire the world has ever known. Richard Branson’s tribute captures the way people felt they could identify with Mr. Jobs’s life narrative: “So many people drew courage from Steve and related to his life story: adoptees, college dropouts, struggling entrepreneurs, ousted business leaders figuring out how to make a difference in the world, and people fighting debilitating illness. We have all been there in some way and can see a bit of ourselves in his personal and professional successes and struggles.”

For the full commentary, see:
RANDALL STROSS. “The Power of Taking the Big Chance.” The New York Times, SundayBusiness Section (Sun., October 9, 2011): 4.
(Note: online version of the commentary is dated October 8, 2011, and has the title “The Wizard and the Mortal: Two Sides of Genius.”)
(Note: in the print version, the same title, on the same page, was used as heading for two different articles on Steve Jobs–Lohr’s on the left side, and Stross’ on the right side.)

Stross’ books on Jobs and Edison are:
Stross, Randall E. Steve Jobs & the Next Big Thing. New York: Scribner Publishers, 1993.
Stross, Randall E. The Wizard of Menlo Park: How Thomas Alva Edison Invented the Modern World. New York: Crown Publishers, 2007.

Experts “Produce Poorer Predictions than Dart-Throwing Monkeys”

(p. 219) Tetlock interviewed 284 people who made their living “commenting or offering advice on political and economic trends.” He asked them to assess the probabilities that certain events would occur in the not too distant future, both in areas of the world in which they specialized and in regions about which they had less knowledge. Would Gorbachev be ousted in a coup? Would the United States go to war in the Persian Gulf? Which country would become the next big emerging market? In all, Tetlock gathered more than 80,000 predictions. He also asked the experts how they reached their conclusions, how they reacted when proved wrong, and how they evaluated evidence that did not support their positions. Respondents were asked to rate the probabilities of three alternative outcomes in every case: the persistence of the status quo, more of something such as political freedom or economic growth, or less of that thing.
The results were devastating. The experts performed worse than they would have if they had simply assigned equal probabilities to each of the three potential outcomes. In other words, people who spend their time, and earn their living, studying a particular topic produce poorer predictions than dart-throwing monkeys who would have distributed their choices evenly over the options. Even in the region they knew best, experts were not significantly better than nonspecialists.

Source:
Kahneman, Daniel. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux, 2011.

Tetlock’s book is:
Tetlock, Philip E. Expert Political Judgment: How Good Is It? How Can We Know? Princeton, NJ: Princeton University Press, 2005.

Joe Biden’s Dad Told Him to “Get Up” in Face of Job Loss

Innovative entrepreneurs, through the process of creative destruction, provide us with wonderful new products and services. But sometimes the process also results in job loss. One response to the job loss is to shut down innovation. Another is to preach resilience. Joe Biden’s Dad said “get up.” (The clip is from a talk that Joe Biden gave to the National Press Club on August 1, 2007. The full talk is posted to the C-SPAN web site.)

A mainly similar presentation of the “get up” message is on p. xxii of Biden’s autobiography:
Biden, Joe. Promises to Keep: On Life and Politics. New York: Random House, 2007.

Alexander Field Claims 1930s Were “Technologically Progressive”

GreatLeapForwardBK2012-06-22.jpg

Source of book image: http://yalepress.yale.edu/images/full13/9780300151091.jpg

(p. 1) UNDERNEATH the misery of the Great Depression, the United States economy was quietly making enormous strides during the 1930s. Television and nylon stockings were invented. Refrigerators and washing machines turned into mass-market products. Railroads became faster and roads smoother and wider. As the economic historian Alexander J. Field has said, the 1930s constituted “the most technologically progressive decade of the century.”
. . .
(p. 6) The closest thing to a unified explanation for these problems is a mirror image of what made the 1930s so important. Then, the United States was vastly increasing its productive capacity, as Mr. Field argued in his recent book, “A Great Leap Forward.” Partly because the Depression was eliminating inefficiencies but mostly because of the emergence of new technologies, the economy was adding muscle and shedding fat. Those changes, combined with the vast industrialization for World War II, made possible the postwar boom.
In recent years, on the other hand, the economy has not done an especially good job of building its productive capacity. Yes, innovations like the iPad and Twitter have altered daily life. And, yes, companies have figured out how to produce just as many goods and services with fewer workers. But the country has not developed any major new industries that employ large and growing numbers of workers.

For the full commentary, see:
DAVID LEONHARDT. “The Depression: If Only Things Were That Good.” The New York Times, SundayReview Section (Sun., October 9, 2011): 1 & 6.
(Note: ellipsis added.)
(Note: online version of the commentary is dated October 8, 2011.)

Book discussed:
Field, Alexander J. A Great Leap Forward: 1930s Depression and U.S. Economic Growth, Yale Series in Economic and Financial History. New Haven, CT: Yale University Press, 2011.

The Illusion that Investment Advisers Have Skill

(p. 215) Some years ago I had an unusual opportunity to examine the illusion of financial skill up close. I had been invited to speak to a group of investment advisers in a firm that provided financial advice and other services to very wealthy clients. I asked for some data to prepare my presentation and was granted a small treasure: a spreadsheet summarizing the investment outcomes of some twenty-five anonymous wealth advisers, for each of eight consecutive years. Each adviser’s score for each year was his (most of them were men) main determinant of his year-end bonus. It was a simple matter to rank the advisers by their performance in each year and to determine whether there were persistent differences in skill among them and whether the same advisers consistently achieved better returns for their clients year after year.
To answer the question, I computed correlation coefficients between the rankings in each pair of years: year 1 with year 2, year 1 with year 3, and so on up through year 7 with year 8. That yielded 28 correlation coefficients, one for each pair of years. I knew the theory and was prepared to find weak evidence of persistence of skill. Still, I was surprised to find that the average of the 28 correlations was .01. In other words, zero. The consistent correlations that would indicate differences in skill were not to be found. The results resembled what you would expect from a dice-rolling contest, not a game of skill.

Source:
Kahneman, Daniel. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux, 2011.

Larry Page on Tesla, Commerce, and Changing the World

Funding is a key constraint for the innovative project entrepreneur. By “project entrepreneur” I mean the innovator who views money as a means to achieving the project, and not as an end in itself. In this brief clip from Page’s 2007 AAAS talk, he discusses how as a 12 year-old reading Tesla’s autobiography he almost cried at how Tesla’s failure to commercialize his ideas limited his ability to change the world.

The Tesla autobiography is:
Tesla, Nikola. My Inventions: The Autobiography of Nikola Tesla. SoHo Books, 2012.

Neglecting Valid Stereotypes Has Costs

(p. 169) The social norm against stereotyping, including the opposition to profiling, has been highly beneficial in creating a more civilized and more equal society. It is useful to remember, however, that neglecting valid stereotypes inevitably results in suboptimal judgments. Resistance to stereotyping is a laudable moral position, but the simplistic idea that the resistance is costless is wrong. The costs are worth paying to achieve a better society, but denying that the costs exist, while satisfying to the soul and politically correct, is not scientifically defensible.

Source:
Kahneman, Daniel. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux, 2011.