Monday, July 28, 2014

Star Sighting: Who's Bigger at Cafe Boulud?

My wife and I took advantage of a beautiful New York evening with kids away at camp to dine tonight  al fresco at Cafe Boulud, one of the nicest restaurants in the city.  We tried to take advantage of Restaurant Week prices to learn they apply only to lunch, but that is not the story I am trying to tell.

As we finished our entree, we were surprised to see television talk show host Charlie Rose sit down at the table next to us.  And then at the next table sat down William Goldman, the Academy Award-winning screenwriter of Butch Cassidy and the Sundance Kid, and countless other prominent films.  They chatted together like old friends, as perhaps they are.

This kind of thing doesn't happen to us much, but I couldn't help wondering: Who's Bigger?  Through the miracle of cell phone technology I looked it up.   They are amazingly similar.   Our algorithms rank Charlie Rose at 13,760, a bit ahead of William Goldman at 15,213.

I would like to report that I told them their rankings, which they found fascinating, and that I am now booked to appear on the next Charlie Rose Show.   The truth is, I behaved like a proper New Yorker and let them eat.

I guess I am better at network algorithms like PageRank than networking.  At least I hope so.

The Biggest Americans (The Atlantic)

Identifying the most historically significant figures in American History is a natural question for our analysis methods.  Indeed, our rankings will be used to fuel a special issue of The Smithsonian magazine this fall on the top figures in American history.  Look for details to come in a future post.

But here we react to a special issue on the 100 most influential figures in American history under the aegis of Ross Douthat, which appeared in the The Atlantic Monthly in December 2006.  Their methodology was based a historian poll, where rankings from ten historians were combined into a single consensus ranking.   This inspires the obvious question of how our top 100 Americans compare to the Atlantic's choices.

To proceed, one must move past the definitional issues of who qualifies as American.  Is an explorer like Columbus American?   A naturalized citizen like Albert Einstein?   Someone born in the U.S. who established themselves elsewhere, like the poet T.S. Eliot?   Our opinions on these matters are, respectively no, yes, and no, to be broadly consistent with the Atlantic.

How did the historians do?   Pretty well, since there is great overlap between our rankings and theirs. Fully fifty of The Atlantic's top 100 rank in our top 100, with another twenty listed in our second hundred candidates. Our top three figures are exactly their top three figures (Lincoln, Washington, and Jefferson), in the same order.  The rank correlation between the orders we rank their top 100 is 0.654, demonstrated by the dot plot below:

Perhaps the most important difference between our two rankings is how we deal with the Presidents of the United States.   Our rankings put 41 of the 43 men to serve as president in our 100 most significant historical figures (our apologies to Jimmy Carter and Chester Alan Arthur, who just got nosed out).  By contrast, only 17 presidents made the Atlantic's top 100 Americans.

We think this reflects a clear editorial judgement on their part: it seems less interesting for readers when half your list is stuffed with presidents.  Ten of their top 20 Americans were presidents, yet only two of the men ranked 51 to 100 (including Richard Nixon sitting provocatively at 99).   One can hear the summons for diversity and controversy (Ralph Nader?) affecting the historian's better judgement.   My guess is that the historians were confronted with a pre-selected group of figures, who they generally ordered in a sensible manner.

Here are the ten Atlantic figures with the weakest Who's Bigger rankings.  Three are journalist/media figures (Gallup, Bennett, and Lippmann), while three others are scientists (Salk, Watson, and Mead):

Name Atlantic Ranking WB Ranking Norm A Rank Norm WB Rank
George_Gallup 83 29736 82 100
James_Gordon_Bennett,_Sr. 69 19473 68 99
Benjamin_Spock 88 8638 87 98
Walter_Lippmann 90 5854 89 97
Betty_Friedan 78 5553 77 96
Lyman_Beecher 92 5203 91 95
Sam_Walton 73 4923 72 94
Jonas_Salk 34 3775 33 93
James_D._Watson 68 3619 67 92
Margaret_Mead 82 3025 81 91

By contrast, here are the ten highest ranking Americans missing from the Atlantic:

Name                                          WB

George_W._Bush                          36    (our algorithm's most-regretted ranking)
Edgar_Allan_Poe                          54
John_F._Kennedy                        71
Nikola_Tesla                                  93
Grover_Cleveland                        98
Andrew_Johnson                        105
Barack_Obama                           111   (admittedly, elected after the Atlantic article)
Bill_Clinton                                  115
Madonna                                         121
Bob_Dylan                                   130

These might not personally all be my choices for the ten most historically-significant missing Americans.   But I have no doubt that I would put our team ahead of the Atlantic's in any game of Who's Bigger.