Monday, April 27, 2015

Rating presidents - by the numbers

I'm a history nut and especially a presidential history nut. Living in the time of Obama has been interesting as will be the next 30 years as Obama's policies are tested by time.

Recently, I was looking through my Kindle on any books on objectively judging presidencies. I came across a 2008 book by Alvin Felzenberg called "The Leaders We Deserved (And a Few We Didn't)."

The premise was intriguing and I was prepared to buy it when I found his presidential scorecard on the web through an interview with Freakonomics. It's different. Ronald Reagan is abnormally high at a tied for No. 3 with Theodore Roosevelt, while Bill Clinton is at No. 22, tied with William Howard Taft, and behind such presidents as Gerald Ford and Benjamin Harrison.

It's all opinion and I'm sure the book lays it out, but then I noticed Felzenberg rated Reagan's economic policy a 5 on a 5-point scale, while Clinton gets a 4.

OK. I can buy a 5 on Reagan's economic policy. I know economists who still worship St. Ronnie. But how can you give Clinton a 4 on economic policy?

Instead of arguing semantics I spent a couple of days trying to find actual numbers. Here's everything I found.

















Gallup is the longest tenured polling company with the best historical data. If you trying to judge presidents, perhaps the best way is how satisfied was the country when they left office?

The above chart shows that of the last 11 presidents, not including Obama, six left office with above a 50 percent approval rate. That includes two, George H.W. Bush and Gerald Ford, who lost their election bids. Truman, of course, is the great hope of all presidents who struggle at the end. Truman's approval was just 32 percent, but his standing among historians has improved over time.

From this chart, Reagan deserves his high regard, but he ranks below Clinton.































OK. There are lots of caveats with this one.

* John Quincy Adams is one of four presidents to win the electoral college while losing the popular vote. In 1824, Adams was one of four candidates running and he finished second in the popular vote to Andrew Jackson by a wide margin. The election went to the House of Representatives where "the corrupt bargain" with Henry Clay gave Adams the victory. In 1828, in a two-way race with Jackson Adams gained some popular vote but still was slaughtered in the electoral college.

** In 1888, Grover Cleveland became the third person to win the popular vote but lose in the electoral college. In 1992, Cleveland faced Benjamin Harrison in a rematch and trounced him.

*** In 1912, William Howard Taft was part of a three-way election. His former mentor, Theodore Roosevelt, decided to run under a new party after being denied at the Republican convention. Taft refused to drop out of the race and the two split the vote, giving Woodrow Wilson an easy victory.

**** Wilson's popular vote increase is, at least in part because of the fact he was in a traditional two main candidate election in 1916 as compared with 2012.

***** In 1968, George Wallace ran a spirited third-party election, which siphoned voters both from Richard Nixon and Hubert Humphrey. In 1972, Nixon faced George McGovern alone and won a historic landslide. Of course, it came out later that Nixon's campaign played a number of dirty tricks during the election and the Watergate scandal forced Nixon to resign. The great irony is that Nixon likely would have won without any of the dirty tricks.

****** After winning a traditional two-way election in 1988, George H.W. Bush faced Bill Clinton and a major third-party try from H. Ross Perot. Perot siphoned voters from Bush and Clinton, making Bush's loss of support appear larger than it likely was.

******* The famous election of 1860 was really a series of sectional candidates. Abraham Lincoln won an easy electoral college victory, but Stephen Douglas, John Breckenridge and John Bell each gathered more than 12.6 percent of popular vote support. In 1864, with the South not in the vote, Lincoln faced just George McClellan, making his increase in support abnormally large.

Another note is about Franklin Roosevelt. Roosevelt trounced Herbert Hoover in 1932 and then won by an even larger percentage in 1936. I listed his next two elections separately. In each one, Roosevelt lost support. His third election some were upset he was breaking the two term tradition of George Washington. His fourth election, he lost more support because of general fatigue over having one person in the White House for so long.

FDR, Andrew Jackson and Barack Obama were the three presidents on the chart to win re-election despite losing some of their popular vote majority from their first (or in Roosevelt's case, prior) elections.

Re-elections are a chance for voters to say they had buyer's remorse. There was no buyer's remorse, at least after four years, for Reagan, Clinton, FDR, George W. Bush and Dwight Eisenhower.











Five vice presidents who took over the presidency ran for election in their own right and they won a solid four times. Theodore Roosevelt and Lyndon Johnson increased the popular vote percentage from their predecessors.

The only losing candidate was Gerald Ford and he faced a nearly impossible task, running after Nixon resigned the office.

Now to some economic measurements.




















Roosevelt's numbers are an outlier because he started during the Great Depression and then had World War II significantly goose the numbers. Truman's numbers are artificially low because he was president during the ramp down from WWII.

Hoover's numbers only cover part of his presidency. Obama's covers five years so far and he is trending upward. GDP growth during Obama's years:

2009: -0.27%
2010: 2.75%
2011: 1.67%
2012: 1.58%
2013: 3.18%
2014: 2.32%

GDP was surprisingly strong in the 1960s and not nearly as strong in the 1950s. The Eisenhower years are remembered as this idyllic time of economic prosperity. In this measurement, Reagan is a solid fifth overall, but Clinton ranks ahead of him at No. 4.


















The data covers only part of Truman's presidency and five years of Obama's presidency. Both Reagan and Obama had significant recessions early in their presidencies. Clinton also came in during a recession, although it was a minor one. Obama's jobless rates are trending downward.

Jan. 1, 2010: 9.2%
Jan. 1: 2011: 8.3%
Jan. 1: 2012: 8.0%
Jan. 1: 2013: 6.6%
Jan. 1: 2014: 5.7%

Clinton again ranks above Reagan.

A different way to look at jobless rates is how much progress -- or lack thereof -- economies made on jobs from one presidency to the next.



















Ronald Reagan inherited a struggling economy from Jimmy Carter, then went through a major recession, before leaving office with a pretty solid jobs picture.

Still, Reagan is tied for third here behind Clinton and Lyndon Johnson, who because of the Vietnam fiasco, rarely gets talked about when it comes to economic policy.

As you see, Reagan is tied in this chart with Obama and, considering that unemployment rates, have continued to fall, the Gipper might end up fourth in this measurement.





















How often have you heard that Barack Obama has accumulated more debt than every other president combined? Several have peddled the theory. Politifact actually fact checked it:

Sarah Palin says Obama has accumulated more debt than previous 43 presidents combined

It's not true. As you see above, the U.S. Government has run at a $4.8 trillion deficit in Obama's five years. Of course, Reagan and the two Bushes ran up deficits of $6.0 trillion so obviously the fact is false.

Interestingly, it has been true twice. Both Reagan and George W. Bush wracked up more debts than all of their predecessors combined -- at least from the data I found.

Dick Cheney famously said Reagan proved "deficits don't matter." Reagan ran a deficit of $1.4 trillion during his eight years. The previous eight presidents had a combined deficit of $754.9 billion. The Roosevelt numbers are only from 1940 forward.

Not to be outdone, George W. Bush followed the only president since before the Great Depression to actually operate the government in the black, and ran up a deficit of $3.5 trillion over eight years. The previous 11 presidents ran the government at a combined deficit of $3.1 trillion.

In terms of Reagan versus Clinton, there really is no starker comparison than the deficit. If you believe that the mounting debt is a bad thing then you have to grade Clinton's management of the government higher than Reagan's.


















Backers of Obama argue that he inherited the biggest fiscal mess since FDR. This chart supports the contention. The U.S. Government's deficit has fallen four of the five years he's been in charge of the government.

On the bottom end of the spectrum are both Bushes and Reagan. Clinton again fares much better than Reagan in this measurement.




















Criticized as a tax and spend liberal, Obama actually has shrunk the government, at least through 2014. Here again Clinton ranks higher than Reagan, who goosed economic growth by vastly ramping up military budgets.





















This one was a bit of a shocker. Per capital personal income exploded under both Jimmy Carter and Gerald Ford and neither one of them was re-elected. The three at the bottom, Bush II, Ike and Obama all were re-elected even with sluggish income growth.

Here is one of the few measurements where Reagan actually finished higher than Clinton.

This leads to the final, very concerning chart.





















This isn't perhaps the best chart to compare presidents because if you look at it, the trend is clear. When you factor in inflation, people in the U.S. essentially have been treading water since the late 1970s.

If you put these presidents in chronological order you get:

Roosevelt: 8.37%
Truman: 4.06%
Eisenhower: 2.76%
Kennedy: 3.57%
Johnson: 5.71%
Nixon: 5.75%
Ford: 4.84%
Carter: 2.32%
Reagan: 2.31%
Bush 1: -1.32%
Clinton: 0.15%
Bush 2: -1.47%
Obama: -1.96%

Essentially, since Bush 1 was elected, the average American consumer is a worse place economically because inflation is rising at a greater rate than income. This should be a focus in the next presidential election.

Friday, April 10, 2015

Winning separates Curry in NBA MVP race

This year's NBA MVP debate is fascinating because for once more than one or two players are in the conversation. I've read over the past few weeks convincing arguments for Stephen Curry, James Harden, Russell Westbrook and my guy, Kentucky great, Anthony Davis.

Curry plays for the team with the best record in the NBA and Harden has carried the Rockets without Dwight Howard to one of the higher seeds in the Western Conference. Westbrook's candidacy is built around the fact he has been churning out triple doubles like Magic Johnson since Kevin Durant was declared out for the season with a foot injury. Davis supporters point to a relatively new statistic -- PER or Personal Efficiency Rating -- to push his MVP credentials.

PER was developed by ESPN.com columnist John Hollinger. It "sums up all a player's positive accomplishments, subtracts the negative accomplishments, and returns a per-minute rating of a player's performance."

Basketball-reference.com has used Hollinger's formula, which some assumptions for incomplete data of earlier years, to calculate PER ratings back to 1951-1952. Davis' PER this year with a handful of games to go is 30.70. He will finish the season as just the seventh player to top the 30 mark, joining Wilt Chamberlain, Michael Jordan, David Robinson, Shaquille O'Neal, Tracey McGrady and LeBron James.

That's rare company, but it is just one statistic to look at. There are three other advanced metrics that help you weigh a player's worth more accurately than the old points-rebounds-assists per game models.

There are win shares, which is derivative of baseball's Bill James. It's a highly complex formula that calculates points produced by a player and offensive possessions and an estimate of a player's points allowed per 100 defensive possessions. Unlike PER, which favors players who are the focal points of their team's offense, win shares favor players on teams with high winning percentages.

Then there is Box Plus/Minus, which uses a player's box score information and the team's overall performance to estimate a player's performance relative to league average based on a per-100-possession basis. Someone with a 0.0 BPM is league average. A -2 score is replacement level and 5 points or better is all-star level.

Finally, there is a Value over Replacement Player (VORP), which takes the BPM and measures it against the value of a player on a minimum salary and not a normal member of the team's rotation.

What is interesting about the 2014-2015 NBA season is that each of the most popular candidates leads in one of these categories. We've already discussed Davis and his PER rating. The leader in win shares with the playoffs just a few games away is James Harden at 15.8 over Chris Paul at 15.4. Curry stands third, Davis fourth and Westbrook is not in the top 10.

Westbrook though tops Box Plus/Minus at 10.66, followed by Curry, Harden, LeBron James, then Anthony Davis. Curry finally comes out on top of VORP with a score of 7.64 to Harden's 7.50. The next four are Westbrook, Paul, James and Davis.

To see which of the four stands out I weighted the categories. First place in a category was worth 20 points, second was worth 19 and so on down to getting one point for finishing 20th. The top 10 players using this method were:

Player (points for PER, WS, BPM, VORP -- Total)
1. Curry, 18, 18, 19, 20 -- 75
2. Harden, 17, 20, 18, 19 -- 74
3. Paul, 15, 19, 17, 17 -- 68
4. Davis, 20, 17, 15, 15 -- 67
5. Westbrook, 19, 8, 20, 18 -- 65
6. James, 16, 12.5, 16, 16 -- 60.5
7. Damian Lillard, 0, 14.5, 11, 14 -- 39.5
8. Jimmy Butler, 1.5, 14.5, 7.5, 10.5 -- 34
9. Rudy Gobert, 5, 7, 13, 8 -- 33
10. Marc Gasol, 4, 9, 6, 12.5 -- 31.5

So just based on these individual rating metrics, I have Curry slightly ahead of Harden for MVP. Of course, the ultimate goal of a basketball team is to win the game. And if you take a player's winning percentage -- the wins/losses of games he actually played in -- and add it to the equation then Curry is the clear choice. To do that, I took a player's winning percentage and multiplied it by 100 and added it the individual weighted points. My top 10 changes a bit once you add in winning percentage.

Player, individual rating points, winning percentage -- total
1. Curry, 75 individual points, 83 winning points (Curry is 64-13 in gamse he's played in) for 158 points.
2. Harden, 74 individual points, 69 winning wings, 143
3. Paul, 68 individual points, 67 winning points, 135
4. James, 60.5 plus 73 winning points, 134
5. Westbrook, 65 plus 59 winning points, 124
6. Davis, 67 plus 56 winning points, 123
7. Lillard, 39.5 plus 65 winning points, 105
8. Kawhi Leonard, 30.5 plus 72 winning points, 103
9. Marc Gasol, 31.5 plus 69 winning points, 101
10. Butler, 34 plus 60 winning points, 94

So that would be my NBA MVP ballot.

Monday, April 6, 2015

The rise of Bill Clinton

In 1948, when historian Arthur Schlesinger of Harvard conducted the first respected poll of presidential historians and political scientists, Grover Cleveland was ranked No. 8 and William McKinley was No. 18.

Cleveland, who served from 1885 to 1889 and then from 1893 to 1897, was against against "special interest legislation" because he thought it would lead to a social welfare state. He created the Interstate Commerce Commission to regulate railroads. He avoided international entanglements.

McKinley, who served from 1897 until he was assassinated in 1901, advocated high tariffs to protect U.S. industries, and he was an expansionist. The U.S. drove Spain out of Cuba and gained control of Puerto Rico, Guam and the Phillippines as part of the peace settlement. In 1898, the country annexed Hawaii as well.

In 2011 though, even though none of those accomplishments had changed, a survey of United Kingdom academics ranked McKinley 21st and Cleveland 23rd.

The point is historians are fickle and there remains a sometimes wide split of opinion on several U.S. Presidents.

The latest poll was conducted by the Brookings Institute, which polled several hundred members of the American Political Science Association. The poll asked the APSA members to rank the presidents on things such as political, legislative and military skill. 

The top of the Brookings poll was familiar. Abe Lincoln was No. 1, followed by George Washington and Franklin Delano Roosevelt. One of those three have topped every one of the 18 major presidential greatness polls conducted since the first 1948 poll. If this was an AP college basketball poll, you'd say Lincoln has gotten 10 No. 1 votes, FDR six and Washington two.  

The poll got interesting at No. 7 and No. 8 where this set of political scientists placed Dwight Eisenhower and Bill Clinton.

Eisenhower, of course, left office in 1961. In a 1962 poll conducted again by Schlesinger, Eisenhower was ranked a mediocre 22nd, below such presidents as Cleveland and McKinley as well as William Howard Taft and Martin Van Buren. 

That seemed unfair to a president who presided over eight years of economic expansion and instituted the federal interstate highway system. In subsequent polls conducted by various organizations from 1982 through this last one, Eisenhower has never ranked lower than 12th and once reached No. 6 in a poll by the New York Times in 2008.

When Clinton left office in 2001, he was personally popular -- Gallup recorded his approval rate at 57 percent when he completed his second term -- but still under the cloud of having been the second president to go through an impeachment trial. 

With that blot on his record, Clinton ranked 24th in the first major poll after his presidency, which was conducted by the decidedly Republican Wall Street Journal in 2000. Still, in polls in 2002, 2005, 2008, 2009, 2010 and 2011, Clinton ranked as low as 19th and as high as 13th until making the leap in the Brookings poll. 

Of course, I'm a numbers nut. I did a quick ranking by adding the Brookings poll with the 17 prior polls, which had been nicely gathered on Wikipedia.

President, polls included, average ranking, (high ranking, low ranking)

1. Abraham Lincoln, 18 polls, 1.56 average (highest: 1st; lowest, 3rd)
2. Franklin Roosevelt, 18 polls, 2.11 average (highest: 1st; lowest, 3rd)
3. George Washington, 18 polls, 2.72 average (highest: 1st; lowest, 4th)
4. Thomas Jefferson, 18 polls, 4.56 average (highest, 2nd; lowest, 7th)
5. Theodore Roosevelt, 18 polls, 4.67 average (highest, 2nd; lowest, 7th)

6. Harry Truman, 17 polls, 7.12 average (highest, 5th; lowest, 9th)
7. Woodrow Wilson, 18 polls, 7.17 average (highest, 4th; lowest, 11th)
8. Andrew Jackson, 18 polls, 9.56 average (highest, 5th; lowest, 14th)
9. Dwight Eisenhower, 17 polls, 9.94 average (highest, 6th; lowest, 22nd)
10. James K. Polk, 18 polls, 11.67 average (highest, 8th; lowest, 19th)

11. John Kennedy, 16 polls, 12.13 average (highest, 6th; lowest, 18th)
12. John Adams, 18 polls, 12.83 average (highest, 9th; lowest, 17th)
13. James Madison, 18 polls, 13.17 average (highest, 6th; lowest, 20th)
14. Lyndon Johnson, 16 polls, 13.25 average (highest, 10th; lowest, 18th)
15. James Monroe, 18 polls, 14.17 average (highest, 7th; lowest, 21st)

16. Ronald Reagan, 14 polls, 14.64 average (highest, 6th; lowest, 26th)
17. Grover Cleveland, 18 polls, 16.5 average (highest, 8th; lowest, 23rd)
18. Barack Obama, 2 polls, 16.5 average (highest, 15th; lowest, 18th)
19. William McKinley, 18 polls, 16.89 average (highest, 10th; lowest, 21st)
20. John Quincy Adams, 18 polls, 17.89 average (highest, 11th; lowest, 25th)

21. Bill Clinton, 12 polls, 18.5 points (highest, 8th; lowest, 24th)
22. William Howard Taft, 18 polls, 21.11 average (highest, 16th; lowest, 29th)
23. George H.W. Bush, 13 polls, 21.38 average (highest, 17th; lowest, 31st)
24. Martin Van Buren, 18 polls, 23.69 average (highest, 15th; lowest, 40th)
25. Rutherford B. Hayes, 18 polls, 24.33 average (highest, 13th; lowest, 33rd)

26. Gerald Ford, 16 polls, 25.88 average (highest, 22nd; lowest, 32nd)
27. Jimmy Carter, 16 polls, 26.44 average (highest, 18th; lowest, 34th)
28. Chester Arthur, 18 polls, 26.44 average (highest, 17th; lowest, 32nd)
29. Benjamin Harrison, 18 polls, 28.11 average (highest, 19th; lowest, 34th)
30. Calvin Coolidge, 18 polls, 28.17 average (highest, 23rd; lowest, 36th)

31. Herbert Hoover, 18 polls, 28.83 average (highest, 19th; lowest, 38th)
32. James Garfield, 11 polls, 29.64 average (highest, 25th; lowest, 33rd)
33. Zachary Taylor, 18 polls, 30.00 average (highest, 24th; lowest, 34th)
34. Richard Nixon, 16 polls, 30.00 average (highest, 23rd; lowest, 38th)
35. Ulysses S. Grant, 18 polls, 31.06 average (highest, 18th; lowest, 37th)

36. John Tyler, 18 polls, 32.72 average (highest, 22nd; lowest, 37th)
37. Millard Fillmore, 18 polls, 33.33 average (highest, 24th; lowest, 38th)
38. William Henry Harrison, 11 polls, 35.18 average (highest, 28th; lowest, 39th)
39. Andrew Johnson, 18 polls, 35.5 average (highest, 19th; lowest, 43rd)
40. Franklin Pierce, 18 polls, 36.22 average (highest ,27th; lowest, 41st)

41. George W. Bush, 6 polls, 36.67 average (highest, 19th; lowest, 39th)
42. Warren Harding, 18 polls, 37.83 average (highest, 29th; lowest, 42nd)
43. James Buchanan, 18 polls, 38.11 average (highest, 26th; lowest, 43rd)

The Brookings poll is the second to include Barack Obama. Obama ranked No. 15 in his first poll, the Siena College presidential rankings in 2010. In the Brookings poll, Obama slipped to 18th. Still, considering some of the accomplishments of the Obama years -- health care reform, ending the Great Recession, the auto industry bailout, the killing of Osama Bin Laden and now the nuclear arms talks with Iran -- his rankings could vary greatly in the coming years depending on how those actions resonate with future historians.

A look at George W. Bush's rankings show how much opinion can shift on a president in a short time. Bush II first was ranked in the 2002 Siena poll, shortly after the 9/11 terrorist attacks. He came in 23rd. In 2005, in a Wall Street Journal poll, the economy was performing well and the war in Iraq was just two years old, Bush improved to 19th.

The next major poll was released in 2008 by the New York Times. At that time, the economy had slipped in to the Great Recession and the war in Iraq was still a chain around the U.S economy's neck. Bush slipped to 37th in that poll and hasn't come in higher than 31st since.