classwarfare

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Thursday, 22 November 2012

Bayes law, Nate Silver and voodoo economics

Posted on 10:38 by Unknown
by Michael Roberts
Nate Silver is the new hero of the liberal left in the US.  This mathematician and statistician correctly forecast Obama’s victory in the presidential election and in the Senate and the result for the electoral college in all 50 states. On the morning of the 6 November 2012, the final update of Silver’s model gave President Barack Obama a 90.9% chance of winning a majority of the 538 electoral votes. Both in summary tables and in an electoral map, Silver forecast the winner of each state.  Silver’s model correctly predicted the winner of every one of the 50 states. In contrast, individual pollsters were less successful. For example, Rasmussen Reports, widely quoted by the right-wing “missed on six of its nine swing-state polls”.

Silver has now published a new book that is already a best seller and he now regularly appears on TV talk shows.  Silver brilliantly exposed the biased commentaries of the right-wing TV channels and papers whose pundits regularly appeared on screen or in print to say that they ‘had a hunch’ that Romney would win or that the polls were ‘biased’ against the Republican candidates.  Silver, in the meantime, quietly presented a statistical analysis of the polls and concluded the probability of Obama winning was over 80% and rising.  His forecast was dead right.  On November 12th, his new book, The Signal and the Noise (print edition) was named Amazon’s Best Book of the Year for 2012.
The evidence is that statistical analysis is way better at forecasting things than ‘hunches’ or human intuition.  Indeed, out of the one hundred studies comparing the accuracy of actuarial statistics (probability analysis) and intuition, there has not been one case humans doing better (Stuart Sutherland, Irrationality, p200).  Indeed, in most studies, actuarial analysis was way better.  Take bank loans, nowadays 90% of loan applications are reviewed by computers taking into account client details against aggregate evidence on bank accounts, jobs etc to gauge risk.  Loans granted by computer using statistical probabilities turn out to have far less defaults than those borrowers chosen by bankers on their own judgement.   Insurance companies have applied to risk in life expectancy and accidents for many years.  So when somebody tells you that their intuition delivers better results, they are talking out of their hats.  Why would you not choose statistical methods to raise your chances of getting things right even if nothing is 100% certain?

Take the stock market.  We are continually told in investment adverts by expensive investment advisers that they can make your money work for you more than just tracking a stock index, like the S&P-500.  In other words, they can beat the market.  But a host of statistical studies prove the opposite.  Sure, some advisers can do better than the index for a few years, but eventually, they all come a cropper.   It’s just so much snake oil voodoo investing.

But everything is not entirely random.  If you were to read Nicholas Taleb’s book, Black Swan (see my book, The Great Recession, chapter 31), you would think that it was.   Or to be more exact, even the most unlikely can happen under the law of chance.  It was assumed that there were only white swans until Europeans got to Australia and found black ones.  It was the ‘unknown unknowns’, to quote Bush’s neo-con Secretary of State, Donald Rumsfeld.  The most unlikely can happen but you cannot know everything.  For Taleb, the Great Recession was one such event that could not have been predicted and therefore bankers, politicians and above all, economists are not at fault.  This was the excuse used by bankers when giving evidence to the US Congress and to the UK parliament.

But modern statistical methods do have predictive power – all is not random.  In his book, Silver offers detailed case studies from baseball, elections, climate change, the financial crash, poker and weather forecasting.  Using as much data as possible, statistical techniques can provide degrees of probability, like “the probability of Obama winning the electoral college is 83%  and the probability of him winning the popular vote is 50.1%”.   This is different from much statistical method in colleges and universities today that rely on idealized modelling assumptions that rarely hold true. Often such models reduce complex questions to overly simple “hypothesis tests” using arbitrary “significance levels” to “accept or reject” a single parameter value.  In contrast, the practical statistician needs a sound understanding of how baseball, poker, elections or other uncertain processes work, what measures are reliable and which not, what scales of aggregation are useful, and then to utilize the statistical tool kit as well as possible. You need extensive data sets, preferably collected over long periods of time, from which one can then use statistical techniques to incrementally change probabilities up or down relative to prior data.

This is the modern form of what is called the Bayesian approach, named after the 18th century minister Thomas Bayes who discovered a simple formula for updating probabilities using new data. The essence of the Bayesian approach is to provide a mathematical rule explaining how you should change your existing beliefs in the light of new evidence. In other words, it allows scientists to combine new data with their existing knowledge or expertise.

What constitutes Bayes approach that led to Nate Silver’s accurate forecasts?  Let me try and explain as best I can, using the help of examples provided by Eliezer Yudkowsky in his excellent blog (http://yudkowsky.net/).

Suppose it is an established fact through other studies that 1% of women at age forty who participate in routine screening have breast cancer.  Second, 80% of women with breast cancer will get positive mammographies.  But 9.6% of women without breast cancer will also get positive mammographies.  A woman in this age group has a positive mammography in a routine screening.  What is the probability that she actually has breast cancer?  The correct answer is 7.8%, obtained as follows:  out of 10,000 women, 100 have breast cancer; 80 of those 100 have positive mammographies.  From the same 10,000 women, 9,900 will not have breast cancer and of those 9,900 women, 950 will also get positive mammographies.  This makes the total number of women with positive mammographies 950+80 or 1,030.  Of those 1,030 women with positive mammographies, 80 will have cancer.  Expressed as a proportion, this is 80/1,030 or 0.07767 or 7.8%.  So the answer is not 1% who do have cancer or the 80% with a positive mammo.

The original proportion of patients with breast cancer is known as the prior probability.  The chance that a patient with breast cancer gets a positive mammography and the chance that a patient without breast cancer gets a positive mammography are known as the two conditional probabilities.  Collectively, this initial information is known as the priors.  The final answer – the estimated probability that a patient has breast cancer, given that we know she has a positive result on her mammography – is known as the revised probability or the posterior probability.  The mammography doesn’t increase the probability that a positive-testing woman has breast cancer by increasing the number of women with breast cancer – of course not; if mammography increased the number of women with breast cancer, no one would ever take the test!  However, requiring a positive mammography is a membership test that eliminates many more women without breast cancer than women with cancer.  The number of women without breast cancer diminishes by a factor of more than ten, from 9,900 to 950, while the number of women with breast cancer is diminished only from 100 to 80.  Thus, the proportion of 80 within 1,030 is much larger than the proportion of 100 within 10,000.  The evidence of the positive mammography slides the prior probability of 1% to the posterior probability of 7.8%.

Actually, priors are true or false just like the final answer – they reflect reality and can be judged by comparing them against reality.  For example, if you think that 920 out of 10,000 women in a sample have breast cancer and the actual number is 100 out of 10,000, then your priors are wrong.  In this case, the priors might have been established by three studies – a study on the case histories of women with breast cancer to see how many of them tested positive on a mammography, a study on women without breast cancer to see how many of them test positive on a mammography, and an epidemiological study on the prevalence of breast cancer in some specific demographic.

Let’s say you’re a woman who’s just undergone a mammography.  Previously, you figured that you had a very small chance of having breast cancer; we’ll suppose that you read the statistics somewhere and so you know the chance is 1%.  When the positive mammography comes in, your estimated chance should now shift to 7.8%.  There is no room to say something like, “Oh, well, a positive mammography isn’t definite evidence, some healthy women get positive mammographies too.  I don’t want to despair too early, and I’m not going to revise my probability until more evidence comes in.  Why?  Because I’m an optimist.”  And there is similarly no room for saying, “Well, a positive mammography may not be definite evidence, but I’m going to assume the worst until I find otherwise.  Why?  Because I’m a pessimist.”  Your revised probability should go to 7.8%, no more, no less.

What’s so great about Bayes’ theorem is that it can be used for reasoning about the physical universe.  But I think Bayes law also shows two other things that are useful to remember in economic analysis.  The first is the power of data or facts over theory and models. Neoclassical mainstream economics is not just voodoo economics because it is ideologically biased, an apology for the capitalist mode of production.  But in making assumptions about individual consumer behaviour, about the inherent equilibrium of capitalist production etc, it is also based on theoretical models that bear no relation to reality: the known facts or priors.  In contrast, a scientific approach would aim to test theory against the evidence on a continual basis, not just to falsify it (as Karl Popper would have it) but also to strengthen its explanatory power – unless a better explanation of the facts comes along.  Newton’s theory of gravity explained very much about the universe and was tested by the evidence, but then Einstein’s theory of relativity came along and better explained the facts (or widened our understanding to things that could not be explained by Newton’s laws).  In this sense, Marxist method is also scientific.  Marx went from the abstract (theory) to the concrete (facts).  The facts would strengthen the explanatory power of the theory or modify it.

This approach using statistical methods like Bayes law is what mainstream economics does not do.  Here is what Dan Kervick said in his blog recently (http://neweconomicperspectives.org/2012/09/shamanistic-economics.html), in a brilliant post on mainstream economics:
You guys in economics are supposed to be empirical scientists, not philosophers. You are supposed to develop the a priori elements of your science only so that you can produce empirically testable models of the real world, and then bring those models to bear on the world we actually live in. You are also supposed to help develop techniques that are relevant to decision-making and government policy in having predictable outcomes. You need to map the terrain of the actual world in detail, so you can help others navigate through it. To the extent you want to give policy advice that deserves to be taken seriously, your focus needs to be on contingent reality, not a priori possibility.
My criticism is that an awful lot of the policy advice we are getting lately is from theorists who are lost in the clouds of a priori models, and who don’t have a clear understanding of the structure of the actual economic order we live in, based on the functioning of actual, highly contingent and specific economic and political institutions.
If you are trying to navigate your way through a mountain range, you don’t ask a geologist; you ask a guide who has explored the mountain range in detail. If the guide has geological knowledge that can definitely help, but the geological knowledge itself is not sufficient to guide people through the terrain. If you want to fix a broken airplane engine, you don’t ask a theoretical thermodynamicist, you ask an engineer. The engineer’s knowledge of thermodynamics can help, but the thermodynamical knowledge itself is not sufficient to know how to fix an airplane engine.
It is not enough for you to describe logically coherent possible worlds with possible sets of beliefs about possible equilibria and possible time paths to those equilibria, where possible statements, and possible actions have possible effects as a result. You need to show we live in such a world – and this is a task for which you don’t seem to have much patience. When challenged on the score of institutional facts, you have repeatedly retreated back into the construction of other models and thought experiments.
The second thing we can glean from the use of Bayes law and Nate Silver’s results is the power of the aggregate.  The best economic theory and explanation comes from looking at the aggregate, the average and its outliers.  Data based on a few studies or data points provide no explanatory power.  That may sound obvious but it seems that many political pundits were prepared to forecast the result of the US election based on virtually no aggregated evidence.  It’s the same with much of economic forecasting.  Sure, what happened in the past is no certain guide to what may happen in the future, but aggregated evidence over time is a hell of sight better than ignoring history.
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest
Posted in economics, marxism, politics | No comments
Newer Post Older Post Home

0 comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Popular Posts

  • Amtrak: Washington DC to Huntington, West Virginia
    A Poem by Kevin Higgins   At Union Station hope is a t-shirt on sale at seventy per cent off. Yesterday, all the bow-tied barristers gather...
  • The NSA, Snowden, spying on Americans, Brazilians and everyone else
    We reprint this article by Glenn Greenwald which includes the video . It is from the Guardian UK via Reader Supported News . The Charlie R...
  • Austerity USA Begins March 1st:
    We reprint this article for the interest of our readers. Facts For Working People is not affiliated with Workers' Action. To read more f...
  • Starvation, poverty and disease are market driven.
    by Richard Mellor Afscme Local 444, retired What a tragedy. A beautiful little boy who should be experiencing all the pleasures that a heal...
  • Kaiser cancelled from AFL-CIO convention
    A short CNA clip from Kaiser nurses.  The AFL-CIO convention was apparently ready to applaud kaiser as the model health care provider.  The ...
  • Remembering 911
  • Buffet and Lemann: two peas in pod
    Jorge Lemann: won't eat what he produces by Richard Mellor GED Afscme local 444, retired In a previous piece I commen...
  • A poem on the 74th Anniversary of Trotsky's murder
                                                                                  You Are The Old Man In The Blue House                        ...
  • Cambodians clash with cops over land grabs
    Like China, there are repeated clashes between authorities and the population over the government's seizure of land for developers. Ther...
  • Austerity hits troops as rations are cut
    The organizers of this blog have explained that US capitalism cannot afford to keep its massive military machine working at its present leve...

Categories

  • Afghanistan (4)
  • Africa (8)
  • Afscme 444 (1)
  • anti-war movement (1)
  • art (6)
  • asia (15)
  • austerity (29)
  • Australia (4)
  • auto industry (3)
  • bailout (10)
  • bangladesh (9)
  • banks (11)
  • BART (13)
  • body image (4)
  • bradley Manning (17)
  • Britain (22)
  • California (17)
  • california public sector (18)
  • Canada (6)
  • capitalism (44)
  • catholic church (10)
  • child abuse. (1)
  • China (2)
  • consciousness (3)
  • debt (3)
  • Democrats (4)
  • domestic violence (7)
  • drug industry (6)
  • economics (43)
  • education (9)
  • Egypt (5)
  • energy (7)
  • environment (12)
  • EU (18)
  • family (1)
  • financialization (1)
  • food production (7)
  • gay rights (2)
  • globalization (17)
  • greece (3)
  • gun rights (4)
  • health care (13)
  • homelessness (4)
  • housing (3)
  • hugo chavez (4)
  • human nature (6)
  • humor (4)
  • immigration (2)
  • imperialism (14)
  • india (4)
  • indigenous movement (4)
  • Internet (1)
  • iran (4)
  • Iraq (4)
  • ireland (22)
  • Israel/Palestine (13)
  • Italy (3)
  • Japan (7)
  • justice system (11)
  • labor (15)
  • Latin America (17)
  • marxism (52)
  • mass media (4)
  • mass transit (1)
  • Mexico (4)
  • middle east (24)
  • minimum wage (4)
  • movie reviews (1)
  • music (2)
  • nationalism (2)
  • NEA (1)
  • Nigeria (1)
  • non-union (11)
  • nuclear (3)
  • Oakland (5)
  • Obama (14)
  • occupy oakland (2)
  • occupy wall street (1)
  • oil industry (2)
  • OUSD (1)
  • Pakistan (3)
  • Pensions (2)
  • police brutality (6)
  • politicians (6)
  • politics (22)
  • pollution (11)
  • poverty (7)
  • prisons (8)
  • privatization (6)
  • profits (21)
  • protectionism (2)
  • public education (9)
  • public sector (15)
  • public workers (6)
  • racism (18)
  • rape (2)
  • Religion (10)
  • Russia (1)
  • San Leandro (2)
  • sexism (21)
  • sexual violence (2)
  • Snowden (7)
  • socialism (22)
  • soldiers (1)
  • solidarity (1)
  • South Africa (15)
  • Spain (2)
  • speculation (1)
  • sport (2)
  • strikes (35)
  • students (3)
  • surveillance (1)
  • Syria (9)
  • tax the rich (4)
  • taxes (1)
  • Teachers (6)
  • Team Concept (4)
  • terrorism (22)
  • the right (2)
  • Trayvon Martin (3)
  • turkey (3)
  • UAW (3)
  • unemployment (1)
  • union-busting (3)
  • unions (51)
  • US economy (22)
  • us elections (6)
  • US foreign policy (41)
  • US military (26)
  • veterans (1)
  • wall street criminals (13)
  • War (15)
  • wealth (9)
  • wikileaks (12)
  • women (26)
  • worker's party (2)
  • worker's struggle (65)
  • workers (44)
  • Workers International Network (1)
  • world economy (28)
  • youth (5)
  • Zionism (13)

Blog Archive

  • ►  2013 (410)
    • ►  September (21)
    • ►  August (54)
    • ►  July (55)
    • ►  June (43)
    • ►  May (41)
    • ►  April (49)
    • ►  March (56)
    • ►  February (46)
    • ►  January (45)
  • ▼  2012 (90)
    • ►  December (43)
    • ▼  November (47)
      • Pakistan: Farooq Tariq comments on the Awami Worke...
      • US: it’s investment, not consumption
      • Trace Adkins and the Confederate flag
      • Burmese workers protest copper mine
      • Fast-Food Workers Walk Off the Job
      • The election's over, Obama's ready to make nice wi...
      • August Nimtz and Lars Lih: Socialists, Elections a...
      • The vultures gather round to scoop up a non-union ...
      • Global growth and the vampire squid
      • Bangladesh- 100 plus workers burnt to death. Walm...
      • The US rate of the profit – the latest
      • Reject austerity: Fight back against the coupon cl...
      • Walmart protests throughout the world.
      • Misery, death and hunger an everyday reality for m...
      • Black Friday Protest at San Leandro Walmart
      • Bayes law, Nate Silver and voodoo economics
      • Protest & Action at the Berkeley (CA) Marine Corps...
      • Monkeys Fight Back Against Inequality
      • Shared sacrifice? Tax the churches and all religio...
      • Bankruptcy Judge to negotiate contract for strikin...
      • Walmart workers, Black Friday: All out in Support.
      • Hostess and the Union leaders agree on mediation
      • Marx, banking, firewalls and firefighters
      • AFL-CIO's answer to Hostess Bosses? Hope.
      • Tel Aviv protests against and for Gaza massacre
      • Explaining the way the right wing Catholic forces ...
      • The Trade Union leadership has no answer to Hostess
      • Savita, Halappanavar: Tens of thousands march to d...
      • Women Shame and the Murder of Savita Halappanavar
      • China’s transition: new leaders, old policies
      • Catholic thinking and power killed woman in Ireland
      • Support South African Farmworkers' strike: DLF pre...
      • BP pays $4.5 billion. It won't save us from ecolog...
      • Savita Halappanavar''s institutionalized murder: C...
      • Woman killed in Ireland by right wing ideas and po...
      • South African farmworkers' strike
      • ULA press release on Savita Halappanavar's death
      • Another Gaza massacre: Finkelstein on the last one
      • Obama's honeymoon will be short: crisis, conflict,...
      • 24 hour strikes and protests throughout Europe
      • South Africa: farmworkers' strikes spread
      • Dirty Old Town: The Pogues
      • Prop 37 recount: $55 million spent by corporations...
      • The US health care system, a lesson in market failure
      • Critical Juncture: Act for Bradley Manning
      • Monsters, delusions of debt and the crisis
      • South African activist speaking in the Bay Area.
Powered by Blogger.

About Me

Unknown
View my complete profile