Why haven’t economic statistics improved?

Party animal that I am, I’ve been spending my spare time in Stockholm this week (where I’ve been doing a couple of events for the Institutet for Naringslivsforskning) reading Oskar Morgenstern’s [amazon_link id=”B00177CAI0″ target=”_blank” ]On The Accuracy of Economic Observations[/amazon_link]. The 1963 edition of this 1950 book was just sent to me by a friend who had read a draft paper of mine that will be out quite soon, which refers to the book in a quotation from a recent paper by Charles Manski.

[amazon_image id=”0691003513″ link=”true” target=”_blank” size=”medium” ]On Accuracy of Economic Observations[/amazon_image]

As so often when you start researching something, it turns out there’s nothing completely new. Morgenstern wrote trenchantly about some of the things that have been bothering me about the way economists use economic statistics. For example: “A significant difference between the use of data in the natural and social sciences is that in the former the producer of observations is usually also their user.” Economic data on the other hand are collected by many hands, often consist of time series, and are processed by statisticians. Economists rarely think hard enough about their numbers – a problem made all the worse by the easy availability of statistics to download from handy websites and pour into a software package that will churn through regressions and generate test statistics.

Morgenstern also notes the strong incentives many ‘creators’ of economic data have to give misleading responses to survey questions. What’s your income? What price do you charge for this service, oh oligopoly provider? What is the level of your GDP, oh Greek government? “‘Strategic’ considerations play havoc with reliability.” Even if all respondents are well-intentioned, the sampling error, general mistakes in data collection and processing and so on mean we place a ludicrous amount of confidence in any and all economic statistics. “Three or four digits is probably the maximum accuracy of primary data that ever needs to be considered in the vast majority of economic arguments,” he wrote.

Gratifyingly, he likes the technique of spectral analysis of time series, which I did a lot of in my PhD days, because they arrange the data in frequency bands. “There can hardly be any doubt that the powerful new techniques of spectral analysis will put the study of economic fluctuations on a new basis,” the book says. Alas, it didn’t catch on except among a small number of time series anoraks. The chapter I’ve just finished concludes that economics still needs to learn to live with the fundamental importance of errors in the data, and include them in its theories – just as modern physics has. Alas, this too has not caught on among economists. All of which raise the question – why not? Why haven’t economic statistics improved, it seems, since 1960?

My favourite chart at the moment is the Bank of England’s GDP forecast in the Inflation Report. February’s showed a 90% chance that UK annual GDP growth was between 1% and 5% at the start of 2015, taking into account simply past experience of revisions of the data, and not any of the additional potential sources of error. This is the difference between the standard of living doubling in 70 years and 14 years, or in other words vast. Something to bear in mind for anyone making any last minute decisions about how to vote today on the basis of parties’ economic claims.

It’s the power, stupid

What’s not to like about a book with the title [amazon_link id=”1612193749″ target=”_blank” ]The Utopia of Rules: On Technology, Stupidity, and the Secret Joys of Bureacracy[/amazon_link]. This is a book of essays by Occup Wall Street activist and LSE anthropologist David Graeber, author of the tome [amazon_link id=”1612194192″ target=”_blank” ]Debt: The First 5000 Years[/amazon_link]. Well, various things. Just like his previous book, I enjoyed the read, strongly disagreed with some points and strongly agreed with others. That makes for quite good entertainment.

[amazon_image id=”B00MKZ0QZ2″ link=”true” target=”_blank” size=”medium” ]The Utopia of Rules: On Technology, Stupidity, and the Secret Joys of Bureaucracy[/amazon_image]

The book is a series of essays, ostensibly about bureaucracy, but really about the iniquities of neoliberal capitalism, which is not at all an arena of individual liberty but on the contrary a highly circumscribed system of exploitation. ‘Bureaucracy’ does service as a catch-all term for the set of rules through which the oligarchy in cahoots with the government restrict the options of the great mass of people.

There is certainly something in this portrayal of a society of rich people and large organisations able to act as they please while the great majority experience a highly regulated life. Think about wanting to open a small cafe or a two-person plumbing business, and the extent of certification and inspections that are needed. Or opening a bank account. Graeber writes that we spend hours entangled in paperwork to apply for licences or pay taxes or open accounts, and: “The paperwork we do exists in this sort of in between zone – ostensibly private, but in fact entirely shaped by a government that provides the legal framework, underpins the rules with its courts and all the elaborate mechanisms of enforcement that come with them but – crucially – works closely with the private concerns to ensure the results will guarantee a certain rate of provate profit.” All the more so in these days of outsourcing of state functions such as determining eligibility for benefits. There has been, he says, a gradual fusion of public and private power into “a single entity, rife with rules and regulations.”

So I think there is something in this. Matt Taibbi was onto the same point in [amazon_link id=”0385529961″ target=”_blank” ]Griftopia[/amazon_link] when he argued that all the people who seem crazy to support Tea Party policies actually do have an arbitrary and unfriendly government controlling their lives.

Where I strongly disagree with Graeber is in his analysis of how to respond. The good part of his argument is about experimenting with other kinds of association and collective organisation, not government but not for profit, perhaps idealistic but worth trying. However, he also writes: “Do not underestimate the importance of sheer physical violence,” drawing on the experience of protests like the 1999 Battle for Seattle riots against the WTO.

He also has a long excursion into technology, arguing that the pace of change peaked in the 1950s or 60s, and that current technological change is not delivering things people might actually want such as flying jet packs. The high hopes of the 1960s as manifested in Star Trek, say, have not materialized. No beaming up, no holodecks etc. Instead, technology has been diverted to military causes. Apart from the fact that the military have always influenced technological research, this is a fact-free essay. I’d want to see some kind of evidence, because if you look at things like either price declines (or how many hours of work are needed to purchase a unit of computer power, or light), or the character of post-1960s discoveries  (medical advances, compelling technologies such as mobile telephony) then there seems to me to be decent evidence for no slowdown. Why can’t computers think yet? Well, give them time. Economic historians like Paul David and David Landes have pointed out how long and variable and unpredictable are the lags between discoveries and their economic and social impact. The dreams and fears about electricity probably peaked more than 60 years before its use had become widespread.

Still, disagreements don’t really matter with a book like this. It’s enjoyable to read something thought provoking with lots of interesting material. I enjoyed the Star Trek riff (“The Federation is Leninism brought to its future absolute cosmic success… a happy conjuncture of material abundance and ideological conformity”) and the potted history of the German Postal system of the 19th century and its influence on future ideal societies, and his review of the third Batman movie and its political interpretation. This book is also less than half the length of [amazon_link id=”1612194192″ target=”_blank” ]Debt[/amazon_link], Bureaucracy having a shorter history I suppose. Although actually the one thing this isn’t really about is bureaucracy, but instead another Graeber take on power.

What should rule the world after GDP?

[amazon_link id=”0691166528″ target=”_blank” ]The Little Big Number: how GDP came to rule the world and what to do about it[/amazon_link] by Dirk Philipsen is out next month. As a GDP-afficionado, I was eager to read it and found it an enjoyable read and generally thought-provoking, although not agreeing with the author on all points.

[amazon_image id=”0691166528″ link=”true” target=”_blank” size=”medium” ]The Little Big Number: How GDP Came to Rule the World and What to Do about It[/amazon_image]

My main disagreement was more about tone and exaggeration in what is a rather emotional book. There are for example assertions like: “It is safe to say our ancestors, for some 200,000 years prior to the agricultural revolution, engaged in labour only to the very extent to which it helped them survive.” Really? No cave paintings, ancient jewellry, religion? Was Stonehenge essential for survival? Or, because of our “fixation with the accumulation of things”, trying to capture the reality of late 18th century life “by saying that people were poor would represent a fundamental misread.” So were they not less well-nourished than us with more illnesses and shorter lives and many children dying in infancy? Did women (and even men) not spend hours in domestic drudgery? I don’t hesitate to call people in the 18th century poor on this basis; it’s nothing to do with a passion for accumulating cars or handbags. I don’t want more than one washing machine but wouldn’t be without the one – just like Hans Rosling’s mother.

Many readers will like the polemical tone of [amazon_link id=”B00V943S3W” target=”_blank” ]The Little Big Number[/amazon_link]; it’s obvious I didn’t. Apart from that, this is an interesting book looking at the history of GDP, its inadequacies as a measure of social welfare, and the environmental consequences of seeking continuing economic growth. It covers some of the same ground as my own [amazon_link id=”0691156794″ target=”_blank” ]GDP: A Brief but Affectionate History[/amazon_link], with additional detail. The book identifies the turn to growth rather than levels of national income as a policy aim in the 1950s. Philipsen attributes this to American optimism as the victor in World War 2. I wonder if it isn’t more related to the dawning Cold War, and the need to demonstrate over and over again that the American system was superior to the Soviet one? Geoff Tily (pdf) pinpoints an OECD document of 1961 as the first official reference to targetting growth, so quite a while after the end of the Second World War. (And as ever for anyone who hasn’t read it, I highly recommend Francis Spufford’s [amazon_link id=”0571225241″ target=”_blank” ]Red Plenty.[/amazon_link])

The Soviet bloc used Net Material Product as their definition of ‘the economy’. The statistics were highly suspect, even those calculated as a best effort by the CIA; it wasn’t really until the mid-1980s, with glasnost, that the true, sustained weakness of growth in the planned economies became evident. There is a nice anecdote in the book: “Once Soviet archives opened to historical research in the years after 1991, we learned that American GDP figures of the Soviet national economy had been far more accurate than estimates provided by the Soviet Union’s own economic planners, who found it near-impossible to come up with reliable data for their centralized planned economy. What did Soviet planners do? They spied on American economists calculating Soviet GDP, and then incorporated what they learned from their American colleagues into their own planning.” Of course, the Americans were spying on the Soviets to get the basic data. Who knows what the figures meant? But the queues and shortages and poor quality of goods were all real.

The second half of the book looks at the ‘Beyond GDP’ debate, although oddly asserting that nobody paid much attention to the issues between Robert Kennedy’s assassination and Congressional hearings in 2001. This is a little US-centric; the global environmental movement kept the candle burning for alternatives all through that period. Philipsen concurs with the kinds of indicator like the Global Progress Index that show progress coming to a complete halt in the 1970s. This always seems absurd to me: even if that was a real turning point in terms of costs to the environment, which gets a heavy weight in the alternative index, there has been a lot of welfare-enhancing innovation and straightforward growth since the 1970s. It’s not just the invention of tamoxifen or the internet, but the fact that more westerners live in houses with phones, indoor toilets and central heating. Sure, there’s a trade-off with the environment but is that really no progress? Nor is Philipsen interested in the issues about defining either market output or social welfare for the growing category of digital goods that are often free and have strong public good characteristics.

As for what to do about it, the book advocates ditching GDP completely, and having a national dialogue about economic goals based on the principles of sustainability, equity, democratic accountability and economic viability. It isn’t clear how this prescription fits with the several ‘dashboard’ initiatives under way now, which are described here. The dashboard approach is attractive, as is public consultation. However, it isn’t yet clear which dashboard is best or what should go in it – it’s easy to end up with a laundry list of good things, and no analytical framework for assessing outcomes or trade-offs. So the real need now is for the hard grind of the kind that Kuznets, Stone and Meade and their many colleagues sustained through the 1930s and 40s in creating the national accounts to make a GDP-plus set of social accounts practical.

I still think dropping GDP altogether would be a mistake – hence ‘affectionate’. How would a government run fiscal policy or a central bank monetary policy without a nominal GDP figure and some of the national accounts detail? The national accounts statistics as a whole also contain a lot of the material that could furnish a meaningful dashboard, so again it would be a waste of an intellectual asset to ditch all of that.

However, the answer to the underlying question, are we going to move ‘beyond GDP’ is: yes.