Tuesday, 13 March 2012

Greater Manchester Growth Plan

I was at Portcullis House yesterday for the launch of the Greater Manchester Growth Plan. Speeches from Danny Alexander and Greg Clark suggest that the government remains committed to striking substantive deals with some of our major cities (we should see the details on the first of these fairly soon).

[Disclosure: I sit on the Economic Advisory Panel that helped draw up the Manchester Growth Plan.] I won't go in to the details on the 10 recommendations that we make but wanted to comment instead on the broader issues. As I said at yesterday's launch - the Onion style headline for the growth plan would read "Manchester Plan calls for more Money and Power for Manchester". I share this immediate reaction but, on balance, I don't think that such extreme scepticism is warranted. Let me explain my reasoning.

I should start by pointing out that my personal position on geographical disparities in the UK remains unchanged. The evidence is clear that who you are is more important than where you live in determining outcomes, but that both matter. It's very difficult to address either personal or area problems, but the evidence suggests that we have more success with the former than the latter. Given this, I would like to see policy focus on improving personal characteristics (e.g. skills) and then allowing people to take advantage of opportunities wherever they arise. In practice, in the UK, more of these opportunities will arise in the South than in the North. It's for this reason that I favour expanding housing supply in the South and allowing more people to live there. In other words, personally I would support more geographic concentration in the South. In contrast, part of the objective in giving 'more power and money for Manchester' is to work against more geographic concentration. I reconcile these differences because, tt the end of the day, I recognise that my personal opinion regarding more concentration in the South puts me in the minority. In other words, even if I am sceptical on geographical rebalancing (a 'normative' position) I think the recommendations in the Manchester growth plan should help achieve it (a 'positive' position).

I should also say that I don't think that 'more power' is just about geographical rebalancing. I am convinced by the evidence that suggests that more localisation will probably improve urban policy making (I also agree with the broad principles that underpin this move). Ironically, however, I'm less convinced that there is much evidence that localisation will have a large direct impact on economic growth. Still, I think we should support it because the highly centralised processes in the UK don't seem to have done much to deliver on economic growth outside of London and the South East. In short, the arguments for 'more power' are that (a) it should lead to better urban policy making; (b) it might lead to more growth and so we should try it.

What about 'more money'? Here, there seemed to be some confusion at the launch. While the immediate recommendations revolve around powers, those on local government finance will lead to Manchester having more money in the long run (because it will keep a larger share of the tax revenues that it generates). So the recommendations are about both more power and more money. I think there are three arguments in favour of this. First, more money is conditional on more growth. This rewards Manchester for making difficult local decisions (e.g. on planning). In other words, more money is partly about getting the incentives right. Second, focusing expenditure on Manchester means that policy is at least working with market forces within the North West region. As I have argued before such concentration may be important in offsetting the very strong market forces working against the North as a whole (and in favour of the South). Third, the previous government tried jam spreading, the effects appear to have been limited, so now might be a good time to try some more concentration (especially given the overall fiscal position).

Overall then, not the impassioned support that you would get from those with more 'skin in the game' but support none the less. More money and more power for Manchester is a policy experiment worth trying.

Monday, 12 March 2012

NHS competition: a response to critics

Posted by Steve Gibbons, SERC and LSE

In a recent blog post, Allyson Pollock, Alison Macfarlane and Ian Greener misrepresented work on NHS competition done with Zack Cooper, Simon Jones and Alistair McGuire, and built straw man arguments designed to undermine our findings. This might pass as political discourse, but is it academic debate?

Perhaps these objections arose because of the publicity that our work has received, rather than the detail of the research. But our goal as academics is to produce the most rigorous research possible, with the further goal of promoting evidence-based policies. When we produce evidence that can have an impact on policy, we present this work and make it available to policy-makers, press and the public. Researchers in publicly funded universities are expected to publicise their work in a timely manner to policy makers. How else should good policy be formed or research funding justified?

Pollock and her co-authors decried ‘The drip feed of pro-competition studies’ we have produced. In fact, there are just two studies. Our first study in the Economic Journal (EJ) looked at the impact of competition - by which we mean a move to less monopolistic local markets - on quality. This work illustrated that competition between NHS providers in a market with fixed prices led to better outcomes. Our findings were consistent with what economic theory would predict and they mirror precisely the academic literature from empirical research in the US. More than that, since our research came out, two subsequent studies by separate research teams (Gaynor et al and Bloom et al) have found nearly identical conclusions about the positive impact that fixed price competition has had in the NHS.

Our second paper looked at the impact of this competition on patients’ length of stay (and was an expansion of an earlier paper). It showed that NHS providers in competitive environments shortened their pre-surgical and overall length of hospital stays (which we regard as evidence of improvements in efficiency). In contrast, the net effect of the introduction of private providers into the market was to increase the average length of stay in NHS hospitals and is potentially suggestive of cream-skimming. This latter finding is not overtly pro-competitive. These studies provide precisely the kind of evidence that policy makers look for, so that they can learn about what has worked and not worked in the past, in order to chart a sensible path forward. This is why they have had a significant impact. Of course, wide-reaching policy should not be set on the basis of one study. However, as a body of evidence grows, the case for policy action becomes more persuasive.

What about the counter-arguments? So far, critics have not articulated a theory as to how fixed price competition could undermine quality in the NHS. They have presented no evidence of their own that competition has harmed patient outcomes.

To be fair, Professor Greener has done work in this area. For example, in 2009, he published an article in a journal called Public Money And Management titled, “Patient Choice in the NHS: What is the Effect of Choice Policies on Patients andRelationships in Health Economies”. This ethnographic study presents insights into the attitudes of hospital managers and staff in one NHS trust. But is it ‘good science’ in contrast to our work which he and Pollock call ‘bad science’ and which they have criticized in the Lancet?

Greener’s piece drew on 60 semi-structured interviews of NHS staff at a single NHS hospital; no patients were interviewed during the course of the research. From these interviews, he concludes that: ‘The case presented suggests that patient choice policies fall short on all of the conditions that are necessary for them to work. Patients in the case study were reluctant to exercise choice decisions’. Here, Greener is happy to use a qualitative style of research (interviews at a single hospital) to draw conclusions of his own against a national policy.

However, when other researchers use qualitative research together with quantitative evidence to show that competition can have positive effects, there is less tolerance. In their co-authored Lancet comment piece attacking our research competition, Pollock et al. dismissed work by Nick Bloom, Carol Propper, John Van Reenen and Stephen Seiler, stating disparagingly that in their study: “An association with management quality is based on interviews with 161 senior staff that did not take account of relevant causal factors’. Bloom et al. involved interviews at 100 hospitals and integrated quantitative work with advanced econometrics. If this is ‘bad science’, what are we to make of the critic’s own work, which adopts a related approach?

My colleague Henry Overman has kicked off a good conversation on this blog about what constitutes sensible blogging - we hope this discussion continues. We hope such a debate, plus our reply here, will provide a teachable moment to pause and reflect on how academics discuss evidence, consider the casual use of phrases like ‘bad science’ and begin a thoughtful discussion of the role of blogs in academic and policy debates in the social sciences.

Elsewhere on the LSE site we give a further point-by-point rebuttal to the criticisms of our work. It is worth noting that Professor Pollock has raised these points before and we responded to her points twice, both in a Lancet letter, and in freely accessible online 8-page document (a detailed response that Pollock et al. do not mention) posted online, also included as a linked appendix to our Lancet reply.

A version of this piece was originally published on the LSE British Politics and Policy blog.

Friday, 9 March 2012

Does cultural diversity help London businesses?

Posted by Dr Max Nathan, SERC and LSE Cities

London exemplifies the cosmopolitan world city. Dominating the UK economy, a major hub of the global system, it is also one of the most diverse cities on the planet. The capital contains contains around 40% of UK immigrants, and has almost half the non-white population in England and Wales. London's schoolchildren speak almost 300 languages between them, and religious diversity is similarly rich.

Immigration is a major driver of these trends, but not the only one. Many 'new' communities have been here for some time, and London's multicultural history is a deep one. Peter Ackroyd's biography of London records "Cymric Brythons and Belgae ... remnants of the Gaulish legions ... East Saxons and Mercians ... Danes, Norwegians and Swedes ... Franks, Jutes and Angles, all mixed and mingling together to form a distinct tribe of 'Londoners'." Worries about multiculturalism aren't new either: in 883AD, fearing unrest, King Alfred banished the Danes from the city, to the east of the River Lea.

Today, a majority of Londoners are proud of the city's diversity, and see it as a social asset. Is it also an economic good?

Economic analyses of diversity have traditionally focused on the labour market impacts of 'immigration shocks', rather than on wider effects of larger, more mixed communities and cities. These dynamic effects of diversity come in several flavours. For example, diverse workforces might have access to a bigger pool of ideas and perspectives, which could help firms to innovate. But mixed groups might also face communication and trust barriers, at least in the short term. Conversely, co-ethnic networks might help companies access international markets, or new 'home markets' opened up by immigration. However, discrimination could limit their success in the marketplace. 

We know surprisingly little about how the wider economics of diversity operate in any city, let alone in London. So in some research recently published by SERC, Neil Lee and I tried to find out.

We used rich data from the London Annual Business Survey to test links between London firms' diversity and aspects of their business performance. We focused on firms' top teams, as managers and owners tend to make the business-critical decisions. Our analysis throws up four main results. First, management diversity - and co-ethnicity - are positively linked to innovation in firms. Second, this does not carry over into successful commercialisation of ideas. Third, firms' diversity shapes the markets they sell into: 'migrant-diverse' firms are heavily internationalised, while 'ethnic-diverse' firms plug into London's cosmopolitan home markets. Finally, we find positive links between migrant status and entrepreneurial firm formation. 

Together, these findings suggest a small but robust 'diversity bonus' for London businesses. So what does this mean for policy?

Our results suggest the current Government's immigration policies are unhelpful for London firms: both the immigration cap and restrictions on post-study work routes seem likely to restrict the future supply of potential entrepreneurs in the capital.

However, different skills are clearly required for starting up a business, having good ideas and taking them to market. Economists talk about 'noisy learning' as entrepreneurs try out new products, many of which will fail. However, our results suggest a commercialisation gap for many migrant and minority ethnic firms - which could be due to discrimination, a lack of skills, or poor quality business support.

Our findings also highlight broader welfare issues. Long term, some employers could use these diversity effects to improve their business models; others might become dependent on relatively cheap migrant labour. There is already some evidence of 'migrant-dependence' in sectors of the London economy. Better regulation of wages and working conditions for migrant workers are important here, as are effective employment and training initiatives for low-skilled Londoners.   

A version of this post was originally published on the LSE British Politics and Policy blog.

Wednesday, 7 March 2012

NHS competition: Bad blogging etc (part II)

I wrote yesterday about misleading criticism of LSE research on NHS competition. In reponse to a couple of comments on my piece, one of the authors of the research (Steve Gibbons, SERC's research director) posted a reply. I thought his reply would be of general interest (particularly regarding their motivation for conducting the research which is discuss towards the end of the comment) and deserved a re-post. You can read the other comments at the bottom of my original piece.

Here's what Steve wrote:

"In response to the comments on this blog regarding our use of "LOS" [Lenght of Stay] as proxy for efficiency and productivity in our latest discussion paper, I agree that we use these terms loosely. The paper is, taken at face value, about the way that the relationship between hospital market structure and LOS changed over the period of the 2006-2008 choice reforms. However, this statistical evidence would be completely uninteresting and useless for informing academic debate or policy makers without some theoretical assumptions about what these numbers in the data might mean in terms of 'real world' factors. This much is true of any empirical analysis, not just ours. Our suggestion is that LOS (particularly pre-operation LOS) is one potential measure of efficiency savings (i.e. reducing any slack in the system without imposing additional costs on staff or patients). We drew this assumption from the literature, and our general understanding of the institutional environment (it is, for example, a pervasive theme in the training materials on the NHS institute for innovation and improvement website http://www.institute.nhs.uk/)

On other points raised in the comments, we have answered before the objection that these elective choices are not actually being made by GPs or patients. The evidence in the HES data (we do not report it in the current version papers) is that patterns of choice did change systematically between the pre and post-reform periods. GPS started referring to more providers and patients were less likely to attend their nearest hospital. But what is more important is that the institutional structure and information systems that facilitate choice were put in place in 2006 and it is the hospital response to these institutional changes, the threat of competition from other NHS providers, that is relevant, not whether different choices were actually being made by patients. I guess, if the GP commenting here has not made use of this choice availability, this is because he and his patients were happy with the choices he was making already and with the service being provided in his locality. The HES patient data suggests that this is not true in general of all GPs or all patients in England.

Lastly, I am baffled as to what political intent critics think we have in writing these papers. For sure, we probably all have priors that involve caution about local monopolies, and think that not being offered a choice about where you can go for e.g. a hip operation is unlikely to be a good thing, either for quality or equity. I do not think this makes us rabidly pro-market or right-wing and I am not in favour of privatising the NHS (and nor are any of my co-authors as far as I am aware). Nor do we wish to see some kind of punitive competitive regime imposed on doctors, nurses or other NHS staff. My wife is an NHS consultant, so this would personally not be in my favour. On the contrary, the research is motivated by a general interest in the role of market structure in public service provision, following in a line of academic work in economics on this issue, and for a desire to provide evidence to help inform policy.

Ironically, given the assumptions that people seem to make about our political motivations, the message from both our papers on NHS competition is in favour of more local NHS hospitals, not less."

Is Heathrow in the Wrong Place?

Posted by Paul Cheshire, SERC and LSE
The Guardian reports that Justine Greening agrees with proponents of Boris Island that Heathrow is in the wrong place – “if you were starting from scratch”.  But the fact is that we are not starting from scratch, and this has fundamentally important implications for decisions on airport policy.  
First, Heathrow has – admittedly inadequate – public transport links already in place. Second, and even more importantly, one must consider the costs any large airport inflicts on residents who might experience its noise and pollution without compensation. The conventional answer is that these are the people living near Heathrow. But it is not as simple as that. 
Almost no one living in Southall, Richmond or Wraysbury looks out of their windows and says – ‘What a surprise  – there are noisy aeroplanes overhead’. Almost no one has lived continuously in the affected area since 1965 (although one occasionally appears on TV, unearthed by a journalist looking for a human interest story or a visiting politician).
Heathrow has been a big and noisy airport for at least 40 years. Some people live in the area because they work at the airport; some because they are frequent users; but most live in the area because - all else equal - the cost of housing is lower there.
Research on how housing markets work shows almost beyond doubt that house prices and rents fully reflect all the costs of disamenities such as aircraft noise, high crime or flood risk. In the same way, the cost of housing quickly adjusts to reflect the value of better local state schools, local parks or transport links.
What’s more, people pay not only for current amenities but also for expected future values of those amenities, as I showed in some 2004 research [pdf]. So it is not just the present experience of aircraft noise and pollution that is reflected in house prices around Heathrow but reasonable expectations about levels of that nuisance in the future.
So if we were truly starting with a clean slate, London’s main hub airport would not be where Heathrow is. But given that Heathrow is where it is, and has been there for more than a generation, it is in exactly the best place in terms of compensating people for the noise and pollution it causes. People who are affected have been compensated at least once via lower house prices and in many cases twice - because they have received help to pay for sound proofing their houses.
Wherever they are, aircraft and airports cause local nuisance and pollution. So we need to compensate those affected by airports and reduce the environmental costs by taxing flying appropriately. But the best way of compensating people is through the housing market – and that implies not only Heathrow is 'in the right place', but that policymakers should focus any necessary expansion of airport capacity where airports are already located.

Tuesday, 6 March 2012

NHS competition: bad science or bad blogging?

Generally speaking I support the idea that academic researchers should engage with public debate. If we have evidence that could help inform policy and wider debates then it's right that we should publicise that beyond our own narrow academic communities. Blogging is one highly effective way of doing that. But every so often I read something on an academic blog that makes me pause and question whether more blogging will end up improving the quality of public debate in the long run.

Yesterday's LSE British Politics and Policy Blog on NHS competition provides a good example of the kind of post that worries me. This post criticises research about the impact of NHS competition on patient outcomes and accuses my LSE colleagues of engaging in bad science, data dredging and faulty analysis. I assume that this post will have been read by far more people than the original scientific paper. That's to be expected - after all it is what the blog is trying to achieve. But as I read through the post I became increasingly puzzled by the fact that the criticism in the the post appeared to bear little relation to the scientific papers I had read. When I went back to the original papers this morning, this confirmed my original concerns.

As I know people may not have access to the academic paper, let me give some concrete examples.

The 'major cause of reductions in AMI'?

PAPER: “using [acute myocardial infarction] AMI mortality as a quality indicator, … mortality fell more quickly (i.e. quality improved) for patients living in more competitive markets after the introduction of hospital competition (to the NHS) in January 2006"

BLOG: "The major improvements in outcome after acute myocardial infarction can be attributed to improvements in primary prevention in general practice and in hospital care".

These points are not contradictory. Couldn't the major improvement be attributable to primary prevention and hospital care while hospitals that face more competition saw mortality fall more quickly?

Heart attack victims don't choose where to be treated

BLOG: "the government’s cardiac Tzar, Sir Roger Boyle, was sufficiently angered by their claims to respond with withering criticism: AMI is a medical emergency: patients can’t choose where to have their heart attack or where to be treated!"

PAPER: "we expect that AMI mortality will decrease more quickly in more competitive markets from mid-2006 onwards after hospitals were exposed to competition created from the new NHS reimbursement system and the expansion of patient choice. While providers are not explicitly competing for AMI patients because competition in the NHS is limited to the market for elective care, we expect the market-based reforms to result in across-the-board improvements in hospital performance, which in turn will result in lower AMI death rates. To that end, Bloom et al. (2010) looked at NHS hospitals and found that better managed hospitals had significantly lower AMI mortality and that greater hospital competition was associated with better hospital management."

In short, the paper is quite clear on the mechanism. Competition on elective care care improves management which also happens to benefit AMI. Why not use elective care directly? Because hospitals can 'manipulate' statistics around those in a way that it can't with AMI precisely because patients have no choice! In other words, the authors clearly understand that patients have no choice for AMI but this helps rather than hinders them in their research.

Elective patients don't choose hospitals

BLOG: "Less than the half patients surveyed in 2008 even remember being given a choice, and only a tiny proportion made those choices based on data from the NHS choices website."

PAPER: There were three components to the health reform only one of which concerned patient choice but all three of which sharpened incentives for hospitals. Also, even if patients don't remember being given a choice: "since GPs are highly active in informing the destination of most referrals, GPs now play a substantial role dictating how money flows around the post-[reform] NHS."

There are several ways in which the reforms sharpened incentives for hospitals. Pointing to the fact that patients don't remember being given a choice doesn't seriously address whether or not these incentives worked in practice.

No biological mechanism for choice to affect outcomes

BLOG: There is no biological mechanism to explain why having a choice of providers for elective hip and knee operations surgery [...] could affect the overall outcomes from AMI where patients do not exercise choice over where they are treated."

But the paper doesn't ever claim that there is a biological mechanism. It claims there is an economic one via the incentives described above.

They ignore the existing evidence

BLOG: "They sweep aside decades of careful economic theory and evidence which shows why markets do not work in health services"

PAPER: Provides pointers to existing literature (and reviews) and specifically considers the reasons why evidence from the reforms of the mid 1990's, the internal market might not be very useful "because the internal market never created significant financial incentives for hospitals to change their behaviour"

They engage in data dredging and their work should never have been published

BLOG: "if you repeat an analysis often enough significant statistical associations will appear." The work was subsequently published in "the Economic Journal. That it got through that journal’s peer-review process is perhaps indicative of the poor understanding of healthcare and routine data from reviewers of that journal."

I don't see any basis for the first of these claims. Data 'dredging' is a serious problem - but not one that appears to apply to this paper (which shows that the results are robust to many different variations in specification - the exact opposite of the data mining problem). The Economic Journal is one of the world's leading peer-reviewed economics journals. I don't believe that peer review is everything, but simply insinuating that the referees and editors of that journal don't know what they are doing doesn't cut much weight with me.

Bad blogging versus bad science

I could go on to discuss the errors around the second paper where, e.g., the blog claims that they don't control for the mix of operations when the paper actually considers within treatment changes in outcomes (so mix is irrelevant). But I assume that the authors are perfectly capable of further defending their own research.

My point is simply that a blog that is supposed to help improve the public's understanding of the evidence is carrying a post that is pretty misleading about what the papers actually do, what they find and what claims they make about their findings. To my mind, this raises far more concerns about bad blogging than it does about bad science ...


[Disclosure: Steve Gibbons is SERC's research director and I am affiliated with the Centre for Economic Performance]

Thursday, 1 March 2012

Miserable Londoners

The new government wellbeing statistics suggest that London is the most miserable place in the country. Worse, from a personal perspective, in 4 years time I'll sit in the late 40s age group which will make me part of the unhappiest group in the the UK (men 45-49 living in London). Time to move, perhaps?

This begs the question what we learn from spatial differences in wellbeing? As usual, the situation is more complex than the simple headlines would suggest. First, it's possible that small regional differences occur by chance. This can occur even when surveys are nationally representative because the number of people interviewed in any one location will be considerably smaller. Second, the survey tells us that individual characteristics affect stated happiness. From SERC work on wages we know that areas differences in wages look much smaller once we allow for the fact that different types of people live in different places.

Indeed, a recent paper by Oswald and Wu for the US (published in the Review of Economics and Statistics 2011) show that the relative position of US states in terms of wellbeing shifts around a lot if you control for observed non-financial individual characteristics (i.e. not income). Again, from our work in the UK on wages we know that controlling for the unobserved characteristics of people would change these area effects even more. In short, when who you are is important in determining how happy you are, simple comparisons of areas are much less useful than they might seem.

A further complication is also highlight by Oswald and Wu's work. Once we recognise that people are mobile across space, economic theory suggests that people shouldn't be able to make themselves better off by moving. As Oswald and Wu explain: "If Vermont, for example, offers a more attractive level of well-being to representative individual A than does Ohio, then we would expect to see Ohio citizens like individual A try to move to Vermont. That kind of migratory flow will cease only when a receiving region has become less desirable as an area in which to live. The economic equilibrium ought to be one of strict equality of utility [...]. If the economist’s arbitrage theory across regions is correct and well-being data are a useful proxy for utility, then its prediction should be detectable in an empirical test for state-by-state equality of well-being
for a person of given characteristics".

In other words, once we control for individual characteristics then there shouldn't be any spatial differences in wellbeing measures providing that the wellbeing measure is actually capturing the factors that determine people's 'wellbeing' (in the sense of utility). In practice, for the US, Oswald and Wu find that some spatial differences in wellbeing do persist but they also find support for a weak form of spatial arbitrage - once we control for individual incomes wellbeing is lower in states with higher average per capita incomes. In other words higher incomes are compensation for living in less nice places in terms of the non-financial benefits they deliver.

So where does all of this leave this soon to be middle aged London based male? The evidence suggests that moving is unlikely to do much for my happiness (unless I am doing it because for personal reasons I know think me and my family would be happiest somewhere else). Instead, I should try to keep my wife happy (married people are happier), enjoy the kids (at least until they are 11) and start saving for that Porsche.