Drink and disease: how figures can confuse
The annual compendium of alcohol statistics from the NHS Information Centre, published yesterday, shows that alcohol-related admissions to NHS hospitals have exceeded 1 million for the first time, reaching 1,057,000.
The increase on the 2008-09 figure (945,000) is 12 per cent, at a time when the amount of alcohol people say they drink is declining. The proportion of men drinking more than 21 units a week fell by two percentage points, from 28 to 26 per cent, and the number of women drinking more than 14 units by one percentage point, from 19 to 18 per cent, between 2008 and 2009.
Total consumption rose slightly, from an average of 1,149 ml per person per week to 1,190 ml per person as the UK emerged from the recession, but this was still below the 2007 level of 1,275 ml. Alcohol-related deaths – that is, those caused by conditions directly linked to alcohol – fell from 6,768 in 2008 to 6,584 in 2009. Much of the fall was attributable to a fall of nearly 250 in deaths from alcoholic liver disease.
So there is much to celebrate in the report. Even the minor tables, such as the ones showing the number of people aware of the daily drinking limits, are encouraging. In 2009, 75 per cent of respondents of the ONS’s Opinions Survey said they were aware of the limits, against 67 per cent in 2008. This is the highest figure ever recorded.
Yet I will wager that tomorrow’s newspapers will headline their stories “More than a million admitted to hospital as a result of drink” – or something a bit snappier conveying the same message. That’s the headline on the NHS IC’s press release, which goes on (erroneously) to quote Tim Straughan, Chief Executive of the centre, as saying: “Today’s report shows the number of people admitted to hospital each year for alcohol-related problems had tapped 1 million for the first time”.
Wrong. Why? It is the number of admissions that has topped 1 million, not the number of people. Some people are bound to have been admitted more than once, possibly repeatedly, so the number of people must be less than the number of admissions, and possibly less than a million. I bet nobody spots this mistake.
However, it’s a minor matter in the broader context. How is it that almost all the statistics related to alcohol can be moving in the right direction, yet the numbers of alcohol-related admissions keep going up at a dizzying rate?
It’s largely a function of methodology. Alcohol-related admissions are calculated in such a way that if you are unlucky enough, say, to be involved in a fire and admitted to hospital for the treatment of your burns, it will count as 0.38 of an alcohol-related admission – unless you happen to be under 15, when it won’t count at all.
If you drown, it counts as 0.34 of an alcohol-related admission – though most people unlucky enough to drown aren’t admitted to hospital. Getting chilled to the bone (accidental excessive cold) counts for 0.25 of an admission, intentional self-harm to 0.20 per cent of an admission.
These fractions apply whether or not there was any evidence you had been drinking before these disasters befell you.
Of course, much greater contributions to the total are made by conditions such as high blood pressure, which accounted for 383,900 admissions – more than a third of the total. Around a third of admissions for hypertensive diseases in men aged between 25 and 65 are attributed to alcohol, and around a fifth in women. There are far more of these admissions than there are for fires or accidents, so they contribute a huge proportion of the total.
Note that no account is taken of the amount these people actually drink. It is reasonable to suppose that only fairly heavy drinking could do enough damage to require an admission, but in calculating these figures the assumption is made that there is no threshold below which drinking is safe. So a third of all admissions for cardiac arrhythmias, for example, are attributed to drinking, even if the sufferer happens to be a teetotaller.
The result is paradoxical. Since the majority of people are moderate drinkers, the majority of alcohol-related admissions and deaths occur in moderate drinkers. The North West Public Health Observatory, which devised the method, reported that there were far more deaths from cancer of the oesophagus in women in the lowest alcohol category (156) than there were in the highest (23).
The paradox is this. “Safe” drinking limits (21 units a week for men, 14 for women) are promoted by the Government on the basis that if you stay within them, the chances of harm befalling you are small. Yet the alcohol-related admissions and deaths statistics include far more people who are modest drinkers than who are heavy drinkers. Am I alone in thinking there is something batty about this?
As for the increases in these admissions over recent years, the report says that the methodology, in use since 2009, “represents a substantial change in the way the impact of alcohol on hospital admissions was calculated before”. That doesn’t stop the press release making a direct comparison between the 2009 figure (1,057,000 admissions) and the 2002-03 figure (510,800).
Given the trends in alcohol consumption over that time, this abrupt a change can only be the result of a change in the method of calculation, not in the actual admissions. Not only have the diseases wholly attributable to alcohol changed, but many of the alcohol attributable fractions have, too. Year-by-year comparison is almost impossible.
But the story plays well to the current belief that alcohol is out of control. The report is bound to be widely covered tomorrow. Just don’t believe everything you read.
Chris Snowdon (not verified) wrote,
Thu, 26/05/2011 - 23:43
Great post. I expected some change in measurements to be responsible. This seems to happen every year now. What I didn't realise was this:
"if you are unlucky enough, say, to be involved in a fire and admitted to hospital for the treatment of your burns, it will count as 0.38 of an alcohol-related admission"
Are you saying that it is assumed that 38% of fires are alcohol related and so the total admissions figures are simply divided up based on estimates?
Rich (not verified) wrote,
Fri, 27/05/2011 - 09:03
Is the same methodology used for tobacco use? If not why not?
Jonathan Bagley (not verified) wrote,
Fri, 27/05/2011 - 13:39
We know fairly precisely, from excise and census statistics, what is the average yearly consumption of pure alcohol per over 16. This report's use of survey data (using questionnaires) may give more insight into who drinks how much, but for average consumption, is surely less accurate.
Alcohol Concern
http://www.alcoholconcern.org.uk/assets/files/Publications/Off%20Measure...
appears to use the figures in page 5 of this document from the Institute of Alcohol Studies
http://www.ias.org.uk/resources/factsheets/consumption-uk.pdf
As AC will not be accused of underestimating consumption, I'll use these figures. The report states that admissions have doubled to one million, from half a million in 2002. Going by the IAS figures, consumption peaked in 2003-04 and has been falling since, yet admissions have been steadily rising. This would rule out an instantaneous effect of consumption on admissions. The alternative is a lagged effect. For a rough calculation, look at the average for the 10 years prior to both 2002 and now. It looks to have risen by about 10%. The doubling of admissions between these dates is therefore due to something other than increased alcohol consumption. Taking into account increased abstinence (by implication, to maintain the average, increased binge drinking) as Alcohol Concern does, or an enormous increase in serious problem drinkers, cannot explain a doubling of admissions.
Andy Sutherland, Head of Profession for Statistics, NHS IC (not verified) wrote,
Fri, 27/05/2011 - 15:14
On behalf of the NHS Information Centre, I’d like to confirm that the figures in the press notice for alcohol related admissions in 2009/10 (1,057,000) and 2002/03 (510,800) are both calculated using the methodology introduced in 2009. They (and the remaining figures) in Table 4.1 of the report are comparable and show a large increase, subject to the various points of detail in the footnotes to that table.
However, we acknowledge that the Chief Executive’s quote referred erroneously to ‘people admitted to hospital’ rather than ‘admissions to hospital’. I apologise for this error; a corrected press notice is now online. The remainder of the press notice, including the title, used the correct terminology.
Our report aims to bring together and highlight figures on alcohol to raise awareness and facilitate debate. It is interesting to read your comments on the methodology; you may like to contribute to a consultation exercise we are currently running (which closes on 24 June) which invites comments on both content of and methodology used in this and our other compendium publications. See
http://www.ic.nhs.uk/work-with-us/consultations/lifestyles-statistics-co...
Andy Sutherland
Head of Profession for Statistics
NHS Information Centre for health and social care.
Anonymous (not verified) wrote,
Fri, 27/05/2011 - 16:54
As a methodology for tracking change over time, ARHAs are fundamentally flawed, because the fractions used to calculate them remains consistant.
Take for example "accidental exessive cold" mentioned above - every hospital admission for this reason counts for 0.25 of an alcohol-related admission.
So if there are 1000 admissions over the course of the year, 250 will be counted as alcohol-related.
Let's assume this is initally accurate, but that year-on-year the *actual* number of ARHAs for accidental excessive cold halves, going down to 125. Assuming everything else remains the same, the total number of admissions for excessive cold would be 875. 25% of that number is 219 - so the ARHA statistic would grossly over estimate the actual number of alcohol related admissions.
On the flip side, any change (up or down) in the number of admissions due to accidental excessive cold for reasons other than alcohol (accounting for 75% of admissions) will be reflected in change in the ARHA figures. For any condition where the majority of admissions can be attributed to some reason other than alcohol, the ARHAs will be more sensitive to change for reasons which aren't related to alcohol at all. Let's imagine admissions for alcohol-related accidental excessive cold stay constant at 250 but admissions for other reasons halve. Our total number of admissions is now 625 (250 alcohol related admissions and 375 non-alcohol related). However the fraction remains constant, so the ARHA statistic would now be grossly under estimated, assuming just 156 ARHAs.
Admittedly there's no easy alternative method for calculating ARHAs, but it's a terrible tool for looking at trends.
Anonymous (not verified) wrote,
Fri, 27/05/2011 - 19:03
There is a bizarre trend these days to hype numbers when they are actually coming down. If the above article's data is correct and declines can be detected why are we not congratulating ourselves ? This strange trend was first seen, I suggest, in the Blair years when he rightly announce that dometic violence was fallling year-on-year (and by more than the odd 2% or 3%), yet the clamour was of a rising tide and an impending disaster about to overwhelm us !
SadButMadLad (not verified) wrote,
Sat, 28/05/2011 - 22:03
"Yet the alcohol-related admissions and deaths statistics include far more people who are modest drinkers than who are heavy drinkers. Am I alone in thinking there is something batty about this?"
Modest drinkers will not be used to be drunk and will do stupid things that lead to accidents. Heavy drinkers will be used to being drunk. They will also be interested in drinking than larking about doing stupid things.
Junican (not verified) wrote,
Tue, 31/05/2011 - 23:06
Oh Dear! And we simpletons thought all along that hospital staff actually counted alcohol related admissions! How stupid of us!
So we have not only the confounding factor of the fraction system and the factor as described by anon 16:54, but we also have another confounding factor - the lack of information on how much alcohol had been consumed. But even allowing for these confounding factors, an increase in admissions of almost double between 2002/3 and 2009, at a time when alcohol consumption has been apparently falling, makes no sense (in terms of that much derided quality known as 'common sense'). Something must have gone wrong with the methodology, regardless of what Mr Sutherland says.
What can have gone wrong? I know nothing, and therefore should not comment, but is it possible that applying the 'method' retrospectively to 2002/3 (and years since) could have resulted in comparing 'apples and pears'? Hindsight is a dangerous thing, if one wants to be accurate.
Perhaps Mr Sutherland would explain to us how 'common sense' is flawed as regards this matter.
boozwatch (not verified) wrote,
Wed, 01/06/2011 - 13:55
General Statistics are very hard to collect accurately of course, but the NHS method seems reasonably sound given the circs. The argument that averaging out admissions eg: 'a third of all admissions for cardiac arrhythmias, for example, are attributed to drinking, even if the sufferer happens to be a teetotaller' is picky. The two-thirds who are admitted for this will of course include the teetotallers - only a 100% rating would necessarily fail to cover the irrelevant cases.
Are the NHS intending though to change the threshold % for each type of case if the known contribution of alcohol changes? Otherwise as previous posteer says, year on year stats may not be so helpful.
In the blue corner, used by the Portman group to question the NHS stats, is the ONS survey of alcohol consumption in the general population which claims a fall, but also has a 'new' methodology open to challenge. - see Gargle Nation for a discussion of the possible weaknesses in this methodolgy, including evidence of greater strength of drinks and under measurement of glass size. Bev, Editor, Gargle Nation http://www.garglenation.com/2011/05/mcwilliams-promotes-cider-and-obama-...
Chris Taylor (not verified) wrote,
Thu, 23/06/2011 - 13:18
"Total consumption rose slightly, from an average of 1,149 ml per person per week to 1,190 ml per person..."
Surely this can't be right. If it means 1149 ml, then that's 115 units a week. If it's 1.149 ml, then that's 0.15 units per week.
Is it per year? That would be two and a bit units per week doesn't make sense, since 25% of people consuming more than 21 units would make the average more than 4 per week even if the rest were teetotal.