Welsh Language Board disowns a survey its chair extols
The Welsh Language Board has previous, as regular readers of this website know (Straight Statistics, passim). But its latest survey sets new standards.
The results appeared in various newspapers and blogs, including the BBC, the Western Mail and the Daily Post. On Click on Wales, The Institute of Welsh Affairs news analysis magazine, Meri Huws, Chair of the Welsh Language Board, rejoiced at the finding that people who don’t speak Welsh no longer see their monoglot status as a barrier to sending their children to Welsh-medium schools. Ms Huws found this “very encouraging”, as you would, in her place.
The trouble is that the results of the survey were never meant to be published by the WLB and the press release was not authorised for public use, or so say the WLB. Pity nobody told Ms Huws.
When you see the survey details, requested from the WLB by a Straight Statistics reader, you can see why. The survey was based on just 125 respondents, parents at Welsh medium schools throughout the country, and was carried out by a PR company, MGB PR, hired by the WLB to attract attention and increase visibility for two videos presenting messages WLB wanted to spread.
In its pitch for the contract, MGB said: “Surveys and reports provide the perfect news fodder for the press” – how true! – “and are excellent at generating extensive and authoritative coverage in the media” – how half true. Extensive, maybe, but not in this case authoritative.
Question 1 asked if the respondent was a Welsh speaker. To this, 65 per cent said no. The next question asked how often respondents used Welsh in everyday life – and 72 per cent said either every day, often or occasionally. So more people use Welsh than speak it.
Question 3 asked “Does the fact that you can’t speak Welsh affect assisting in your child’s education?” To this, 66 per cent said yes. But the press release proudly asserts that 66 per cent of parents who send their children to a Welsh medium school are not Welsh speakers themselves and do not view their inability to speak the language as a hindrance to their children’s education. That’s the opposite of what the survey found,
Question 7 asked what had been the main motivation to send your child to a Welsh medium school. Location, said 5 per cent; facilities, 6 per cent, better standards of teaching 21 per cent; desire for child to be able to speak Welsh, 97 per cent. Yes, that does add up to 129 per cent. That was because respondents were able to answer yes to more than one option.
The 125 respondents gave, between them, 160 answers. The desire to speak Welsh was included by 121 of them, so it represents 76 per cent of the responses given, not 97 per cent. You might argue that all but four of the respondents included a desire for their child to learn Welsh among their reasons for choosing the school, but it would be odd to send one’s child to a Welsh medium school if Welsh-speaking were not among the features desired.
Similar quibbles apply to question 11: What do you think is the single greatest benefit of being able to speak Welsh for your child? Multiple choices were again allowed, but the percentages were calculated as if it was a single-choice question. So 61 said greater employment prospects, which is interpreted as 49 per cent. Since there were 183 responses recorded, it is actually 33 per cent. And so on.
It’s easy to see why the WLB now says that this survey should not have been published. But it was, its results were extolled by the WLB chair, it was picked up by several other media outlets, and it was only removed from WLB’s website when my correspondent raised questions about it. Congratulations to him for digging the details out, and a tiny morsel of credit to WLB for coming clean, even if it took them a month.
Sir Robert Worcester (not verified) wrote,
Sat, 23/07/2011 - 08:30
Well done for exposing this silly survey. As founder of MORI, I've said for more than 40 years that survey research is a simple business, all that you have to do is ask the right sample, the right questions, and add up the figures correctly. The PR agency asked the wrong sample, the wrong questions, and they clearly did not have the nous to even add up the figures correctly. Clearly, the WLB wanted a poll on the cheap, and when they commissioned a PR company who advised that the media would use it, they must have known what they were getting.
Yes, congratulations to the correspondent who raised questions about it, and also for the contribution Nigel. Well done. Hope it gets picked up by the media in Wales!
Bob Worcester
Nic Dafis (not verified) wrote,
Sun, 24/07/2011 - 11:25
Question 1 asked if the respondent was a Welsh speaker. To this, 65 per cent said no. The next question asked how often respondents used Welsh in everyday life – and 72 per cent said either every day, often or occasionally. So more people use Welsh than speak it.
No, more people use Welsh than define themselves as Welsh speakers, presuming you're presenting the questions as they appeared on the survey.
I teach Welsh to adults, and have found that adult learners are, on the whole, unwilling to define themselves as "Welsh speakers", even when you ask them the question in Welsh, and they answer in Welsh. When I asked a small group of quite advanced students, none of whom would dream of using English in the classroom, how they were going to respond to the questions about the Welsh language on the census return, only 1 or 2 out of 6 students were intending to tick the box that said they could speak Welsh.
There's obviously all sorts of problems with the way this data was gathered and the "results" presented, but that particular example isn't necessarily as self-contradictory as it appears.
Anonymous (not verified) wrote,
Tue, 26/07/2011 - 17:34
You have a point Nic. Definitions are everything but the WLB has also done some excellent research in the "Use of Welsh 2004-2006" paper. In 2006 they found that 20.5% of over three years olds in Wales said that they spoke Welsh. Of that number 12% spoke Welsh fluently, 21% spoke "a fair amount" and 17% "only a little" whilst 4% spoke "A few Words".
So, in that survey, even people who spoke only a few words were willing to describe themselves as able to speak Welsh.
In the environment of parents of children at Welsh Medium schools I would suppose that only those fluent in Welsh would call themselves Welsh speakers. But look at what the WLB is trying to do in this case; they are trying to "sell" Welsh Medium education to the 78% or 79% of parents who have no Welsh whatsoever. In reality few of THIS group are selecting WM schools.
This is a completely dishonest poll, it goes beyond massaging figures to the realm of out and out lying.
Anonymous (not verified) wrote,
Wed, 31/08/2011 - 15:05
"So more people use Welsh than speak it."
You don't have to speak Welsh to use it, how about occaisionally reading Welsh
language place names and traffic signs.
Croeso i Gymru!