{"id":115,"date":"2007-07-30T21:04:48","date_gmt":"2007-07-30T20:04:48","guid":{"rendered":"https:\/\/brennigjones.com\/blog\/?p=115"},"modified":"2012-05-05T10:06:30","modified_gmt":"2012-05-05T09:06:30","slug":"misunderstanding-statistics-the-bbc-way%e2%80%a6","status":"publish","type":"post","link":"https:\/\/brennigjones.com\/blog\/?p=115","title":{"rendered":"Misunderstanding statistics the BBC way"},"content":{"rendered":"

We’re screwed.<\/p>\n

The battle between the continual advance of technology and mankind’s equally continual ability to misunderstand data continues.<\/p>\n

But the latter edges ahead in the domination table.<\/p>\n

We fail to appreciate the complexity of questions we ask.<\/p>\n

We fail to comprehend the responses.<\/p>\n

Yet we\u00a0continue to\u00a0construct flawed questionnaires.<\/p>\n

And misrepresent the findings.<\/p>\n

This story<\/a> on the BBC website emphasises just how doomed to a world of misunderstanding we are.<\/p>\n

The headline is:
\nMany Asians do not feel British<\/strong>.<\/p>\n

Straight away my brain\u00a0wants to know whether these Asians were born in Britain or not (i.e. it is possible to come from another country and live in the UK without giving up one’s nationality).<\/p>\n

So that’s a black mark to the BBC straight away – for a badly constructed tabloid headline.<\/p>\n

As we read\u00a0the story we are told ‘38% of UK residents of south Asian origin felt only slightly or not at all British<\/em>.’<\/p>\n

So now the story has narrowed, has transformed to\u00a0become ‘UK residents of south Asian origin’ and not\u00a0the wider meaning of the description:\u00a0‘Asians’?<\/p>\n

Surely this a different meaning entirely?<\/p>\n

A second black mark to the BBC then – this time for misrepresenting their poll.<\/p>\n

But as I ponder this misrepresentation I can’t help wondering how many ‘UK residents of English<\/em> origin’ would term themselves British?<\/p>\n

Or Welsh origin?<\/p>\n

Or Scottish origin?<\/p>\n

Or Irish?<\/p>\n

But the BBC survey doesn’t give us any comparative data.<\/p>\n

So that’s another (third) black mark to the BBC – failing to provide comparative data.<\/p>\n

Beginning\u00a0to feel wary of the BBC’s reporting of what is, after all, their own survey (and against my better judgement)\u00a0I click on the link and download the survey results.<\/p>\n

The survey questioned 500 people of (south<\/em>) Asian background (but the survey authors don’t tell us what the specific criteria is that determines being ‘of (south<\/em>) Asian background’).<\/p>\n

Or ‘of\u00a0Asian background’ in general.<\/p>\n

That’s another (fourth) black mark to the BBC – lack of transparency of the sampling criteria.<\/p>\n

Anyway.<\/p>\n

The survey.<\/p>\n

Don’t click on the link in the news item.<\/p>\n

Don’t do a statistical analysis\u00a0of the BBC’s own survey data.<\/p>\n

No really.<\/p>\n

Don’t.<\/p>\n

Because you’ll find that the BBC’s own survey data is wrong.<\/p>\n

I could give you examples (I was nerdy enough to break down the percentage of responses and number of respondents to Table 7 then sum the returns to try to get back to the quoted sample of 500. I bet you a\u00a0large Pimms that if you did that you wouldn’t get back\u00a0to the 500 that you should!).<\/p>\n

No, seriously.<\/p>\n

Don’t.<\/p>\n

Because it proves the survey is wrong.<\/p>\n

And while you’re not<\/strike> recompiling the survey responses please don’t ask yourself what about the other<\/em> British subjects of other Asian nationalities (e.g. there are more British subjects of Chinese extraction than of Indian, Pakistani and Bangladeshi combined.\u00a0 And what about our cousins from Malaysia?).<\/p>\n

So then a quick flick forward to Table 8:
\nQ.8 Generally speaking, to what extent do you think that white British people treat you as British?<\/em><\/p>\n

Hmm\u20ac\u00a6<\/p>\n

But the BBC news item reported the wording to this question as:
\n‘… nearly half believed white people do not treat them as British.’<\/em><\/p>\n

So whereas the question asked ‘white British’<\/em>, the BBC have reported it as ‘white’<\/em>.<\/p>\n

So some distortion there.<\/p>\n

Another black mark to the BBC.<\/p>\n

How many is that?<\/p>\n

I can’t remember.<\/p>\n

I’m starting to lose the will to live.<\/p>\n

Crack on.<\/p>\n

Getting tired of the BBC’s manipulation I fast forward to Table 11:<\/p>\n

Table 11
\nQ.11 Do you think, as an Asian, that you have more opportunities, the same number of opportunities, or fewer opportunities in the UK compared to the opportunities you would have in South Asia?<\/em><\/p>\n

What does ‘opportunities’ mean?<\/p>\n

Opportunities to do what?<\/p>\n

Own a BMW?<\/p>\n

Get divorced?<\/p>\n

Stand for election?<\/p>\n

Opportunities for women to become a member of the clergy?<\/p>\n

Is this a cultural<\/em> question?<\/p>\n

A financial<\/em> question?<\/p>\n

A political<\/em> question?<\/p>\n

Or – best of all – an equal opportunities question?<\/p>\n

For surely, these questions and their responses must be weighted to males, females, gays, lesbians, able-bodied and disabled to have a tangible value?<\/p>\n

Yes?<\/p>\n

Sigh.<\/p>\n

Look, I know that the BBC is our national broadcaster but there’s something very wrong here.<\/p>\n

That the BBC commissioned this survey is one thing.<\/p>\n

Laudable perhaps, but flawed because the parameters can not have been adequately set at the point of\u00a0specification.<\/p>\n

That the survey output is so badly flawed it is risible, this\u00a0is another thing entirely.<\/p>\n

That no-one in the BBC has comprehended the magnitude of the wrongness of the survey is inexcusable.<\/p>\n

That the BBC news department has published this survey\u00a0is just plain stupidly wrong.<\/p>\n

Yes, I know I’m probably the man who put ‘anal’ into\u00a0‘analytical’ but come on.<\/p>\n

As a piece of statistical work this really isn’t good enough.<\/p>\n

Is it?<\/p>\n

Look!<\/p>\n

I’ve found someone else who feels similarly.<\/p>\n

Chlo\u00c3\u00a9<\/font><\/a> says:<\/p>\n

I’d like these kids to realize that maths and statistics (and science in general) are not only about calculations, but also about properly asking the right question, cleanly checking that conditions are verified before applying formulas, and drawing conclusions from the numerical results they obtain.<\/p>\n

Which is the reason why they are asked about analysis, interpretations and other horrible things that require to actually write this highly suspicious things called, oh, yes, I remember now, words.<\/p>\n

And by that I don’t mean tossing words together in a grammatically dubious sentence, hoping that nobody will notice that the beginning contradicts the end – and both of them contradict the middle -, nor that they don’t have the faintest idea what the difference between hypothesis<\/span>, condition,<\/span> proof,<\/span> example<\/span> and conclusion<\/span> is.<\/p><\/blockquote>\n

See?<\/p>\n

It’s not just me!<\/p>\n

B<\/em><\/strong>.<\/p>\n","protected":false},"excerpt":{"rendered":"

We’re screwed. The battle between the continual advance of technology and mankind’s equally continual ability to misunderstand data continues. But the latter edges ahead in<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-115","post","type-post","status-publish","format-standard","hentry","category-stuff","two-columns"],"_links":{"self":[{"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/115","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=115"}],"version-history":[{"count":0,"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/115\/revisions"}],"wp:attachment":[{"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=115"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=115"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/brennigjones.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=115"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}