Blog Post

Lies, damned lies and statistics
Posted By Nick Barnes, 24/10/2014 10:30:50 AM

When conducting employee research, too often the numbers become the end game.  People become obsessed with how many people agreed with this or what proportion said that, rather than what the numbers mean and how they can be used to as a stepping stone to better understanding.

This is partly due to the emphasis researchers and statisticians put on simplifying statistics into easy-to-grasp numbers.  In doing so, we create metrics which succeed only in hiding the truth or the broader meaning behind the collective research findings.

Simple numbers are prone to manipulation, with organisations picking and choosing the statistics which will help them achieve their goal and ignoring those that don’t.  These simple, headline figures usually have consolidated totals sitting beneath them, with tallies and raw data from sample surveys further down in the process.  Most accept the headlines without digging down deeper into the numbers, where the meaning and driving patterns can often be found and explained.  And once one of these headline figures is put forward and shared, it then becomes gospel because the knowledge and / or information to challenge or refute it is unavailable.

I'm not suggesting that people apply 'creative license' to the figures; the intent of any manipulation is usually altruistic, because the people doing it are unable to understand these numbers due to the lack of exposure to the wider picture. 

And I'm not saying we shouldn't trust numbers or that statistics are largely invalid and we should rely on gut instinct.  What I am saying is that, to be reliable, objective and trustworthy, statistics need to be translated and presented, first and foremost, in a narrative. 

Numbers used holistically to construct and validate a compelling narrative of your findings will not only serve the purpose of engaging your audience, it will also avoid the construction of a finely tuned, numbers-based propaganda piece being submitted to the decision makers.

The art of developing this narrative is easier said than done, (hence the overuse of graphs and charts in most research results presentations) and requires skills which are finely tuned to interpreting data, extracting insight, and of course, communicating. 

 

For a light hearted, tongue-in-cheek look at the use / misuse of numbers to apply meaning, check out this TED Talk by Sebastian Wernicke.

 


Drop a comment
Twitter

20 September, 6pm - pop it in your diary! Our next IoIC Coventry and Warwickshire hub will be led by Adrienna May,… https://t.co/o6ImJRAc50

😳😳😳 Ms Dewi said the children's performance... was simply a show. He said it was clear the school did not intend to… https://t.co/lpn9eBd8Wx

RT @ConversationEDU: QUIZ: which of the following traits are associated with #IS “martyrs” + which with Australians recently killed in acti…

Maria in her dress :-) by Milan R https://t.co/pHbLAZhuWp https://t.co/Vf9tS8kgoE

RT @CSIS: The Islamic State still boasts as many as 26,000 fighters across multiple continents despite the group’s loss of territory. https…

RT @OSINTtechniques: https://t.co/F0YtdEoKil - global network of owned and operated live streaming webcams. Advanced search https://t.co/zr…

Get in touch!

Treble