Books, writers, words, and competencies

I have always believed that any good, competent and credible writer can be judged (if judge people we must, and yet we do) by the books on his or her desk. Yes, books: printed hardcopy, paper and ink. I’ll go into why books are vastly superior to online sources a bit later (although I suspect my readers already know why…). Although I am no … (more)

What’s wrong with local media?

“It’s about trust. Our relationship with our readers is built on transparency, honesty and integrity.” So opens the front-page piece in this weekend’s Connection, titled in all-caps, “Local News Needs Support ‘Now More Than Ever’”. It echoes the theme of”now more than ever” written for National Newspaper Week, Oct. 1-7. And some of it is eerily similar to what Bob Cox wrote about journalism … (more)

Politically correct pronoun madness

Muddle-headed editorial palaver

There’s a muddle-headed editorial in this weekend’s Collingwood Connection titled “Citizens, not rich developers should drive political ship” (sic*) that shows (again) how little the chain’s editorial writers understand municipal politics and the laws that govern it. It opens: Money talks and, in the case of municipal elections, one could argue that all of those cheques, banknotes and e-transfers going toward funding the war chests of … (more)

Sloppy Reporting and Secret Agendas

One really doesn’t actually expect sterling journalism, good, investigative reporting or excellent editing from a community newspaper, but we do expect factual accuracy. And we expect reporters and editors to do at least the basics of their jobs. Some parallel stories in the local papers show just how inaccurate – and sloppy – local reporting and editing can be. And how this is letting … (more)

Social Media, Public Opinion, and Jian Ghomeshi

[youtube=https://www.youtube.com/watch?v=b1XGPvbWn0A] I doubt anyone in North America is unaware of the furor surrounding CBC’s recent firing of radio show Q’s host, Jian Ghomeshi last week.* In case you were on the moon when it happened, you can read some of the many stories on the Star and other news sites (just Google it…). It’s a complex story; about the seesaw between workers’ and employers’ rights; about … (more)

No Data Are Better Than Bad Data

Avoid bias
The full name of an article I read today is, “The Fallacy of Online Surveys: No Data Are Better Than Bad Data.” It’s from 2010 and very good. You can find it on the Responsive Management website. It makes some key points about the invalidity of online surveys:

  • For a study to be unbiased, every member of the population under study must have an equal chance of participating.
  • When online surveys are accessible to anyone who visits a website, the researcher has no control over sample selection. These self-selected opinion polls result in a sample of people who decide to take the survey — not a sample of scientifically selected respondents who represent the larger population.
  • Non-response bias in online surveys is complicated by the most egregious form of self-selection. People who respond to a request to complete an online survey are likely to be more interested in or enthusiastic about the topic and therefore more willing to complete the survey, which biases the results.
  • Unless specific technical steps are taken with the survey to prevent it, people who have a vested interest in survey results can complete an online survey multiple times and urge others to complete the survey in order to influence the results.
  • Because of the inability to control who has access to online surveys, there is no way to verify who responds to them — who they are, their demographic background, their location, and so on.

I’ve said this all before. The article concludes:

As a result of these problems, obtaining representative, unbiased, scientifically valid results from online surveys is not possible at this time, except in the case of the closed population surveys, such as with employee surveys, described earlier. This is because, from the outset, there is no such thing as a complete and valid sample — some people are systematically excluded, which is the very definition of bias. In addition, there is no control over who completes the survey or how many times they complete the survey. These biases increase in a stepwise manner, starting out with the basic issue of excluding those without Internet access, then non-response bias, then stakeholder bias, then unverified respondents. As each of these becomes an issue, the data become farther and farther removed from being representative of the population as a whole.

There’s also a good slide show on internet surveys here that goes over the basics presented in the article above. A 2008 paper addressed just issue with online surveys: self-selection. The author, Jelke Bethlehem, wrote:

…web surveys are a fast, cheap and attractive means of collecting large amounts of data. Not surprisingly, many survey organisations have implemented such surveys. However, the question is whether a web survey is also attractive from a quality point of view, because there are methodological problems. These problems are caused by using the Internet as a selection instrument for respondents.
This paper shows that the quality of web surveys may be seriously affected by these problems, making it difficult, if not impossible to make proper inference with respect to the target population of the survey. The two main causes of problems are under-coverage and self-selection.

The author concludes:

It was shown that self-selection can cause estimates of population characteristics to be biased. This seems to be similar to the effect of nonresponse in traditional probability sampling based surveys. However, it was shown that the bias in selfselection surveys can be substantially larger. Depending on the response rate in a web survey, the bias can in a worst case situation even be more than 13 times as large.

In other words: most online surveys are bunk. You might also recall I wrote about online surveys in past posts. I won’t repeat what I said then, but here are the links to those posts:

Our gawker culture

Suddenly the Net lit up with headlines news: celebrity nude photos leaked! Videos too! Facebook timelines were replete with media stories. Shock. Horror. Voyeurism. Click, click, click the viewers racked up the view count as they raced to the sites just in case they actually showed something. A little flesh to feed our insatiable desire to gawk. Meanwhile psychopaths in ISIS continue to harvest … (more)

Classical music matters even more today

The official launch of the new Classical FM 102.9 radio station in Collingwood this past weekend reminded me of my own past history with classical music, but also why it matters so much to have classical music in our lives. And why we need to keep that cultural lifeline to our musical past alive and active. Classical music binds us to our past, to our civilization … (more)

Back to Top