Blog

Don’t Jump at Shadows

By David Kidd, BPR

Radio surveys remain one of the most influential tools in Australian media, shaping advertising spend, programming decisions and public perceptions of audience success. Yet one of the most misunderstood aspects of survey data is the margin of error: the statistical reality that small movements in ratings may not reflect meaningful changes in listening behaviour at all.

Sydney provides a strong example of why recognising margin of error matters, particularly in the context of audience data produced by GfK. Each survey is based on a sample of listeners rather than the entire population. While GfK’s methodology is exceptionally rigorous and widely respected, every sample contains a degree of statistical uncertainty. That is the same with every market research study anywhere in the world.

With a survey sample of approximately 2,500 people, the margin of error at a 95% confidence level is roughly ±1.2 percentage points. This means that if a Sydney radio station records a 10% audience share, the true audience could realistically sit somewhere between about 8.8% and 11.2%.

I consistently see articles written by journalists saying “Station A had an increase of 0.3%” which is technically incorrect.

In practical, statistical terms, the audience may have remained largely unchanged.

But decision makers often do not take this important piece of information into the strategy meeting!

Treating every movement as a major trend risks overstating both success and decline.

Advertisers, broadcasters and media commentators therefore need to focus less on isolated surveys and more on long-term trends. Consistent movement across multiple surveys is generally far more meaningful than a single result. Analysts also look beyond headline share figures to cumulative audience, time spent listening and demographic performance to gain a clearer picture of station health.

Recognising the margin of error encourages a more disciplined and statistically informed interpretation of media data. In a city as large and diverse as Sydney, understanding what the numbers can… and cannot…confidently say is essential for making sound decisions in the radio industry.Top of Form