{"id":2979,"date":"2021-05-27T12:11:40","date_gmt":"2021-05-27T02:11:40","guid":{"rendered":"http:\/\/www.bprworld.com\/?p=2979"},"modified":"2021-05-27T13:05:02","modified_gmt":"2021-05-27T03:05:02","slug":"the-recall-based-vs-observed-behaviour-debate-2","status":"publish","type":"post","link":"http:\/\/bprworld.com\/de\/news\/the-recall-based-vs-observed-behaviour-debate-2\/","title":{"rendered":"The Recall Based vs Observed Behaviour Debate – Part 2"},"content":{"rendered":"

By Wayne Clouten, BPR<\/em><\/p>\n

\"\"<\/p>\n

Second Part of a Two-Part Series<\/p>\n

In the first part of this article<\/a> about recall vs observed behaviour research we looked at the critical importance of recall-based research in the measurement of the emotional transaction a listener has with a radio station.\u00a0 In this second part we will look at some of the other issues to consider as well as application ideas for observed behaviour data.<\/p>\n

The most fundamental principle of research is knowing who it is you are researching and basing your assumptions on.\u00a0 In recall-based research you start using a stratified sample approach which ensures that you a getting a representative sample of your intended target market, while observed behaviour from a digital stream generally provides a view of your station users only.\u00a0 With digital stream data you are effectively looking \u201cinside the box\u201d and you can certainly assume that they represent part of your cume and if they listen for an extended or reoccurring basis are likely part of you P1\u2019s however outside of that you have to be careful what you assume.<\/p>\n

In terms of accurately measuring listening behaviour the argument has two dimensions.\u00a0 The argument against recall-based research is whether the respondents recalled behaviour is how they actually behaved. If you operate in a market where the official survey is a recall-based methodology, then the argument against using recall-based research is largely irrelevant. In markets where radio listening is predominately digital, and the official survey is a personal people meter then observed behaviour analytics from your audio stream may have better application.<\/p>\n

Observed behaviour data sourced from your audio stream also has interpretive issues unless you can apply some demographic context to the information.\u00a0 If you are only dealing with observed behaviour data without demographic context then is user ID 013245 a 18-24 male or a 25-39 female?\u00a0 In countries where digital consumption remains a small part of overall radio listening, basing strategic decisions on digital analytics is likely a waste of time at best or even potentially dangerous.\u00a0 A stations digital listener can often be inconveniently different in demographic and behavioural profile from your analog listeners depending on your format.\u00a0 To draw any meaningful strategic conclusions from observed behaviour data it is critical to know who your digital listeners are.<\/p>\n

Leaving aside issues of sample integrity, observed behaviour data is terrific at profiling usage patterns of your radio station by your digital users<\/u>. The only caution is treading carefully on what you assume is behind people leaving or joining your digital stream.\u00a0 In BPR\u2019s broader all audio studies where we see the entire listening landscape people often leave a digital device\/source and move to an analog device\/source such as when they leave home and jump in the car.\u00a0 Assuming that they \u201cleft\u201d your radio station as measured by your digital data is wrong, all they did was simply continue listening to your station in the car on FM.\u00a0 Equally just because someone comes into you radio station on your digital stream at 9am doesn\u2019t mean they started listening to your radio station at that time.<\/p>\n

A good application for observed behaviour data is trending the performance of specific content such as a benchmark or show.\u00a0 If you have a new show between, say 3pm and 4pm and you start to see your digital audience retention building during that time, then it is a safe bet that your new show is working.\u00a0 Equally if the reverse happens then the new show is possibly a fail.<\/p>\n

Observed behaviour data is also a good way to link between your strategic sample-based studies and monitor if what you decided to do is working.\u00a0 It is not a perfect solution, but it will be cheaper and at least provide you with broad behavioural feedback from your digital users.<\/p>\n

Another advantage of observed behaviour data is that the sample size is usually relatively large, the measurement is continuous, and you can review the data pretty much in real time whereas recall based research involves a much longer project timetable and needs to be planned ahead of time.<\/p>\n

In any event you will have some form of observed behaviour data at your fingertips, generally data on your music streams.\u00a0 From this you should be able to gain some sense of your stations overall listening momentum.\u00a0 This is great to have but beware it has limitations in terms of strategic insight.\u00a0 Observe it over time and look for the bigger picture trends.\u00a0 Observed behaviour analytics can assist in telling you what is happening, whereas recall (sample based) research tells you why it happened.<\/p>\n

The major problem with recall-based research are those people and organisations still using and defending old methodologies and questionnaire tactics.\u00a0 21st<\/sup> century recall based research using digital platforms and visual intuitive response interfaces have changed the game.\u00a0 Sample based research is now much more about actively engaged respondents reacting in real time rather than people being badgered on the telephone for 30 minutes while they try to cook dinner.<\/p>\n

 <\/p>\n

Whether you belong to the Observed Behaviour Tribe, the Recall-Based Tribe or my tribe, the Whatever Works Best Tribe it doesn\u2019t really matter, just keep your mind focussed on what you are trying to achieve with your research and choose tools and services that best suit what it is you are trying to understand, discover or manage.<\/p>\n

For me observed behaviour data is best utilised in assessing the overall performance of specific content elements against your digital users, presuming you can view the data as a trend over time.\u00a0 In terms of anything strategic such as identifying your stations strengths, weaknesses, opportunities and threats, designing new radio formats and determining the \u201cwhy\u201d of listening behaviour and brand attributes, recall based research wins hands down<\/p>\n

A little while after this article is published, I am going to receive a lot of statistics from BPR\u2019s Research and Social Media Coordinator about this article. These observed behaviour statistics will include such things as how many people opened it, how many page views it had, who shared it, length of time reading it, where they live, how it performed against other articles and what operating system you used but the only thing that really matters at the end of the day is who remembers what I wrote a few weeks or months from now.<\/p>\n

 <\/p>\n

Want to continue the conversation?<\/p>\n

 <\/p>\n

Wayne.clouten@bprworld.com<\/a><\/p>\n

 <\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

By Wayne Clouten, BPR Second Part of a Two-Part Series In the first part of […]<\/p>\n","protected":false},"author":3,"featured_media":2984,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2979","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorised"],"acf":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/bprworld.com\/wp-content\/uploads\/2021\/05\/pexels-startup-stock-photos-212286-scaled.jpg?fit=2560%2C1707","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/posts\/2979","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/comments?post=2979"}],"version-history":[{"count":4,"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/posts\/2979\/revisions"}],"predecessor-version":[{"id":2998,"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/posts\/2979\/revisions\/2998"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/media\/2984"}],"wp:attachment":[{"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/media?parent=2979"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/categories?post=2979"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bprworld.com\/de\/wp-json\/wp\/v2\/tags?post=2979"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}