Skip to content

Seeing Measurement Frameworks from New Perspectives

It’s fair to say that management frameworks are often challenged and centered around disparate media product offerings to define how and where they’re going. There are those who are going to focus on traditional media, while others are more focused on digital media. So right from the start, there are disparate answers.

Stringfield observes, “This in and of itself is a problem that has existed for 15, 20 years, and we haven’t even solved that part. So now that aperture is getting wider. And you’re adding what can only be described as a litany of new digital product offerings. Obviously, things are getting more complicated than simple. Despite the complexity of the media standpoint, let alone the fragmentation audience they’re in, our measurement methods are not evolving at all in terms of keeping up with that pace.”

Bianchi agrees. She points out, “We talked about traditional to digital, and now we have new media of the future that we haven’t even scratched the surface of. How are we measuring that? We’re in the world of media advertising, a lot of the access here is having measurements so that people who would like to connect with certain audiences can find them. It’s like having a map from the 1800s and trying to navigate to something that exists today. That’s really our issue, we’re sending people out without the tools to be able to find the right audiences. They’re not measured, so I can’t find them. I can’t place media or advertising with them. They don’t get advertising media, therefore, they can’t run a business. That cycle continues. We can see it happening, but we don’t have the right tools or map to do a better job.”

Including the Audience

Continuing the conversation around audience—are channels perhaps not inclusive or representative of the promised audience?

“We got hammered with the idea of how well we could represent our audiences with the advent of what was like social networks that had a lot of identity information,” Stringfield says. “Looking back to television measurement, we were looking at things that were essentially context proxies for the audiences that we want to reach. I’m going to place an ad against soap operas because I want to reach women who are going to watch it, who are probably buying the products in the home, and then again all the stereotypical things that are broiled in it. And then all of a sudden, the social networks were introduced. It’s not just that I want to reach women per se. I want women who live in the Midwest that drive a minivan that’s taupe not necessarily beige, should buy Oreos, but not the black and white ones, the yellow and white ones, and so on. We got so down this trail that we digital and general marketers perhaps fooled ourselves, like we nailed it. This is going to be the future. And then digital privacy legislation hits. We started with contextual understanding of the audience that may or may not have been accurate. And now we’re back to going to contextual understandings of audiences that may or may not be accurate.”

Bianchi adds, “We fooled ourselves with the amount of specificity we think that we can have. You know, the left-handed minivan owner that lives in this zip code that has two dogs and you keep doing that, and then your audience is three people. And it’s leaving out the ability to kind of discover on the back end. It’s now gotten so bespoke. And I think I’ve nailed it, but it cost me an arm and a leg to get that bespoke. And my reach is very small. You don’t want to be so niche that you’re not getting to enough people, and it’s actually not performing at a rate of return that makes sense. So it’s finding that place in the middle that you can to learn and discover. And then, guess what? They’re not watching soap operas. They’re watching late night or something else that I wasn’t expecting. And this is actually the way to convert, but I might not have ever seen it. If I come in with those blinders on, I’m going to go down this very prescriptive kind of old school path of the way that you build an audience.”

Can we change that outcome? And perhaps change the antiquated frameworks and carry the antiquated KPIs that we depend on now?

“Even very standardized tools like viewability and time on page, it’s all proxies for what people want at the end of the day, which is I want someone to transact with,” says Bianchi. “So if we’ve kept filtering along the way, we might have actually lost some of the people that actually can convert in the effort of converting. It’s how can we get to different kinds of metrics, and it might be something that’s more around engagement. That shows up in different ways than probably a click through rate or a dwell time or something else. Are we willing to get to different KPIs that might not live in regular reach and frequency and get ourselves comfortable with it. That’s a meaningful way to measure an engagement with an audience, that happens to be not one of our typical media metrics.”

The Ad Works, Sort Of

It was all kind of this framework of opportunity to see. But do we know if the consumer actually saw it? In other words, are the ads working or not?

Stringfield continues the conversation: “We’re getting pretty good about the extent to which that I’m pretty certain that this person or cohort of people saw this ad. But we stopped caring whether the ads work or not. And that’s the part that asks, did we have the right reach, did the message actually connect? That’s a much chunkier problem to address. But it does give me hope that when you look at ongoing dialogues of should we start looking at an attention-based framework? Again, that’s kind of up to the industry. What is the currency and then, importantly, how do we measure. On the one hand, I’m encouraged that there’s starting to be a little bit more momentum in that direction, but I can’t help but feel a little bit of trepidation that we’ve really started to go as deeply as possible in terms of just kind of verifying that someone might have seen a thing, but not whether or not there was any cognitive impact or change of behaviors. That’s actually what we’re trying to do.”

So attention metrics, great idea. It’s not new and kind of aiming towards that is great, but then that also is not the whole picture.

“Again, you look at viewability metrics, the time spent. These are all just ways to say I’m verifying you’re a human. Did you spend enough time to take any action. Now I’m going to take an action. Might have clicked something, looked at something, spent some time with it, downloaded something. Now we’re getting closer. Then did you actually convert by something, sign up for a service. Give me your name. This is just like a little crumb trail that we’re following down. Did you actually then make a relationship with me at the end of the day?” says Bianchi. “And I think we’re still using a lot of proxy metrics to get there. The problems are getting a little bit bigger as we get closer. But yes, I don’t think we’ve gotten there, unless you have a really just wonderfully articulate sort of ROI system that closes a loop on sales. And maybe for Amazon, it works great but I think for a lot of others, it’s very indirect and this is where it’s really tough.”

See the full video to dive into more on the topic of measurement frameworks. Our panel explores a case study on Twitch that featured female gamers, inclusivity, different metrics of success, engagement, effective media and more.

Contributors

  • Seth Adler

    Seth Adler heads up All Things Insights & All Things Innovation. He has spent his career bringing people together around content. He has a dynamic background producing events, podcasts, video, and the written word.

  • Matt Kramer

    Matthew Kramer is the Digital Editor for All Things Insights & All Things Innovation. He has over 20 years of experience working in publishing and media companies, on a variety of business-to-business publications, websites and trade shows.

Related Content

Powering Subscriber Acquisition

The streaming business is a fluid, changing landscape. To gain some insights into the category, All Things Insights’ Seth Adler spoke with Beau Decker…

 
 

More Related Content

boxing glove punching
streaming

Powering Subscriber Acquisition

The streaming business is a fluid, changing landscape. To gain some insights into the category, All Things Insights’ Seth Adler spoke with Beau Decker…

metaverse, woman with virtual reality headset
media insights

Developing Immersive Content Opportunities

All Things Insights’ Seth Adler had the opportunity to chat with Shenaika Davis, Customer Insights Content Producer at Meta, at the recent Media Insig…

playing the Jenga block game
media measurement

Building a Marketing Mix Framework

Suraj Rajdev, Head of Analytics at Google, sat down with All Things Insights’ Seth Adler to discuss his session at the Media Insights & Engagement Con…

interior design on mobile phone
consumer trends

Focusing On an Augmented Reality Strategy

Augmented Reality is here. But are consumers and advertisers embracing it with open arms? Aarti Bhaskaran, Global Head of Ad Research & Insights at Sn…

Gold bars
quantifying content

Determining the Value of Business Content

Michael Bagalman, Vice President, Business Intelligence and Data Science, STARZ, gave a presentation at the Media Insights & Engagement Conference, ca…

media insights

Connecting with Generation Alpha

At the recent Media Insights & Engagement Conference, Seth Adler had a chance to chat with Alexander Cammy, Manager, Insights & Cultural Intelligence…

artificial intelligence

Exploring User Community Perceptions of AI

Max Wartel, Director of Consumer Insights, Fandom, held an AI-related session at TMRE, which focused on the perceptions of AI in a user-generated comm…

media insights

Getting Social to Measure User Engagement

Social media is changing in sometimes complex ways as featured content generated by users in a private capacity has often been supplemented and perhap…

sports betting

Betting on Sports Consumer Engagement

In assessing the rise of sports streaming and betting, opportunities have come to light that might not have been considered five years ago. Content st…

marketing insights

Piecing Together the Attribution Puzzle

During the “Beyond Media Measurement” session of the Road to TMRE Gathering, Seth Adler discussed “Attribution” with guests Doug Healy, Senior Directo…

media measurement

Unlocking Blockchain for the Enterprise System

During the “Beyond Media Measurement” session of the Road to TMRE Gathering, Seth Adler discussed “Building Trust In The Media Ecosystem: What We’ve L…

media insights

Taking New Approaches to Attention Metrics

All Things Insights recently held the Road to TMRE virtual Gathering, featuring three days packed with informative presentations to get insights profe…

metaverse

Winning the Future of Fandom

All Things Insights’ Seth Adler recently connected with Christina Speck, former VP Corp. Strategy, Blue Cross & Blue Shield of Rhode Island, at this y…

consumer

Zeroing in on DIY Research

All Things Insights’ Seth Adler recently connected with Bill Trovinger, Consumer Insights Dir., Pharmacy & Health, Albertson’s Companies. Adler and Tr…

retail

Building Insights for the Home Consumer

All Things Insights’ Seth Adler recently caught up with Daniella Tsoncheva, Director Consumer Insights, The Home Depot. The retail market over the las…

actionable insights

Elusive Insights

Insights are being generated but in some cases are not being used. The first assumption is that these insights aren’t actionable. Which of course migh…

user engagement

Attention Metrics: User Engagement

All Things Insights’ Seth Adler caught up with Aarti Bhaskaran, Global Head of Ad Research & Insights, Snap Inc., at the Media Insights & Engagement C…

media insights

A Changing Consumer Shapes Media Evolution

All Things Insights’ Seth Adler caught up with Edwin Wong, SVP Insights & Innovation, Vox Media, at the Media Insights & Engagement Conference earlier…

media insights

Redefining the Home Experience

All Things Insights’ Seth Adler caught up with David Schliecker, Group VP, HGTV Insights and Strategy, Warner Bros. Discovery, at the Media Insights &…

television audience measurement

Measuring OTA Programming

Television audience measurement is on the precipice of innovation due to the opportunity to leverage data from set top boxes, smart TV’s, and other so…

consumer insights

Fan Insights

Thanks to the advent of social media and streaming services, the world of television today looks nothing like it did a few decades ago. All industries…

media insights

Live Sports Insights

Programming across the board is looking to develop content that appeals to an audience that engages increasingly with user-generated content (UGC) and…

media insights

Content Marketing Insights

In the past decade, SVOD (Subscription Video-On-Demand) companies have revolutionized how we consume our favorite shows and discover new ones. As medi…

media insights

Media Behavioral Insights

Analytical minds will always benefit from more complete data from farther-reaching sources. Even more fundamentally, Pepe says the questions everyone…

media insights

Media Industry Insights

It’s not unreasonable to feel overwhelmed when faced with the size and scope of the continuous shifts in the television industry within the past few d…

media insights

Media Insights Report

The All Things Insights Media Insights community completed an extensive survey covering what folks are thinking, how they’re spending and the issues t…

media insights

2023 Outlook

Known uncertainty. We enter 2023 with some of the most known uncertainty of our lives. Going into 2019- certainty. Going into 2020- certainty-albeit m…

media insights

Media Past Is Media Prologue

“Whatever the modern technology of the day, it was a force for disruption, it was a force for change, and it was a force for enchantment, joy, and lea…

media insights

Representative Insights

A great story starts with a single word. From there, the story is subject to its characters, plots, and the conflict presented by the content, all of…

media insights

Super Insights

Talking with Peter Leimbach, Senior Vice President, Ad Sales Research at FOX Sports, it’s clear that pro football teams aren’t the only ones competing…

streaming services

Streaming Insights

As 2022 continues, Chris Whitely, Senior Director of Product Management at Comcast, says that the big subscription-based streaming services have seen…

insights

20 Quotes On Risk, Truth, Wealth And More

Dan Runcie, Founder, Trapital sat down with Percy ‘Master P’ Miller at the most recent TMRE. The discussion focused on how Miller’s background provide…

media insights

Measurement, Currency and Attribution

Keeping pace with innovation is always a challenge. The Media industry not only has to keep pace with that innovation, many players have offerings tha…

business insights

A Contemporary Insights Organization

We are in the process of experiencing the second paradigm shift of human behavior in just a three year period. For a prepared organization, this is a…