Skip to content

Finding the Right Path to a Measurement Framework System

Indeed, the ability to measure meaningfully at all is challenging and, in terms of accuracy, may be too specific in individual cases, such as influencer campaigns, to translate back to a framework that makes results comparable or useful in developing initiatives aimed at other audiences.

The very speed at which media is evolving can mean that agencies are constantly chasing and trying to define the impact of new expressions if not varieties of media and trying to fix measurement on them either in narrow terms that make them non-comparable or by taking established metrics and applying them in ways that might not be deeply informative.

The Measurement Mix

The search for new measurement frameworks is ongoing. In a Harvard Business Review article, “A New Gold Standard for Digital Ad Measurement?” Julian Runge, a behavioral economist, data scientist and assistant marketing professor at Northeastern University, Harpreet Patter, part of the global marketing science team at Meta I, and Igor Skokan, part of the global marketing science team at Meta in London, note that the difficulty in measurement particularly across different media had revived the use of marketing mix models to generate more useful measurement frameworks.

Yet, the models don’t immediately translate into the current market. As such, the authors conducted field studies focusing on digital marketers to look at how they have been experimenting to develop modernized versions of such models. Among their determinations in moving forward is calibration is necessary including, in one example, launching experimental marketing campaigns in one market and looking at results in a comparable market where the campaign didn’t run, then compare the results to what the model suggests the outcome should be. At that point, a calibration can be made.

The effort is particularly important given changes in privacy rules. The combination of marketing mix models and experimental calibration could become standard procedure, the authors note, especially for measurement in data-constrained digital markets, providing a defined, reliable measurement framework until tools such as differential privacy and interoperable private attribution provide new capabilities.

Such an example of the effort being put into measurement frameworks underscores the point that creating effective means of applying numbers that accurately represent today’s marketing campaigns is very much a work in progress.

A Complicated Issue

In a “Road to TMRE” video chat with All Things Insights’ Seth Adler about “Measurement Frameworks,” Jonathan Stringfield, Vice President, Global Business Research & Marketing, Activision Blizzard, points out that the industry hasn’t been able to come up with a standard even after a couple of decades of trying and has been trailing the diffusion of media significantly. “Things are getting more complicated than simple,” he says.

In the video, Kerry Bianchi, Global CEO, APEX Exchange, says the lack of recognized frameworks is an ongoing problem and one that is even more complicated when trying to develop connections to specific designated audiences. The more certain of an audience, given how specific marketing demands can get today, the smaller it is likely to be and the more expense is necessary to define and find that audience.

Marketing as it developed was a mass enterprise, Stringfield points out. However, the increasing specificality of marketing initiatives means that either the audience is likely to be more diverse than the real target, so many messages will go to people who aren’t targeted, or the size of the audience will be limited and defeat the purpose of reaching as broad an audience as desired. In either case, however, determining the impact of the message on consumer behavior should be part of measurement, however it’s eventually framed, but that can’t be a solid consideration when no agreed pathway to simply reaching the right audience is available. An initiative can establish measurements within its own context, but that isn’t necessarily compatible with a typical media plan.

Program This

When it comes to programmatic and that approach to the market, different models produce unique results but eventually reconciliation is required, something similar to the calibration mentioned in the Harvard Business Review article. So, when it comes to multicultural marketing, for instance, applying standards can be specific to the model developed. Yet, some points of comparison have to be available for companies to make business decisions about commitments and investment.

In a “Road to TMRE” video chat on “Programmatic Progression,” with Adler, Jennifer Garcia, SVP, Strategy & Insights, Publicis Media, says the establishment of benchmarks can be one way to move forward for agencies. Although brands and media organizations may be employing programmatic as well, when it comes to agencies, benchmarks need setting so as to establish a broader framework that can be more comparable at least in a general sense so they at least create a common ground of consideration. Because no common standard or template exists, the use of benchmarks can provide an interim solution to meet immediate needs on the way to more unifying principles that allow more substantial definitions and comparisons.

Still, organizations already exist where ideas about topics such as multicultural marketing and how to develop better ways of solidifying ideas around approach and reconciliation are under consideration with the intention of establishing a more informed way of investing in and increasing the efficiency of initiatives.

Finding the Right Solution

Agencies need to develop an approach to measurement frameworks that includes clients but also service providers that might be using different models based on unique perspectives to help create a common ground on which discussion and the establishment of principles and benchmarks can begin. From the perspective of multicultural marketing, an understanding of how it fits and compares with other areas of consumer outreach. Population dynamics are making multicultural marketing more vital. As population diversity increases, that ability to compare and contrast the results of marketing initiatives becomes more important in that it can identify where efforts have been effective and direct further endeavors, so they have the best effects over time.

The Media Insights & Engagement Conference will be held January 23-25, 2024, in Miami, FL.

Video courtesy of Sprout Social

Related Content

Powering Subscriber Acquisition

The streaming business is a fluid, changing landscape. To gain some insights into the category, All Things Insights’ Seth Adler spoke with Beau Decker…


More Related Content

A surface of cubes with a variety of rising cubes, one stands out in a different color.
artificial intelligence

Leveraging AI in B2B Respondent Insights

In the B2B marketing landscape, artificial intelligence has shown great potential. It is becoming an essential and advantageous tool, a tool which no…

boxing glove punching
media insights

Powering Subscriber Acquisition

The streaming business is a fluid, changing landscape. To gain some insights into the category, All Things Insights’ Seth Adler spoke with Beau Decker…

metaverse, woman with virtual reality headset

Developing Immersive Content Opportunities

All Things Insights’ Seth Adler had the opportunity to chat with Shenaika Davis, Customer Insights Content Producer at Meta, at the recent Media Insig…

playing the Jenga block game
media insights

Building a Marketing Mix Framework

Suraj Rajdev, Head of Analytics at Google, sat down with All Things Insights’ Seth Adler to discuss his session at the Media Insights & Engagement Con…

interior design on mobile phone
augmented reality

Focusing On an Augmented Reality Strategy

Augmented Reality is here. But are consumers and advertisers embracing it with open arms? Aarti Bhaskaran, Global Head of Ad Research & Insights at Sn…

Gold bars
media insights

Determining the Value of Business Content

Michael Bagalman, Vice President, Business Intelligence and Data Science, STARZ, gave a presentation at the Media Insights & Engagement Conference, ca…

media insights

Connecting with Generation Alpha

At the recent Media Insights & Engagement Conference, Seth Adler had a chance to chat with Alexander Cammy, Manager, Insights & Cultural Intelligence…

data science

Turning Data into Market Intelligence

When surveying a new market opportunity, the company’s market intelligence efforts come into play. This valuable data helps determine market segmentat…

user generated community

Exploring User Community Perceptions of AI

Max Wartel, Director of Consumer Insights, Fandom, held an AI-related session at TMRE, which focused on the perceptions of AI in a user-generated comm…

media insights

Getting Social to Measure User Engagement

Social media is changing in sometimes complex ways as featured content generated by users in a private capacity has often been supplemented and perhap…


Betting on Sports Consumer Engagement

In assessing the rise of sports streaming and betting, opportunities have come to light that might not have been considered five years ago. Content st…

media insights

Piecing Together the Attribution Puzzle

During the “Beyond Media Measurement” session of the Road to TMRE Gathering, Seth Adler discussed “Attribution” with guests Doug Healy, Senior Directo…

media insights

Taking New Approaches to Attention Metrics

All Things Insights recently held the Road to TMRE virtual Gathering, featuring three days packed with informative presentations to get insights profe…


Winning the Future of Fandom

All Things Insights’ Seth Adler recently connected with Christina Speck, former VP Corp. Strategy, Blue Cross & Blue Shield of Rhode Island, at this y…


Zeroing in on DIY Research

All Things Insights’ Seth Adler recently connected with Bill Trovinger, Consumer Insights Dir., Pharmacy & Health, Albertson’s Companies. Adler and Tr…


Building Insights for the Home Consumer

All Things Insights’ Seth Adler recently caught up with Daniella Tsoncheva, Director Consumer Insights, The Home Depot. The retail market over the las…

actionable insights

Elusive Insights

Insights are being generated but in some cases are not being used. The first assumption is that these insights aren’t actionable. Which of course migh…

user engagement

Attention Metrics: User Engagement

All Things Insights’ Seth Adler caught up with Aarti Bhaskaran, Global Head of Ad Research & Insights, Snap Inc., at the Media Insights & Engagement C…

media insights

A Changing Consumer Shapes Media Evolution

All Things Insights’ Seth Adler caught up with Edwin Wong, SVP Insights & Innovation, Vox Media, at the Media Insights & Engagement Conference earlier…

media insights

Redefining the Home Experience

All Things Insights’ Seth Adler caught up with David Schliecker, Group VP, HGTV Insights and Strategy, Warner Bros. Discovery, at the Media Insights &…

television audience measurement

Measuring OTA Programming

Television audience measurement is on the precipice of innovation due to the opportunity to leverage data from set top boxes, smart TV’s, and other so…

consumer insights

Fan Insights

Thanks to the advent of social media and streaming services, the world of television today looks nothing like it did a few decades ago. All industries…

media insights

Live Sports Insights

Programming across the board is looking to develop content that appeals to an audience that engages increasingly with user-generated content (UGC) and…

media insights

Content Marketing Insights

In the past decade, SVOD (Subscription Video-On-Demand) companies have revolutionized how we consume our favorite shows and discover new ones. As medi…

media insights

Media Behavioral Insights

Analytical minds will always benefit from more complete data from farther-reaching sources. Even more fundamentally, Pepe says the questions everyone…

media insights

Media Industry Insights

It’s not unreasonable to feel overwhelmed when faced with the size and scope of the continuous shifts in the television industry within the past few d…

media insights

Media Insights Report

The All Things Insights Media Insights community completed an extensive survey covering what folks are thinking, how they’re spending and the issues t…

media insights

2023 Outlook

Known uncertainty. We enter 2023 with some of the most known uncertainty of our lives. Going into 2019- certainty. Going into 2020- certainty-albeit m…

media insights

Media Past Is Media Prologue

“Whatever the modern technology of the day, it was a force for disruption, it was a force for change, and it was a force for enchantment, joy, and lea…

media insights

Representative Insights

A great story starts with a single word. From there, the story is subject to its characters, plots, and the conflict presented by the content, all of…

media insights

Super Insights

Talking with Peter Leimbach, Senior Vice President, Ad Sales Research at FOX Sports, it’s clear that pro football teams aren’t the only ones competing…

streaming services

Streaming Insights

As 2022 continues, Chris Whitely, Senior Director of Product Management at Comcast, says that the big subscription-based streaming services have seen…


20 Quotes On Risk, Truth, Wealth And More

Dan Runcie, Founder, Trapital sat down with Percy ‘Master P’ Miller at the most recent TMRE. The discussion focused on how Miller’s background provide…

media insights

Measurement, Currency and Attribution

Keeping pace with innovation is always a challenge. The Media industry not only has to keep pace with that innovation, many players have offerings tha…

business insights

A Contemporary Insights Organization

We are in the process of experiencing the second paradigm shift of human behavior in just a three year period. For a prepared organization, this is a…