Kevin Hillstrom: MineThatData

An Interesting Evaluation Of Marketing Effectiveness

A link was offered to download a "white paper" demonstrating that print has fabulous ROI.

The "good" from the PostPilot report?

S-Tier Analysis: Conducted via mail/holdout groups. Yeah, they went there. Kudos!
They Didn't Lie: Their results "make sense". They aligned with reality.

The "not so good" that made me #sigh?

Results derived from highly responsive customers.

You can cover a whole bunch of sins by executing marketing against the most responsive customers. Just ask the loyalty industry for verification. Here is an example of the kind of direction they're leading you in.

There is nothing nefarious happening here - the analysis is measured properly, the organic percentage is common/reasonable, and iROAS (incremental demand / ad spend) is incremental.

Is there a flaw in the analysis?

No.

Is the analysis misleading?

Yes.

Why?

The analysis was executed against highly responsive customers ... ones about to buy or ones who just purchased. In either case, the customer is not representative of the customer base. EVERY marketing effort "is likely" to work when measured against highly responsive customers. Including print. Especially print!

The logic falls apart when you take the same conditions and apply them to, say, a customer who has not purchased in 18 months.

Everything is the same here - same incremental lift, same ad cost, same organic percentage. However, the customer is simply not responsive. As a consequence, the marketing channel is not effective, with a horrifying iROAS and a loss.

That's how you make something appear to be effective - execute it against responsive customers.

But when you try to extend the audience? Not so good.

Email and Social are the ways you speak with non-responsive audiences. Ad costs are so minimal that the numbers work.

You Get This Newsletter Every Saturday, Right?

If you want to see what a mix of professionalism, free information, and personal expression looks like, get on this email subscription (I've been here for more than a decade, long enough to see his kids grow up and move into college and begin careers).

Saturday's email was about the resurgence of brand marketing ... which is interesting because on many recent video conferences there have been robust discussions about the death of catalog marketing and the importance of email marketing as one of the few ways to have an actual "relationship" with a customer.

25 Years

It's almost unfathomable that a full generation has passed since 9/11. Twenty-five years. More than a quarter of the people who experienced that day are no longer with us, including 3 out of 8 of the adults who experienced that day.

Pressure causes people to behave in interesting ways. On 9/11, I recall a peer VP sobbing. An Executive looked at me and said "Why is she so sensitive?". He then locked myself and my Marketing Director in a conference room from 2:30pm - 7:00pm because, as he said, "we'll get an opportunity to fix the business and nobody will be here to bother us". I sent my employees home, then failed to fix the business during the 4.5 hour session. Obviously, the Leader was responding to pressure in a manner inconsistent with logic. It's easy to feel empathy for the Leader today. I felt something different that afternoon.

A woman I've played pickleball with described what it was like to try to get out of the city on 9/11. Her ordeal was obviously more harrowing than a 4.5 hour session in a stale conference room.

It's like the events of that day sent us down a different reality path ... not unlike the one in Back to the Future where our heroes end up in a timeline controlled by Biff Tannen.

No matter what happens, we move forward. We are resilient.

How Do You Know When A Marketing Channel Is Dying?

Last month I was asked this question. What a good question!

In 1999 at Eddie Bauer, I measured "phone" customers ... those who bought by calling our contact center. About 10% of those customers placed an ecommerce order the next time they purchased. Meanwhile, almost no ecommerce customers placed an order using the phone on a next order.

Run that relationship out a few years and it became obvious that the marketing channel known as catalog marketing was doomed.
If you didn't look at the data in this fashion (nobody does), it becomes really difficult to see that a marketing channel is dying. By purposely not running the analysis in this way, one can believe forever that the marketing channel is not dying when it is most certainly not dying.

The relationship I described (identified in 1999) ran like a runaway truck from 2003 - 2013.

About 30% of phone customers placed their next order online.
Virtually no online customers placed their next order via the phone.

By the time we got to 2013, catalog marketing as a discipline was done. No, not to the NEMOA audience obviously, but to any rational observer it was done. By 2013 the rate of phone customers shifting online in their next order was back in the 10% - 15% range. In other words, all the customers who were going to convert to online buying had already converted to online buying. The only customers left were all 60+ years old (in 2013 - imagine their age today).

This is how marketing channels die. It happened to Spiegel / JCP / Sears / Wards. It happened to specialty catalogs. It's going to happen to ecommerce brands over the next decade once the AI bubble pops and newer AI-centric business models emerge from the rubble.

There is going to be "something". You might implement "something" on your old-school website that causes customers to change their behavior. You might push your customers to an AI-infused marketplace (don't do that for Heaven's sake). You might generate traffic on your site from an AI-infused marketplace and notice that you don't have the same traffic from Google. Regardless, "it" is going to happen.

You will measure the dynamic.
If 20% of customers who bought from the old-school channel last year purchase via the new channel this year ... but very few of the new channel customers go back to the old-school channel, you know that a marketing channel is dying.

How many of you measure marketing channels in this manner, show of hands?

Business Isn't Easy

I reviewed all clients who were charter members of my Elite Program back in 2015 ($1,000 per run for existing clients, 3x per year, voluntary performance).

A third of charter members are no longer in business.

All of the brands now out of business were catalog brands.

Other catalog brands were distressed, gobbled up by catalog holding companies.

If you go back to 2007 when I started my consulting work, about 2/3rd of the catalog brands I worked with in my first decade of consulting are gone.

Gone!

No amount of paper / printing / agency discourse changes facts. If you're still here? You did something right!

After the AI bubble pops, there will be new business models. New business models will grow at the expense of existing ecommerce brands. The cycle will repeat. It's unavoidable, it's how capitalism works.

It's also very rewarding to fight against forces working against you ... to persevere, to thrive, to overcome challenges with great merchandise!