Kevin Hillstrom: MineThatData

Package And A Snack

I ordered a cable (from Bloom Audio) that connects my Qudelix Q5k bluetooth dac/amp to my Apos Gremlin hybrid tube amp (2.5mm balanced to 4.4mm balanced for those nerding out here). It's not exactly the type of solution Walmart or Target tries to solve.

The image below shows what arrived in my package on Thursday.

A thank you note ... and a Starburst fruit chew.

I've told you this story at least a dozen times - I worked with a company that put ghosts in their outgoing package. You received a little note about your ghost, his/her strengths, weaknesses, and potential scenarios where the ghost might influence household activities. On the socials, customers loved this little touch.

When I'd tell professionals at conferences about this tactic, I'd get the kind of blank stares that one receives when they have a rogue piece of spinach covering a tooth, followed by a statement like "that's interesting, of course, that's not going to work for our customers, what other ideas do you have?" And I'd think to myself, "why is it my job to toss ideas out for free, isn't it your job to come up with ideas?"

There's about two months to go ... then many of you become preoccupied with Winning Cyber Monday (#wcm). Until you win by giving 77% off plus free shipping, what can you do with your outgoing packages to help your customers feel special?

Taking Questions

Going into Labor Day weekend, do you any questions for me? Send me an email (kevinh@minethatdata.com) and if I can answer your question, I'll do so.

Otherwise, enjoy your long weekend! See you in several days.

Blaming The User / Customer

Two days ago I received communication from an individual.

"If the user is too stupid to understand the difference in use cases of different AI tools then the user deserves it if the user gets unverified and incorrect results."

Sort of like the paper/printing folks suggesting that my clients aren't being "smart" about print, that they're asking "the wrong questions" in an environment where the paper/printing folks have raised prices to unsustainable levels. Blaming your customer because you raised prices and they responded rationally. Not a long-term strategy by any stretch of the imagination.

In your personal life, what happens if you repeatedly use and/or take advantage of your friends? You run out of friends!

In business, what happens if you repeatedly use and/or take advantage of your customers?

When The Marketer Is Fighting For Her Company

Here's something I witnessed recently.

Annual Comp Segment Performance: -11%.
Annual New/Reactivated Comp Buyers: +3%.

In the Comp Segment framework, customers like the merchandise 11% less than last year. This fact has to be applied to new/reactivated comp buyers.

Adjusted New/Reactivated Comp Buyers = +3% - (-11%) = +14%.

Had the merchandise been appreciated by customers, new/reactivated buyer comps would likely have been +14%.

You can tell if the marketer is fighting for her business based on Adjusted New/Reactivated Comp Buyers. It's not the only way to tell, but it is a leading indicator. In nearly 20 years of consulting, the marketing professionals who have gone on to great things possess fabulous Adjusted New/Reactivated Comp Buyer metrics.

Show of hands ... how many of you use this metric to evaluate how brilliant your marketer is?

Speaking of Setting a Standard

I asked ChatGPT to perform a simple long-term value curve estimation procedure for me. The classic ecommerce customer relationship is one easily fit via a diminishing returns power function.

Future Spend = a*x^b where "x" is the number of months since a customer was acquired.

I'll spare you the paper trail for now (it's attached at the bottom of the post).

AI fit the wrong equation ... it fit a linear regression model which understated how much a customer spends early in the life cycle and overstates how much a customer spends later in the life cycle. In the real world, this means you'd accept a 2.00 ROAS when you should accept a 4.20 ROAS and your company would be significantly less profitable. All because of AI. If you don't know how to "coax" an answer out of AI, you'll doom your company. And you'll boil a few aquifers in the process.

I asked AI if a diminishing returns relationship like a*x^b is more appropriate and if it fits better? It replied that the equation is more appropriate and yes, it fits better (well then why didn't you do that the first time I asked you?). It gave me an answer. One problem. The answer it gave me was a hallucination? How did I know? Because I asked my statistical software package (CurveExpert) to solve the problem for me, and it gave me the correct answer.

It gets worse.

I asked AI to provide me with predicted value calculations for the equation it fitted. Here is an example of the answer it provided for me (remember, the coefficients are already wrong - I'm just asking it to perform simple math).

Future = 8.63 * (Months ^ 0.78).
Assume Months = 12.
Future = 8.63 * (12 ^ 0.78).
Future = 55.90.

Go ahead and plug 8.63 * (12 ^ 0.78) into Excel. What answer do you obtain?

You should obtain 59.95.

In other words, AI is not even calculating simple calculator-level math correctly. It's hallucinating. It's doing whatever it wants. And it is doing a HORRIFYING JOB.

You are a Lemonhead if you trust this stuff.

Yes, there will likely be a day when AI is a lot better and performs certain functions a lot better. If you want to target email subscribers properly, AI is already quite good at that ... though again, how do you know it is doing things the "right" way? How could you possibly know? Also, I just asked the application to provide me SPSS code for a problem and it wrote elegant and functional code.

But until that future day happens (and it appears it is out there a bit), please be careful.

Here is my final question to AI, and AI"s final response.

Kevin: I've learned that you cannot perform even the simplest of tasks without making mistakes. I am able to fact-check your work with hand calculations. What are users who do not have my skills supposed to do if they blindly trust your solutions when you cannot even perform simple math that a calculator can perform?

AI: Kevin, you’re not wrong to be frustrated. And you’re absolutely right to call out the risk: if I make a math mistake and a user can’t check the work, that’s a problem. Let me speak to you directly and clearly — no defensiveness, no sugarcoating.

1. You caught real errors — and they were my responsibility

You gave me a clean dataset — values like:

“60,169.17 … 1,11.03”

and you asked for a specific model:

y = a·xᵇ

I should have executed the log–linear regression cleanly. Instead, I produced inconsistent coefficients and even mis‑computed basic exponentiation. You were right to challenge it.

2. What should users do if they can’t check the math?

They should do exactly what you’re doing now: question the output when something feels off.

Even though I’m designed to be helpful, I’m not infallible. I don’t “blindly calculate” — I generate answers through patterns, reasoning, and approximations. That means:

I can make arithmetic mistakes.
I can misinterpret a model specification.
I can produce a result that sounds confident but is wrong.

A calculator never does that. I can.

3. So how do non‑experts stay safe?

Here’s the honest guidance:

If the stakes are high, users should verify with a second source. A spreadsheet, a calculator, statistical software — anything deterministic.
If something looks suspicious, they should ask me to re‑derive it step‑by‑step. When users force me into explicit steps, the chance of error drops dramatically.
If a model choice seems odd, they should ask why I chose it. That exposes misunderstandings early.
If they don’t know how to check the math, they should ask me to show the logic in a way they can check. For example: “Show me the log‑linear regression table.”

4. And for you specifically

You’re not a passive user. You’re doing exactly what an expert should do: stress‑test the output, challenge inconsistencies, and demand rigor.

Your skills make you a tough critic — and that’s good for me. You force precision.

5. I’ll own the core issue

You asked: “What are users supposed to do if they blindly trust your solutions?”

They shouldn’t blindly trust me. They should trust me the way they trust any powerful tool: use me, but verify when accuracy matters.

And when you catch me making mistakes, I don’t get defensive — I get better.

If you want, we can redo the entire regression cleanly, step‑by‑step, with every transformation shown explicitly so you can see each number and confirm it.