AI Adoption GuideMarketingReport
KPI auto-insights detection
Machine learning surfaces top week-over-week KPI changes and ranks them by business impact.
Marketing processResearchPlanCreateLaunchMeasureReport
By Don, DoneThat’s AI coach · updated
What KPI auto-insights detection does
KPI auto-insights detection is a reporting pattern that turns a wide set of marketing metrics into a short, ranked list of week-over-week changes. Instead of scanning every chart and table for movement, the model compares current values to the prior period, estimates how much each change matters to the business, and returns the top movements first.
The output is a prioritized review queue, not an automated decision. Ranking answers which changes deserve attention first. Analysts still decide which items to investigate, which to dismiss as noise, and which to escalate into a narrative, deck, or deeper root-cause review.
This pattern is most useful when the marketing stack produces more KPIs than a weekly review can reasonably cover: paid and organic channel metrics, funnel conversion rates, acquisition cost, pipeline contribution, retention or engagement signals, and campaign-level performance. The value is speed of triage. Analysts spend less time finding candidates and more time interpreting the ones that matter.
When this pattern fits marketing reporting
Use auto-ranked KPI insights when reporting cadence is fixed (typically weekly) and the question is consistent: what moved, and what should we look at first? It fits recurring performance reviews, leadership check-ins, and analyst handoffs where the same metric catalog is evaluated every period.
It is a weaker fit when the period is irregular, definitions keep changing, or the business cannot state how to weight impact across metrics. Without stable series and impact logic, ranking becomes arbitrary. In those cases, stabilize the metric catalog and weighting rules before relying on auto-insights.
The pattern also assumes that “top change” means top impact, not top percentage swing. A 40% move on a tiny volume metric can look dramatic while a 3% move on revenue or qualified pipeline can dominate the week. Impact ranking exists to correct that bias.
How ranking by business impact works
At a high level, the system needs three ingredients for each KPI in scope:
- A comparable time series (current period vs prior period, usually week-over-week).
- A change measure (absolute delta, relative delta, or both).
- An impact weight or scoring function that translates the change into business significance.
Impact scoring can combine magnitude, direction relative to goals, contribution to a parent KPI (for example, channel spend feeding CAC or pipeline), and confidence based on volume or volatility. Exact formulas vary by team. What matters operationally is that weights are explicit, versioned, and reviewed when definitions change.
The model then ranks candidates and surfaces a limited set, for example the top N positive and negative movers, or a single ordered list with direction and score. Presenting both the raw change and the impact score helps analysts see why an item rose in the queue.
Human-in-the-loop remains non-negotiable. The model proposes order; analysts accept, reject, or re-prioritize before any investigation or stakeholder story is treated as final. Treat rankings as hypotheses about attention, not as claims about causation.
Analyst workflow and human review
A practical weekly loop looks like this:
Ingest and score. Pull the approved KPI set for the period. Compute deltas against the prior week. Apply impact weights and produce a ranked list with supporting context (prior value, current value, delta, score, and related dimensions when available).
Triage. Analysts scan the ranked list first. For each high-ranked item they decide: investigate now, monitor, or dismiss. Dismissal reasons (seasonality, tracking change, known campaign launch, data delay) should be capturable so the same false positive is easier to filter next time.
Investigate selectively. Only promoted items move into deeper work: segment breakdowns, channel drill-downs, or root-cause explanation workflows. Ranking prevents every small swing from becoming a research project.
Publish with judgment. Insights that survive review can feed narrative reports or review decks. Unreviewed model output should not ship as the official story of the week.
This division of labor is the speed outcome. Detection and ranking compress the search phase. Analyst judgment protects quality. The page audience is the marketing analyst who owns that judgment call, not a system that closes the loop alone.
Inputs, empty states, and failure modes
Auto-insights should return empty output when required inputs are missing. Two hard stops matter most:
- Missing KPI time series. If the period comparison cannot be computed for a metric (no current value, no prior value, broken join, or incomplete history), that metric must not enter the ranked list. If the catalog cannot produce any valid series, the whole insight set should be empty rather than partial fiction.
- Missing impact weights. If the scoring function has no weight, contribution rule, or approved default for a metric, exclude it. If no metrics have usable weights, return empty output. Silent equal weighting often recreates the “biggest % move wins” problem the pattern is meant to avoid.
Other failure modes to handle explicitly:
- Definition drift. Renamed metrics, changed attribution windows, or mid-week tracking fixes create false movers. Prefer empty or flagged output over confident ranks when lineage indicates a break.
- Sparse volume. Low-volume KPIs can swing wildly. Down-rank or withhold until volume thresholds are met.
- Over-narrow tops. If the top list is always the same three vanity metrics, revisit weights; the model may be amplifying what leadership already stares at rather than what moved the business.
Document these empty and withheld cases in the UI or export so analysts know the system declined to rank, rather than assuming nothing changed.
Is this worth automating for you?
Whether this pays back depends on how much time it takes your team today. Most teams estimate that from memory, and the estimate is usually wrong in one direction or the other.
DoneThat reconstructs where the time actually went, with no timers to forget, so you can measure the baseline before committing to a project and check the gain afterward.
Measure the baseline first