Data pitfalls

Expert: with sources and numbers. Plain: the same, without them, for beginners.

"Unique versus total counting, aggregation, latency, thresholds, opt-in: failures that make a number wrong yet look right."

Verified 2026-09-18 · 38 days ago both analytics method

None of these make a chart look broken. They make it look fine and mean something else.

Unique versus total

A Apple’s impressions and product page views are counted in unique devices; downloads are totals. (Metric definitions, verified 2026-09-18)

So the conversion rate divides a total by a unique count, and can in principle exceed what an intuitive funnel would allow. It is not a percentage of people who converted.

Uniqueness is also per period. A device unique in a day is counted again in the next day. Summing seven daily unique figures does not give the weekly unique figure. It gives a larger number that means nothing. Always take the platform’s own figure for the period you want.

Aggregation hides opposite movements

A single national figure is an average over markets, devices and source types that may be moving in opposite directions. A flat total can be a strong gain in one market cancelling a collapse in another.

A Apple splits by five source types. App Store Browse, App Store Search, App Referrers, Web Referrers, App Clips. A Play splits into Google Play search, Google Play explore, ads and referrals (Understand and grow your app’s user base, verified 2026-09-18).

Break down before concluding. Search and browse respond to completely different levers, and a change in one is routinely read as a change in the other.

Reporting thresholds

A Apple requires at least five first-time downloads or pre-orders before App Store metrics appear, and five active devices before usage metrics do. (Metric definitions)

A Play groups low-volume search terms into an “Other” bucket, and custom store listing performance requires sufficient visitor volume to report (Understand and grow your app’s user base).

Absence of data is not evidence of absence. A custom page or a small market showing nothing may be below a threshold. These look identical to failure and are not the same thing (60-05).

Opt-in samples

A Apple’s usage data is based on users who opt in to share their analytics data. Same source.

Sessions, active devices and crashes are therefore samples of unknown composition. Trends within them are usable; absolute levels are not, and comparisons to anyone else’s numbers are meaningless.

Acquisition metrics are not described as opt-in. Keep the two families apart in your head and in your reports.

Latency

Both consoles publish with a delay, and both restate. A number read the morning after is provisional. Deciding on same-day data is the most common cause of a reversal a week later.

Wait for the data to settle before acting, and note the read date on anything you circulate.

Release-shaped confounds

A Phased release for automatic updates is adjustable within a 7-day window (Required, localizable and editable properties, verified 2026-09-18).

During a phased rollout the population receiving the new version is growing, so any metric split by version is measuring a moving denominator. Metadata changes go live at release, but the user base does not switch at once.

Also: on iOS, indexed text changes ship with a release (10-09), so a keyword change and a binary change land together and are confounded by construction.

Definitions that changed underneath you

A Play moved store listing performance from acquisitions to clicks in July 2026 (Understand and grow your app’s user base).

The reports still existed, the charts still rendered, and every comparison across the boundary silently became wrong. This is the most dangerous class of pitfall, and the reason every claim here carries the date it was last checked.

What goes wrong

Summing daily uniques. Produces a number with no meaning.

Concluding from a national total. Averages hide opposite movements.

Reading an empty report as poor performance. It may be below a threshold.

Quoting opt-in usage figures as absolutes.

Acting on same-day data. It is provisional.

Comparing across a definition change. Nothing looks wrong.

In short

Every fact on this page in one line, with its evidence tier, source and verification date, 6 A. Generated from the claim register, so it cannot drift from the page above.

A Apple defines Impressions (Unique Devices) as the number of unique devices that have viewed your app on the Today, Games, Apps and Search tabs of the App Store, and states that it includes unique product page views.
IOS-AN-001 · verified 2026-09-18
A Apple defines Product Page Views (Unique Devices) as the number of unique devices that have viewed your App Store product page, including when apps use StoreKit to load the page.
IOS-AN-002 · verified 2026-09-18
A Apple defines a Session as the app being used for at least two seconds, and Active Devices as devices with at least one session in the period. Usage data is based on App Store users who opt in to share their analytics data.
IOS-AN-005 · verified 2026-09-18
A App Store metrics require at least five first-time downloads or pre-orders before they appear; downloads metrics require five first-time downloads; usage metrics require five active devices in the selected range. Sources are counted when a customer follows a link to the product page, across five source types: App Store Browse, App Store Search, App Referrers, Web Referrers and App Clips.
IOS-AN-006 · verified 2026-09-18
A Phased release for automatic updates can be adjusted within a 7-day window.
IOS-VER-004 · verified 2026-09-19
A Play Console reports the search terms users searched before navigating to a store listing, split across Google Play search, Google Play explore, ads and referrals, and all traffic sources. Terms without enough visitors to report individually are grouped into an 'Other' bucket.
PLAY-ACQ-001 · verified 2026-09-18

Think your app deserves better?

Send the App Store link.
The audit comes back within two working days, whether you hire us or not.

Free, and we mean it. No card, no call required.