User guide8 min
Measure the impact of your fixes
Once a site is connected to Google Search Console, PixyScan puts its search traffic next to its scans. You see clicks on the Overview, your deploys and scans on the search trend, and clicks beside every page. For each issue a production scan fixed or introduced, you also see how those pages did in Google search afterwards, compared with the rest of the site. It starts at Basic.
Before you start#
Search impact builds on two things you may already have.
- Tier
- Basic or above. Search impact comes with Search Console from Basic up. Free and Hobby show a locked card instead.
- Search Console
- Connected, with the site's property chosen and the current data-use terms agreed. Results use Web search data only.
- Production scans
- Fixes are read from scans of your production branch, whether you press Scan now, a schedule runs or your pipeline starts one.
- Deploys
- Deploy markers and the traffic-drop alert need scans from your CI/CD pipeline, which is included from Basic up.
Not connected yet? Follow Connect Google Search Console first. Everything on this page fills in from the data that connection syncs.
Search impact needs the current consent. If PixyScan's data-use terms for Search Console change, everything on this page pauses for the site, the traffic-drop alert included, until the person who connected it presses Confirm and resume, or another admin reconnects. If the data-use terms change explains it. Nothing is deleted while it waits.
Search traffic on the Overview#
A Search traffic card sits on the site's Overview, below the six area cards.
| Field | Shows | What it does |
|---|---|---|
| Clicks | Total | Clicks from Google search to the site, with the change against the previous 28 days. |
| Impressions | Total | How often the site appeared in Google results, with its change. |
| Click-through rate | Percent | Clicks divided by impressions. Its change is shown in percentage points. |
| Average position | Rank | The site's average position in results. A lower number is better. |
| Clicks per day | Sparkline | A small chart of daily clicks across the 28 days. |
| Data through | Date | The last day Google has reported. The latest two to three days are provisional and can still change. |
A link on the card opens Search performance, where the full figures are. If the site is not connected, admins see a Connect Search Console card in its place.
On the workspace overview, each connected site's card also shows Clicks (28d) with its change, so you can see which site's traffic moved without opening it.
Deploys and scans on the trend#
The Search performance trend marks the days your production scans ran, so you can line up a change in clicks with what happened on the site.
- 1
Open Search performance
Choose Search performance in the Explore group of the site sidebar. Markers sit on the clicks and impressions trend.
- 2
Pick All scans or Deploys only
The filter above the trend shows every production scan, or only the scans your pipeline started after a deploy.
- 3
Open a marker
It shows the kind of scan, its branch, how the health score changed, and how many issues were fixed and how many are new. For a deploy, View commit opens the commit in your Git host.
app.pixyscan.com/w/…/s/…/search
Screenshot · not captured yet
The Search performance trend with dashed markers on the days production scans ran, one opened to show a deploy's short commit SHA, its branch, the score change and the issues fixed and new.
| Field | Marker | What it does |
|---|---|---|
| Deploy | Deploy a1b2c3d · v2.4.0 | A scan your CI/CD pipeline started after a deploy. It shows the commit's short SHA, a link to the commit and a release label when your pipeline provides them. |
| Manual scan | Manual scan | A scan someone started with Scan now. |
| Scheduled scan | Scheduled scan | A scan a schedule ran. It is marked only when it changed something: the score moved, or issues were fixed or appeared. |
Commit details come from your CI automatically
Clicks beside your pages and issues#
Two tables gain a Clicks and an Impressions column once Search impact is on: the Pages table and the affected pages of each issue.
Each figure is the page's Web search clicks or impressions over the last 28 days of data. Press a column's heading to sort by it, so the pages with the most traffic come first. A page Google has no data for shows a dash and sorts last.
Pages are matched to Google's data by address. A note above the table says how many were matched, for example Search Console data matched 812 of 940 pages. Small differences such as www, http or a trailing slash still match. Redirects are not followed, so a page Google knows only by an old address is not matched.
On the Pages table, the Bytes column starts hidden when the traffic columns are shown. Turn it back on from the column menu.
The Impact tab#
Impact lists every fix and regression your production scans recorded, and how the changed pages did in Google search afterwards.
After each production scan, PixyScan compares it with the previous full production scan of the same branch. Every check that stopped failing on some pages is a fix, and every check that started failing on some pages is a regression. Each one becomes a row here.
- 1
Open the Impact tab
On Search performance, choose Impact next to Queries and Pages.
- 2
Filter the list
Show all changes, fixes only or regressions only, and pick a status. Press the date or Lift vs rest of site heading to sort. The weekly charts of your health score and clicks sit above the list.
- 3
Read a row
Each row names the check, says whether it was fixed or appeared, and shows the date, how many of its pages have Search Console data, its status, and clicks before and after.
- 4
Open a row for the page breakdown
It lists the changed pages with their clicks and impressions before and after, the pages with the most clicks first.
app.pixyscan.com/w/…/s/…/search?tab=impact
Screenshot · not captured yet
The Impact tab: weekly health score and clicks charts on one time axis, then a list of fixes and regressions, each with its check name, date, matched pages, a status badge and the result against the rest of the site.
How a result is measured#
Each change is measured over fixed windows around the day of the scan that found it.
| Field | Length | What it does |
|---|---|---|
| Before | 28 days | The 28 days up to the day before the scan. |
| Gap | 7 days | A week for Google to recrawl the changed pages. Nothing in it is counted. |
| After | 28 days | The 28 days that start a week after the scan. |
| Early signal | From day 14 | A first result once half of the after window has data. |
PixyScan compares clicks to the changed pages before and after, and does the same for the rest of the site over the same days. The result says how much better or worse the changed pages did than the rest of the site. It reads, for example: After this change, these pages did 15% better than the rest of the site.
Comparing with the rest of the site takes out what happened everywhere at once, such as a season or a Google update. If the changed pages lost 10% of their clicks while the rest of the site lost 30%, the changed pages did 29% better.
The windows are the same on every tier. Until the after window is complete, before and after figures are shown per day so they compare like with like. Once a result is Ready, it does not change.
A result shows what happened after a change, not why
What each status means#
A result moves from Measuring to Early signal to Ready. Some changes cannot be measured at all.
| Field | Badge | What it does |
|---|---|---|
| Measuring | Measuring · ready on 14 Oct | The after window has not reached 14 days of data yet. The date is when the result should be ready, allowing for Google's usual delay. |
| Early signal | Early signal · 17 of 28 days | At least 14 days of the after window have data. The result is provisional and can still change. |
| Ready | Ready | All 28 days are in. The result is final. |
| Not enough data | Not enough data | The change cannot be measured. The reason is shown under the check's name. |
| Field | Reason | What it does |
|---|---|---|
| Too few pages | Under 3 | Fewer than 3 of the changed pages have Search Console data. |
| Too few impressions | Under 100 | The changed pages had under 100 impressions in the 28 days before. |
| History too short | Your tier | The search history your tier keeps does not reach 28 days before the change. PixyScan names a tier with longer history. |
| Connection interrupted | Paused | Search Console was paused or reconnected during the measurement. |
| Nothing to compare | No rest of site | The changed pages are almost all of the site's search traffic, so there is nothing left to compare them with. |
Results on other screens#
The same results appear in three more places.
| Field | Where | What it does |
|---|---|---|
| Search impact panel | Changes | The fixes and regressions of the scan you are looking at, with their status and result, and a link to the full list on the Impact tab. |
| Your recent fixes | Overview | Up to three Ready fixes whose pages did best against the rest of the site. It appears only when at least one fix did better. |
| Health score and clicks by week | Overview · Impact | Two charts on one time axis: your health score from the last full production scan of each week, and Google clicks for each whole week, with the scan markers on both. |
The weekly charts let you look at the two lines side by side. They do not work out how one affects the other, and they need at least two weeks that have both a score and clicks.
When clicks drop after a deploy#
PixyScan watches Google clicks in the days after each production deploy and tells you if they fell sharply.
It compares clicks in the 3 days after the deploy with the same 3 days of the week over the previous 4 weeks. It alerts only when all three of these are true:
| Field | Threshold | What it does |
|---|---|---|
| The drop is large | 25% or more | Clicks fell by at least a quarter against the previous 4 weeks. |
| There is enough traffic | 100 clicks | Those days normally get at least 100 clicks, so a few lost clicks on a quiet site do not count. |
| It is unusual | Beyond normal | The drop is bigger than the site's normal week-to-week variation. |
Google's newest days are provisional for two to three days, so the alert is decided about a week after the deploy (day 6 at the earliest). Several deploys on the same day share one check, and each deploy day alerts at most once.
The alert appears in the bell and on Site alerts, and opens Search performance at the deploy's marker. It is also emailed to the site's members and workspace admins, and sent to the Slack and generic webhooks when they are set. The message reads, for example: Clicks fell 32% in the 3 days after deploy a1b2c3d (branch main), compared with the same days of the previous 4 weeks.
If the site's Search Console data is later deleted, for example because Search Console was disconnected, alerts already sent stay in Site alerts but lose their click figures. Emails, Slack messages and webhook calls already delivered are not changed.
Turn off the email, keep the alert
Does something here not match what you see in the app? Tell us