Skip to content

Search PixyScan

Guide contents

User guide8 min

Measure the impact of your fixes

Once a site is connected to Google Search Console, PixyScan puts its search traffic next to its scans. You see clicks on the Overview, your deploys and scans on the search trend, and clicks beside every page. For each issue a production scan fixed or introduced, you also see how those pages did in Google search afterwards, compared with the rest of the site. It starts at Basic.

Before you start#

Search impact builds on two things you may already have.

Tier
Basic or above. Search impact comes with Search Console from Basic up. Free and Hobby show a locked card instead.
Search Console
Connected, with the site's property chosen and the current data-use terms agreed. Results use Web search data only.
Production scans
Fixes are read from scans of your production branch, whether you press Scan now, a schedule runs or your pipeline starts one.
Deploys
Deploy markers and the traffic-drop alert need scans from your CI/CD pipeline, which is included from Basic up.

Not connected yet? Follow Connect Google Search Console first. Everything on this page fills in from the data that connection syncs.

Search impact needs the current consent. If PixyScan's data-use terms for Search Console change, everything on this page pauses for the site, the traffic-drop alert included, until the person who connected it presses Confirm and resume, or another admin reconnects. If the data-use terms change explains it. Nothing is deleted while it waits.

Search traffic on the Overview#

A Search traffic card sits on the site's Overview, below the six area cards.

The card covers the last 28 days of Web search, compared with the 28 days before.
FieldShowsWhat it does
ClicksTotalClicks from Google search to the site, with the change against the previous 28 days.
ImpressionsTotalHow often the site appeared in Google results, with its change.
Click-through ratePercentClicks divided by impressions. Its change is shown in percentage points.
Average positionRankThe site's average position in results. A lower number is better.
Clicks per daySparklineA small chart of daily clicks across the 28 days.
Data throughDateThe last day Google has reported. The latest two to three days are provisional and can still change.

A link on the card opens Search performance, where the full figures are. If the site is not connected, admins see a Connect Search Console card in its place.

On the workspace overview, each connected site's card also shows Clicks (28d) with its change, so you can see which site's traffic moved without opening it.

Deploys and scans on the trend#

The Search performance trend marks the days your production scans ran, so you can line up a change in clicks with what happened on the site.

  1. 1

    Open Search performance

    Choose Search performance in the Explore group of the site sidebar. Markers sit on the clicks and impressions trend.

  2. 2

    Pick All scans or Deploys only

    The filter above the trend shows every production scan, or only the scans your pipeline started after a deploy.

  3. 3

    Open a marker

    It shows the kind of scan, its branch, how the health score changed, and how many issues were fixed and how many are new. For a deploy, View commit opens the commit in your Git host.

app.pixyscan.com/w/…/s/…/search

Each marker is a production scan. A deploy names the commit it scanned.
FieldMarkerWhat it does
DeployDeploy a1b2c3d · v2.4.0A scan your CI/CD pipeline started after a deploy. It shows the commit's short SHA, a link to the commit and a release label when your pipeline provides them.
Manual scanManual scanA scan someone started with Scan now.
Scheduled scanScheduled scanA scan a schedule ran. It is marked only when it changed something: the score moved, or issues were fixed or appeared.

Commit details come from your CI automatically

Version 1.2.0 and later of the PixyScan SDK read the commit from GitHub Actions, GitLab CI, Bitbucket Pipelines, CircleCI, Vercel and Netlify, so you change nothing in your pipeline. On GitHub Actions and GitLab CI, a build for a Git tag also adds the tag as a release label. Older SDK versions still mark the deploy, without the commit.

Clicks beside your pages and issues#

Two tables gain a Clicks and an Impressions column once Search impact is on: the Pages table and the affected pages of each issue.

Each figure is the page's Web search clicks or impressions over the last 28 days of data. Press a column's heading to sort by it, so the pages with the most traffic come first. A page Google has no data for shows a dash and sorts last.

Pages are matched to Google's data by address. A note above the table says how many were matched, for example Search Console data matched 812 of 940 pages. Small differences such as www, http or a trailing slash still match. Redirects are not followed, so a page Google knows only by an old address is not matched.

On the Pages table, the Bytes column starts hidden when the traffic columns are shown. Turn it back on from the column menu.

The Impact tab#

Impact lists every fix and regression your production scans recorded, and how the changed pages did in Google search afterwards.

After each production scan, PixyScan compares it with the previous full production scan of the same branch. Every check that stopped failing on some pages is a fix, and every check that started failing on some pages is a regression. Each one becomes a row here.

  1. 1

    Open the Impact tab

    On Search performance, choose Impact next to Queries and Pages.

  2. 2

    Filter the list

    Show all changes, fixes only or regressions only, and pick a status. Press the date or Lift vs rest of site heading to sort. The weekly charts of your health score and clicks sit above the list.

  3. 3

    Read a row

    Each row names the check, says whether it was fixed or appeared, and shows the date, how many of its pages have Search Console data, its status, and clicks before and after.

  4. 4

    Open a row for the page breakdown

    It lists the changed pages with their clicks and impressions before and after, the pages with the most clicks first.

app.pixyscan.com/w/…/s/…/search?tab=impact

One row per check a production scan fixed or introduced.

How a result is measured#

Each change is measured over fixed windows around the day of the scan that found it.

FieldLengthWhat it does
Before28 daysThe 28 days up to the day before the scan.
Gap7 daysA week for Google to recrawl the changed pages. Nothing in it is counted.
After28 daysThe 28 days that start a week after the scan.
Early signalFrom day 14A first result once half of the after window has data.

PixyScan compares clicks to the changed pages before and after, and does the same for the rest of the site over the same days. The result says how much better or worse the changed pages did than the rest of the site. It reads, for example: After this change, these pages did 15% better than the rest of the site.

Comparing with the rest of the site takes out what happened everywhere at once, such as a season or a Google update. If the changed pages lost 10% of their clicks while the rest of the site lost 30%, the changed pages did 29% better.

The windows are the same on every tier. Until the after window is complete, before and after figures are shown per day so they compare like with like. Once a result is Ready, it does not change.

A result shows what happened after a change, not why

Other things can move a page's clicks in the same weeks, such as new content, links from other sites or competitors. Read a result as what followed your change, not as proof that the change caused it.

What each status means#

A result moves from Measuring to Early signal to Ready. Some changes cannot be measured at all.

FieldBadgeWhat it does
MeasuringMeasuring · ready on 14 OctThe after window has not reached 14 days of data yet. The date is when the result should be ready, allowing for Google's usual delay.
Early signalEarly signal · 17 of 28 daysAt least 14 days of the after window have data. The result is provisional and can still change.
ReadyReadyAll 28 days are in. The result is final.
Not enough dataNot enough dataThe change cannot be measured. The reason is shown under the check's name.
Why a change shows Not enough data.
FieldReasonWhat it does
Too few pagesUnder 3Fewer than 3 of the changed pages have Search Console data.
Too few impressionsUnder 100The changed pages had under 100 impressions in the 28 days before.
History too shortYour tierThe search history your tier keeps does not reach 28 days before the change. PixyScan names a tier with longer history.
Connection interruptedPausedSearch Console was paused or reconnected during the measurement.
Nothing to compareNo rest of siteThe changed pages are almost all of the site's search traffic, so there is nothing left to compare them with.

Results on other screens#

The same results appear in three more places.

FieldWhereWhat it does
Search impact panelChangesThe fixes and regressions of the scan you are looking at, with their status and result, and a link to the full list on the Impact tab.
Your recent fixesOverviewUp to three Ready fixes whose pages did best against the rest of the site. It appears only when at least one fix did better.
Health score and clicks by weekOverview · ImpactTwo charts on one time axis: your health score from the last full production scan of each week, and Google clicks for each whole week, with the scan markers on both.

The weekly charts let you look at the two lines side by side. They do not work out how one affects the other, and they need at least two weeks that have both a score and clicks.

When clicks drop after a deploy#

PixyScan watches Google clicks in the days after each production deploy and tells you if they fell sharply.

It compares clicks in the 3 days after the deploy with the same 3 days of the week over the previous 4 weeks. It alerts only when all three of these are true:

FieldThresholdWhat it does
The drop is large25% or moreClicks fell by at least a quarter against the previous 4 weeks.
There is enough traffic100 clicksThose days normally get at least 100 clicks, so a few lost clicks on a quiet site do not count.
It is unusualBeyond normalThe drop is bigger than the site's normal week-to-week variation.

Google's newest days are provisional for two to three days, so the alert is decided about a week after the deploy (day 6 at the earliest). Several deploys on the same day share one check, and each deploy day alerts at most once.

The alert appears in the bell and on Site alerts, and opens Search performance at the deploy's marker. It is also emailed to the site's members and workspace admins, and sent to the Slack and generic webhooks when they are set. The message reads, for example: Clicks fell 32% in the 3 days after deploy a1b2c3d (branch main), compared with the same days of the previous 4 weeks.

If the site's Search Console data is later deleted, for example because Search Console was disconnected, alerts already sent stay in Site alerts but lose their click figures. Emails, Slack messages and webhook calls already delivered are not changed.

Turn off the email, keep the alert

In Site settings → Alerts, the switch Email when search clicks drop after a deploy is on by default. It controls the email only. The alert still shows in the app, and Slack and the webhook still get it whenever their URLs are set.

Does something here not match what you see in the app? Tell us