About FairestMirrorBot
If you run a med spa or clinic website and found this page in your server logs, this explains exactly what our crawler did, why, and how to stop it. Everything below is a promise you can hold us to — including a same-day way to have your prices taken down.
Who we are
Fairest Mirror is a price-comparison site for aesthetic treatments in the Scottsdale and Phoenix area. We list what clinics publish — per-unit neurotoxin prices, filler, laser, skincare — with the source URL and the date we saw it, so patients can compare before they call. We do not sell placement, we do not take referral fees, and a clinic cannot pay to move up. How we work →
How to identify our crawler
Every request we make carries this User-Agent:
FairestMirrorBot/1.0 (+https://thefairestmirror.com/bot; prices@thefairestmirror.com)
If a request claims to be us but does not match this string exactly, it is not us. We never disguise our crawler as a browser.
What it does — and what it never does
- Reads your
robots.txtfirst, every time, and obeys it. ADisallowmeans we do not fetch that path. - Fetches at most about a dozen public pages per site, roughly one request per second — a fraction of what a single visitor generates.
- Records facts only: the treatment name, the price as printed, the units, the page URL, and the time we read it.
- Comes back a few times a year, not daily.
We do not:
- Log in, create accounts, fill forms, or book appointments.
- Work around a block. If your site refuses our crawler, we record “not published” and move on — we do not retry with a browser user-agent.
- Call private or undocumented APIs, or scrape anything behind a paywall or portal.
- Copy your photos, before-and-afters, staff bios, or marketing copy. A price and a link back to you is all we keep.
How to block us
Add this to your robots.txt and we stop on our next pass:
User-agent: FairestMirrorBot Disallow: /
To block one section only, list those paths instead. If you would rather not edit a file, email prices@thefairestmirror.com and we will add your domain to our own do-not-fetch list.
Correcting or removing your listing
Blocking the crawler stops future reads; it does not remove what is already on the site. For that, email us and say which you want:
- Fix a price — tell us the correct number and where it is published. We check the page and update it.
- Remove your clinic — we take the listing and the map pin down. No argument, no retention period, no “claim it first” requirement.
- Stop crawling entirely — we stop and remove what we already hold.
We act within 24 hours and log every request with the time it arrived and the time we handled it. You do not need to be the clinic owner to report a wrong price — anyone can.
corrections@thefairestmirror.com · prices@thefairestmirror.com
Why we keep records
For each price we publish we keep the page we read it from, your robots.txt as it stood that day, and the server response we got. That is how we can show a price was public when we recorded it — and how we can prove we stopped when asked. Those records are ours alone; we do not republish your pages.
Questions this page does not answer: prices@thefairestmirror.com. Last updated 2026.