Who we are
VentureKitBot is the name Private School Shortlist, an independent directory of private schools and learning programs, uses when it checks a provider's own website. Every request it sends carries this user agent:
VentureKitBot/1.0 (+https://privateschoolshortlist.com/bot/)
What it reads
It checks whether a provider's website is online, with a short request (a HEAD request, then a small GET if the site needs one) to the website address on the listing. To find a provider's published tuition, or whether its site says it is enrolling, it reads the provider's home page and a few linked pages or PDFs on the same site, so a listing can show the published price or the opening with its source and the date we read it. Before we write to a provider, it also checks that the business contact address we hold is still printed on the provider's own website, and, for a school we add from outside an official list, that the school's name appears there. It does not publish descriptions or photos, and it does not extract people's names or other personal details as listing facts.
It does not read the website of a provider whose listing shows only its city until the provider claims it.
How it behaves
- It reads your robots.txt before it fetches a page and follows it for VentureKitBot or for all robots (*). A page your robots.txt disallows is not fetched, and a redirect to a page your robots.txt disallows is not followed.
- If your robots.txt cannot be read (your server returns a 5xx error, does not answer, or refuses access with a 401 or 403), it does not read your site. If you have no robots.txt (a 404), nothing is disallowed.
- It never uses proxies, never solves CAPTCHAs, and never pretends to be a person's browser.
How to ask it to stop
Add these two lines to your robots.txt, in place of any rules you already have for VentureKitBot, and it will stop reading your site:
User-agent: VentureKitBot
Disallow: /
It reads your robots.txt at the start of each run, so a new rule applies from its next run.
You can also write to [email protected] with your website address to ask us to stop checking it or to review facts taken from it. The robots.txt rule above is the sure way.
If a fact about your school or program is wrong
Write to [email protected], or claim your listing for free. See corrections.