Skip to content
Brand Identity API

Crawler

BrandIdentityBot

BrandIdentityBot reads a company's public homepage to find its logos, brand colors and fonts for Brand Identity API. It visits a site when someone asks for that company's brand, fetches a handful of files, and stays away from any site that tells it to.

When it visits

A visit starts when someone asks for a company's brand: a customer through the API, a visitor typing a domain on this site, or us adding a well-known company to the brand directory. After the first visit, a record is refreshed only when someone asks for it and it is more than 30 days old, or 3 days if the last visit could not finish.

What it fetches

One visit reads the homepage and the files that page points to, and nothing else:

  • /robots.txt, first.
  • The homepage, up to 3 MB. No other page, no form and no login.
  • Up to seven logo or icon images that the homepage links to.
  • Up to eight stylesheets, 3 MB in all, and the Adobe Fonts kit they import, to read the brand colors and fonts.
  • The web app manifest and its icons, and the page's share image.

Company facts such as the founding year come from Wikidata, not from your site.

How it identifies itself

Most requests send a browser's user-agent with our token added, so sites serve the same markup people see:

text
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36 (compatible; BrandIdentityBot/1.0; +https://brandidentityapi.com/bot)

Where a site refuses browser strings from a data centre, it sends the token on its own:

text
BrandIdentityBot/1.0 (+https://brandidentityapi.com/bot)

How to stop it

Add a group that names BrandIdentityBot to your robots.txt. It then fetches nothing from your site, not even the homepage:

robots.txt
User-agent: BrandIdentityBot
Disallow: /

A general User-agent: * rule does not stop it. A visit happens because a person asked for one page, the way a link preview does, so only a rule addressed to BrandIdentityBot by name applies.

Correct or remove a brand

Logos and brand names belong to their owners. To correct a brand's record or have it removed, write to agenticstudio@gmail.com and name the domain.